IBM Support

Web Crawler fails in GPFS with permission issues

Technote (troubleshooting)


The Web Crawler application fails in GPFS with permission issues.


When running the Web Crawler application in GPFS, the crawler creates two directories, /tmp/web-crawler and /tmp/mapred, with 750 permissions.

The application will run successfully the first time you executes it but will fail due to permission issues when other users try to run it.

Diagnosing the problem

The JobTracker log will display an error message.

Resolving the problem

As a workaround, before running the application, set permission to 777 for the /tmp/web-crawler and /tmp/mapred directories.

Related information

InfoSphere BigInsights Information Center

Document information

More support for: IBM BigInsights

Software version: 2.1.0

Operating system(s): Linux

Reference #: 1639396

Modified date: 03 June 2013

Translate this page: