Web Crawler fails in GPFS with permission issues

Technote (troubleshooting)


Problem(Abstract)

The Web Crawler application fails in GPFS with permission issues.

Cause

When running the Web Crawler application in GPFS, the crawler creates two directories, /tmp/web-crawler and /tmp/mapred, with 750 permissions.

The application will run successfully the first time you executes it but will fail due to permission issues when other users try to run it.


Diagnosing the problem

The JobTracker log will display an error message.

Resolving the problem

As a workaround, before running the application, set permission to 777 for the /tmp/web-crawler and /tmp/mapred directories.

Related information

InfoSphere BigInsights Information Center

Rate this page:

(0 users)Average rating

Add comments

Document information


More support for:

InfoSphere BigInsights
GPFS

Software version:

2.1.0

Operating system(s):

Linux Red Hat - pSeries, Linux Red Hat - xSeries, Linux SUSE - pSeries, Linux SUSE - xSeries

Reference #:

1639396

Modified date:

2013-06-14

Translate my page

Machine Translation

Content navigation