IBM Support What's New?

Content Analytics has 'Out of Memory' errors on Linux

Technote (troubleshooting)


I am running IBM Content Analytics with Enterprise Search on RHEL 6.3 64-bit, which runs correctly as long as only one collection runs at a time. If I start multiple collections, out of memory errors occur.


Output from the command 'esadmin system stop' shows:

FFQC5306I Stopping the system...
JVMDUMP039I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError"

Also, numerous Javacore files are generated in the /logs directory that contain entries similar to the following:

"Failed to create a thread"
"2CIUSERLIMIT   RLIMIT_NPROC                          1024               515312 "


The soft limit of the number of processes for the user is 1024 in Javacore. On Linux this means that the total number of threads are (equal to number of processes) limited to 1K, which is too small for multiple collections.

Resolving the problem

See the documentation link in the Related information section below for instructions on checking the ulimit settings on Linux.

In addition, the documentation is missing the following ulimit settings when working with Linux:
<USER_ID> soft nproc 16384
<USER_ID> hard nproc 32768

<USER_ID> soft as unlimited
<USER_ID> hard as unlimited

Related information

Setting ulimit values

Document information

More support for: Watson Content Analytics

Software version: 3.0

Operating system(s): Linux

Reference #: 1635090

Modified date: 2014-05-03