Content Search Services is unable to initialize the language tokenizer preventing all Content Based Retrieval indexing

Diagnosing The Problem

On the CSS server, the error in the trace*.log will be similar to this:

<message>IQQI0005E The document with ID {A4066CC9-64BF-45C1-A6AA-FECDA7793E0A} cannot be indexed.
Causes of the problem:
IQQP6000E The tokenizer cannot be initialized with the UIMA descriptor /app/IBM/ContentSearchServices/CSS_Server/resource/uima//aggregate_indexing_default.xml and data directory /app/IBM/ContentSearchServices/CSS_Server/resource/uima/:/app/IBM/ContentSearchServices/CSS_Server/config/dictionaries/.
IQQG0020E org.apache.uima.resource.ResourceInitializationException: Initialization of annotator class "com.ibm.es.nuvo.tokenizer.annotators.FrostWrapperAnnotator" failed. (Descriptor: file:/app/IBM/ContentSearchServices/CSS_Server/resource/uima/langware.xml)
IQQG0020E java.lang.NullPointerException
java.io.File.&lt;init&gt;(File.java:233)
com.ibm.dltj.CapMatrix.getRequestedFiles(Unknown Source)
com.ibm.dltj.CapMatrix.setDataSpec(Unknown Source)
com.ibm.dltj.CapMatrix.setDataSpec(Unknown Source)
com.ibm.dltj.CapMatrix.&lt;init&gt;(Unknown Source)
com.ibm.dltj.uima_annotator.lex_analysis.DictionariesCacheManager.&lt;init&gt;(DictionariesCacheManager.java:77)
...

Steps to confirm the permissions on the mounted drive:

1) Check to see if the Content Search Services installation is located on an NFS mounted drive using:

df -k

and look for the path to the Content Search Services installation.

2) Check to see if read/execute permission to the mounted drive is granted to the user who runs Content Search Services, starting at the top level directory.

An ls -al of the mounted drive, shows permission denied.

For example:

$ ls -al /ibm
ls: 0653-345 /ibm/..: Permission denied.
total 0
drwxr-xr-x    4 root     system          256 Aug 16 11:08 .
drwxr-xr-x    2 root     system          256 Aug 16 11:07 lost+found
drwxr-xr-x    2 root     system          256 Aug 16 11:08 FileNet

3) Create the Test.java program on the same drive as Content Search Services is installed.

public class Test {
   public static void main(String[] args)  {
       System.out.println(System.getProperty("user.dir"));
   }
}

Compile the above java using this command:
/usr/java6/bin/javac Test.java

Run the test using this command:
/usr/java6/bin/java Test

The output of the test on the NFS mount with incorrect permissions will be ".".

Testing the same java program by copying it to a local drive like /tmp should result in the local drive path instead of "." as the value for "user.dir".