IBM Support

X4001:Internal Error:Out Of Memory when running a Modeler or Clementine stream

Troubleshooting


Problem

I am running a stream in Modeler\Clementine and get this error: X4001:internal error:out of memory. How can I fix this?

Resolving The Problem

This error will occur if all memory (physical plus swap space) on your server is being used. In this case if Modeler\Clementine server needs to claim more memory it cannot and this error results. You do not see this error under usual circumstances.

Typically this will happen if on your server you have other processes running that are consuming resources, meaning that the free RAM on the system is a lot less that the total RAM. Because Modeler\Clementine Server bases it's memory usage on total RAM, in situations where there is only a very small amount of free RAM Modeler\Clementine Server can start using swap if the stream processing requires it, if all of this is used then you will get this error. By the time you see this error performance will probably have seriously degraded.

To prevent this error, you should place tighter restrictions on the amount of memory that Modeler\Clementine Server can access for sort-based processing operations on the Server machine. To do this reduce the memory_usage parameter in the Modeler\Clementine Server \config\options.cfg file. Try setting this to 50 and then execute the stream again (if you are running in server mode any changes made in this configuration file will require you to restart Modeler\Clementine Server before they take effect). This will prevent Modeler\Clementine Server from trying to address so much memory (it will use it's own disk-spilling mechanism instead), and so should prevent the error. If you see this error when building neural net, kohonen, or K-Means models you should reduce the value of the "modelling_memory_limit_percentage" parameter in the same file and restart server.

This error should be rare if you are working on a server with adequate resources, as the default memory settings for Modeler\Clementine should prevent this. If you are seeing this error frequently it is worth checking the load and specification of your server machine to see if it requires an upgrade

[{"Product":{"code":"SS3RA7","label":"IBM SPSS Modeler"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Component":"Modeler","Platform":[{"code":"PF002","label":"AIX"},{"code":"PF010","label":"HP-UX"},{"code":"PF016","label":"Linux"},{"code":"PF027","label":"Solaris"},{"code":"PF033","label":"Windows"}],"Version":"Not Applicable","Edition":"","Line of Business":{"code":"LOB10","label":"Data and AI"}}]

Historical Number

41791

Document Information

Modified date:
16 June 2018

UID

swg21474829