IBM Support

ANR3704E jvm failure on cloud storage pool space

Technote (troubleshooting)


Problem(Abstract)

A client backup on cloud storage pool fails with error ANR3704E and ANR0522W

Symptom

Spectrum Protect server activity log shows following error:

ANR3704E sdcloud.c(xxxx): Unable to load the jvm for the cloud storage pool.
ANR0522W Transaction failed for session 23 for node <node_name> - no space available in storage pool <cloud_pool_name> and all successor pools.


Cause

Permission issue


Diagnosing the problem

Enable an IBM Spectrum Protect server trace; the traceflag 'SDCLOUD SPI SPID' helps to identify the issue:


13:08:57.393 [287][sdcloud.c][3172][FindJVMLib]:JVM_LIB environment variable set. Using: /opt/tivoli/tsm/jre/bin/j9vm/libjvm.a
13:08:57.393 [287][sdcloud.c][3177][FindJVMLib]:Trying JVM library at: /opt/tivoli/tsm/jre/bin/j9vm/libjvm.a
13:08:57.393 [287][pkload.c][333][pkLoadModuleExt]:pkLoadModule entered, modName: /opt/tivoli/tsm/jre/bin/j9vm/libjvm.a
13:08:57.393 [287][pkload.c][392][pkLoadModuleExt]:Attempting to open module '/opt/tivoli/tsm/jre/bin/j9vm/libjvm.a'
13:08:57.394 [287][pkload.c][460][pkLoadModuleExt]:Error loading module /opt/tivoli/tsm/jre/bin/j9vm/libjvm.a: Permission denied errno = 13
13:08:57.394 [287][sdcloud.c][3247][LoadJVMLib]:pkLoadModuleExt got rc = -1; errmsg = 0; succmsg = 0
13:08:57.394 [287][sdcloud.c][3260][LoadJVMLib]:Exit: rc=-1
13:08:57.394 [2][ffdcutil.c][377][FFDCLogThread]:[07-25-2017 13:08:57.394][ FFDC_GENERAL_SERVER_ERROR ]: (sdcloud.c:3257) Unable to load jvm.
13:08:57.395 [287][sdcloud.c][1754][PutConsoleMsg]:ANR3704E sdcloud.c(1754): Unable to load the jvm for the cloud storage pool.~


Resolving the problem

Error code 13 indicates a permission issue. In this example the IBM Spectrum Protect server was running as a non-root user. This results in 755 (r-x for OTHER / PUBLIC) permission as noted on the below directory and files


The j9vm directory
- /opt/tivoli/tsm/jre/bin/j9vm/libjvm.a
- /opt/tivoli/tsm/jre/bin/j9vm/libjvm.so

Also, check the permission of dependent files:
>ldd libjvm.a
libjvm.a needs:
/usr/lib/libc_r.a(shr_64.o)
/unix
/usr/lib/libcrypt.a(shr_64.o)
/usr/lib/libc.a(shr_64.o)

In this example, the user has the following permission to the directory:
drwx------ 2 root system 256 Apr 20 17:51 j9vm

Updating the permissions as follows, helped to resolve the issue.
drwxr-xr-x 2 root system 256 Apr 20 18:51 j9vm

Related information

Configure JRE

Product Alias/Synonym

TSM

Document information

More support for: IBM Spectrum Protect
Server

Software version: 7.1, 8.1

Operating system(s): AIX

Reference #: 2007481

Modified date: 22 August 2017


Translate this page: