Troubleshooting
Problem
A client backup on cloud storage pool fails with error ANR3704E and ANR0522W
Symptom
Spectrum Protect server activity log shows following error:
ANR3704E sdcloud.c(xxxx): Unable to load the jvm for the cloud storage pool.
ANR0522W Transaction failed for session 23 for node <node_name> - no space available in storage pool <cloud_pool_name> and all successor pools.
Cause
Permission issue
Diagnosing The Problem
Enable an IBM Spectrum Protect server trace; the traceflag 'SDCLOUD SPI SPID' helps to identify the issue:
13:08:57.393 [287][sdcloud.c][3172][FindJVMLib]:JVM_LIB environment variable set. Using: /opt/tivoli/tsm/jre/bin/j9vm/libjvm.a
13:08:57.393 [287][sdcloud.c][3177][FindJVMLib]:Trying JVM library at: /opt/tivoli/tsm/jre/bin/j9vm/libjvm.a
13:08:57.393 [287][pkload.c][333][pkLoadModuleExt]:pkLoadModule entered, modName: /opt/tivoli/tsm/jre/bin/j9vm/libjvm.a
13:08:57.393 [287][pkload.c][392][pkLoadModuleExt]:Attempting to open module '/opt/tivoli/tsm/jre/bin/j9vm/libjvm.a'
13:08:57.394 [287][pkload.c][460][pkLoadModuleExt]:Error loading module /opt/tivoli/tsm/jre/bin/j9vm/libjvm.a: Permission denied errno = 13
13:08:57.394 [287][sdcloud.c][3247][LoadJVMLib]:pkLoadModuleExt got rc = -1; errmsg = 0; succmsg = 0
13:08:57.394 [287][sdcloud.c][3260][LoadJVMLib]:Exit: rc=-1
13:08:57.394 [2][ffdcutil.c][377][FFDCLogThread]:[07-25-2017 13:08:57.394][ FFDC_GENERAL_SERVER_ERROR ]: (sdcloud.c:3257) Unable to load jvm.
13:08:57.395 [287][sdcloud.c][1754][PutConsoleMsg]:ANR3704E sdcloud.c(1754): Unable to load the jvm for the cloud storage pool.~
Resolving The Problem
Error code 13 indicates a permission issue. In this example the IBM Spectrum Protect server was running as a non-root user. This results in 755 (r-x for OTHER / PUBLIC) permission as noted on the below directory and files
The j9vm directory
- /opt/tivoli/tsm/jre/bin/j9vm/libjvm.a
- /opt/tivoli/tsm/jre/bin/j9vm/libjvm.so
Also, check the permission of dependent files:
>ldd libjvm.a
libjvm.a needs:
/usr/lib/libc_r.a(shr_64.o)
/unix
/usr/lib/libcrypt.a(shr_64.o)
/usr/lib/libc.a(shr_64.o)
In this example, the user has the following permission to the directory:
drwx------ 2 root system 256 Apr 20 17:51 j9vm
Updating the permissions as follows, helped to resolve the issue.
drwxr-xr-x 2 root system 256 Apr 20 18:51 j9vm
Related Information
Product Synonym
TSM
Was this topic helpful?
Document Information
Modified date:
17 June 2018
UID
swg22007481