IT28430: ANR9999D_2835836899 InstGetDB2stmtPass1 Error in fetching DB2 statement stats, rc=2359 displayed on 8.1.7 server restart

8.1.9.000-IBM-SPSRV-WindowsX64
8.1.9.000-IBM-SPSRV-Linuxx86_64
8.1.9.000-IBM-SPOC-WindowsX64
8.1.9.000-IBM-SPCMS-WindowsX64
8.1.9.000-IBM-SPSRV-Linuxs390x
8.1.9.000-IBM-SPCMS-WindowsI32
8.1.9.000-IBM-SPOC-Linuxx86_64
8.1.9.000-IBM-SPCMS-Linuxx86_64
8.1.9.000-IBM-SPSRV-Linuxppc64le
8.1.9.000-IBM-SPOC-Linuxs390x
8.1.9.000-IBM-SPOC-LinuxPPC64le
8.1.9.000-IBM-SPSRV-AIX
8.1.9.000-IBM-SPOC-AIX
IBM Spectrum Protect Server V8.1 Fix Pack 8 (V8.1.9) Downloads

APAR status

• Closed as program error.

Error description

• Error Description: After upgrading to 8.1.7, ANR9999D messages
  may appear if servermon ALWAYSON=yes.
  
  
  Spectrum Protect Versions Affected: 8.1.7.00 and higher
  on all supported platforms
  
  
  
  Customer/L2 Diagnostics: The Errors in the activity log will
  look like this
  
  ANR2017I Administrator SERVER_CONSOLE issued command:
  INSTRUMENTATION BEGIN
  
  ANR0944E QUERY PROCESS: No active processes found.
  
  ANR9999D_2835836899 InstGetDB2stmtPass1(instr.c:545)
  Thread<364>: Error in fetching DB2 statement stats, rc=2359
  
  ANR9999D Thread<364> issued message 9999 from:
  ANR9999D Thread<364> 0x1260d3c dsmserv(OutDiagToCons+0x16c)
  
  ANR9999D Thread<364>0x1263f9c dsmserv(outDiagfExt +0x1fc)
  ANR9999D Thread<364> 0x127ec91 dsmserv(instrumentStart+0x911)
  ANR9999D Thread<364> 0x636b89 dsmserv(AdmInstrumentBegin+0x1c9)
  ANR9999D Thread<364> 0x571a3e dsmserv(AdmCommandLocal+0x24e)
  ANR9999D Thread<364> 0x573ab0 dsmserv(admCommand+0x1680)
  ANR9999D Thread<364> 0x12b5f37 dsmserv(RunCommand+ 0x1a7)
  ANR9999D Thread<364> 0x12b6dd2
  dsmserv(ServerMonTwentyMinThread+0x552)
  ANR9999D Thread<364>0x13317b0 dsmserv(StartThread+0x90)
  
  if you run server in foreground you will see:
  
  ANR2017I Administrator SERVER_CONSOLE issued command:
  INSTRUMENTATION BEGIN
  The db2updvXX tool needs to be run to update routine
  definitions.
  

Local fix

• Even though the db2-level might be updated to the latest version
  11.1.4.4, run the below set of commands
  
  1. Stop TSM server and issue the following commands as the
  instance owner.
  
  db2 force application all
  db2 terminate
  
  2.  login as root user
  
  3.  run  /opt/tivoli/tsm/db2/instance/db2iupdt -d <instance
  name>
  
  4.  login as the instance owner ID
  
  5. issue the command:   db2updv111 -d TSMDB1
  

Problem summary

• ****************************************************************
  * USERS AFFECTED:                                              *
  * All IBM Spectrum Protect server users.                       *
  ****************************************************************
  * PROBLEM DESCRIPTION:                                         *
  * See error description.                                       *
  ****************************************************************
  * RECOMMENDATION:                                              *
  * Apply fixing level when available. This problem is currently *
  * projected to be fixed in level 8.1.9. Note that this is      *
  * subject to change at the discretion of IBM.                  *
  ****************************************************************
  

Problem conclusion

• This problem was fixed.
  Affected platforms: AIX, Linux, and Windows.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  TSM SERVER

• Fixed component ID

  5698ISMSV

Applicable component levels