IBM Support

IT19374: SERVER CRASH WITH STACK TRACE SHOWING TWO PKACQUIREMUTEXTRACKED ENTRIES FOLLOWING AN OUTPRINTFTRFL

Subscribe

You can track all active APARs for this component.

APAR status

  • Closed as program error.

Error description

  • The Tivoli Storage Manager/IBM Spectrum Protect server may crash
    when  the server gets caught in a loop trying to put out a
    diagnostic message. The second time through causes the server to
    try and get a mutex that the thread already has and causes the
    crash.  This was seen with the Query Nodedata command but occur
    with other commands
    
    
    Customer/L2 Diagnostics (if applicable)
    Call stack from the core file on AIX:
    
    dbx) where
    pthread_kill(??, ??) at 0x90000000055cf94 [untrusted:
    /usr/lib/libpthreads.a(shr_xpg5_64.o)]
    _p_pause() at 0x90000000055c7e4 [untrusted:
    /usr/lib/libpthreads.a(shr_xpg5_64.o)]
    initialize_libs(??, ??) at 0x900000000039a68 [untrusted:
    /usr/lib/libc.a(shr_64.o)]
    __d64_to_b128(1.2969223203332722e-320, 0x12b368652, 0x101108610)
    at 0x900000000055064 [untrusted:
    /usr/lib/libc.a(shr_64.o)]
    PsAbortServer(??) at 0x100015420
    pkAbort(??) at 0x10000c8e0
    pkAcquireMutexTracked(??, ??, ??) at 0x1000079d8 <--- acquire
    mutex (second time aborts)
    PkShowThreadsDetail(??) at 0x100011e80
    pkAcquireMutexTracked(??, ??, ??) at 0x100007c68  <--- acquired
    mutex (first time)
    StdPutText(??, ??, ??, ??, ??, ??) at 0x10001faa4
    outPrintfTrFL(0x588f5b05, 0x3900000019, 0xa0000001e,
    0x10110a0f4, 0x760362, 0x0, <--- put out diag message
    0xf1000a02305bdc00, 0x0) at 0x10000be20
    PkShowThreadsDetail(??) at 0x100011ea8
    pkAcquireMutexTracked(??, ??, ??) at 0x100007c68
    StdPutMsg(??, ??, ??, ??, ??, ??, ??, ??) at 0x10001e028
    outTabString(??, ??, ??, ??) at 0x1000251ec
    GetAndDisplayEntries(??, ??, ??, ??) at 0x100f0d810
    bfQueryNodeData(??, ??, ??, ??, ??, ??, ??, ??) at 0x100f0cc04
    AdmQueryNodeData(??) at 0x100f06d84
    AdmCommandLocal(??, ??, ??, ??, ??) at 0x1007af484
    admCommand(??, ??, ??, ??, ??) at 0x1007acf40
    SmAdminCommandThread(??) at 0x1008e0e10
    StartThread(0x0) at 0x10000da90
    (dbx)
    
    Activity Log
    01/30/17   10:25:56      ANR2017I Administrator U200522 issued
    command:  QUERY   NODEDATA *  (SESSION: 2872030)
    01/30/17   11:14:48      ANR7811I Using instance directory
    /tsmnas1/db2home.
    01/30/17   11:14:48      ANR4726I The Async I/O support module
    has been  loaded.
    01/30/17   11:14:49      ANR4726I The ICC support module has
    been loaded.
    01/30/17   11:14:49      ANR0990I Server restart-recovery in
    progress.
    
    Nothing in DB2diag.log at the time of the crash
    
    AIX errpt confirmed the stack from the debugger
    
    *NOTE*
    None
    
    Platforms affected:
    Linux, Unix, Windows  7.1, 8.1
    
    Initial Impact: Medium
    
    Additional Keywords: crash core abend
    

Local fix

Problem summary

  • ****************************************************************
    * USERS AFFECTED:                                              *
    * All Tivoli Storage Manager and IBM Spectrum Protect server   *
    * users.                                                       *
    ****************************************************************
    * PROBLEM DESCRIPTION:                                         *
    * See error description.                                       *
    ****************************************************************
    * RECOMMENDATION:                                              *
    * Apply fixing level when available. This problem is currently *
    * projected to be fixed in levels 7.1.8 and 8.1.2. Note that   *
    * this is subject to change at the discretion of IBM.          *
    ****************************************************************
    

Problem conclusion

  • This problem was fixed.
    Affected platforms for reported release:  AIX, HP-UX, Solaris,
    Linux, and Windows.
    Platforms fixed:  AIX, HP-UX, Solaris, Linux, and Windows.
    

Temporary fix

Comments

APAR Information

  • APAR number

    IT19374

  • Reported component name

    TSM SERVER

  • Reported component ID

    5698ISMSV

  • Reported release

    71A

  • Status

    CLOSED PER

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt / Xsystem

  • Submitted date

    2017-02-22

  • Closed date

    2017-04-20

  • Last modified date

    2017-04-20

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

  • Fixed component name

    TSM SERVER

  • Fixed component ID

    5698ISMSV

Applicable component levels

  • R71A PSY

       UP

  • R71L PSY

       UP

  • R71H PSY

       UP

  • R71S PSY

       UP

  • R71W PSY

       UP

  • R81A PSY

       UP

  • R81L PSY

       UP

  • R81W PSY

       UP



Document information

More support for: Tivoli Storage Manager

Software version: 7.1.3

Reference #: IT19374

Modified date: 20 April 2017