IC91138: "AUDIT VOLUME" ON A DEDUPLICATED STGPOOL VOLUME MAY RESULT IN ANR9999D_2164256325 AND ANR9999D_2547000324

IBM Tivoli Storage Manager V6.3 Fix Pack 5 (6.3.5.000) Server Downloads

APAR status

• Closed as program error.

Error description

• The Tivoli Storage Manager server AUDIT VOLUME process on
  deduplicated storage pool volumes might result in the following
  ANR9999D message which will cause the AUDIT VOLUME process
  to terminate prematurely.
  
  The process should mark the file as damaged and continue
  auditing the rest of the files that reside on the given volume.
  
  The cause of the ANR9999D message, and invalid termination of
  the process, are missing links (deduplication referential
  integrity problem) in the catalog of the Tivoli Storage Manager
  server.
  
  Customer/L2 Diagnostics
  Example actlog output of an AUDIT VOLUME from a 6.3.3.000
  server:
  
   ANR9999D_2164256325 BfGetBitfileExtents(bfaggrut.c:4572)
    Thread<235657>: BFBE Entry not found for object 123457
    (SESSION: 9, PROCESS: 5)
   ANR9999D Thread<235657> issued message 9999 from:
    ANR9999D Thread<235657>  0x00000000d6ae73 OutDiagToCons
    ANR9999D Thread<235657>  0x00000000d6dc68 outDiagfExt
    ANR9999D Thread<235657>  0x0000000065bc9c BfGetBitfileExtents
    ANR9999D Thread<235657>  0x00000000676966 bfRtrvExt
    ANR9999D Thread<235657>  0x0000000073b77a AfAuditBitfile
    ANR9999D Thread<235657>  0x00000000670629 bfAuditBitfile
    ANR9999D Thread<235657>  0x00000000504e40 AdmAuditVolThread
    ANR9999D Thread<235657>  0x00000000dfc3e6 StartThread
    ANR9999D Thread<235657>  0x000036cac07851 *UNKNOWN*
    ANR9999D Thread<235657>  0x000036ca4e890d *UNKNOWN*
  
    ANR9999D_2547000324 bfRtrvExt(bfrtrv.c:1444) Thread<235657>:
      Error 9979 obtaining deduplication information for object
      123457 in super bitfile 2087565032 in pool 14
      (SESSION: 9, PROCESS: 5)
   ANR9999D Thread<235657> issued message 9999 from:
   ANR9999D Thread<235657>  0x00000000d6ae73 OutDiagToCons
   ANR9999D Thread<235657>  0x00000000d6dc68 outDiagfExt
   ANR9999D Thread<235657>  0x000000006771d9 bfRtrvExt
   ANR9999D Thread<235657>  0x0000000073b77a AfAuditBitfile
   ANR9999D Thread<235657>  0x00000000670629 bfAuditBitfile
   ANR9999D Thread<235657>  0x00000000504e40 AdmAuditVolThread
   ANR9999D Thread<235657>  0x00000000dfc3e6 StartThread
   ANR9999D Thread<235657>  0x000036cac07851 *UNKNOWN*
   ANR9999D Thread<235657>  0x000036ca4e890d *UNKNOWN*
  
   ANR2327W Audit volume process terminated for volume
    /dedup/file01.bfs - internal server error detected.
    (SESSION: 9, PROCESS: 5)
   ANR0515I Process 1145 closed volume  /dedup/file01.bfs.
    (SESSION: 9, PROCESS: 5)
   ANR0985I Process 1145 for AUDIT VOLUME (REPAIR) running in
    the BACKGROUND completed with completion state FAILURE at
    11:16:10 AM. (SESSION: 9, PROCESS: 5)
   ANR1893E Process 1145 for AUDIT VOLUME (REPAIR) completed
    with a completion state of FAILURE. (SESSION: 9, PROCESS: 5)
  
  | MDVREGR 6.3.3.000-TIV_5698MSV |
  
  Tivoli Storage Manager Versions Affected:
  Tivoli Storage Manager  server 6.3.3.x on all platforms
  
  Initial Impact:
  medium
  
  Additional Keywords:
  zz63 TSM audit dedup deduplicate dedupe invalid header
  

Local fix

Problem summary

• ****************************************************************
  * USERS AFFECTED: All Tivoli Storage Manager server users.     *
  ****************************************************************
  * PROBLEM DESCRIPTION: See ERROR DESCRIPTION.                  *
  ****************************************************************
  * RECOMMENDATION: Apply fixing level when available.           *
  *                 This problem is currently projected          *
  *                 to be fixed in level 6.3.5.                  *
  *                 Note that this is subject to change at the   *
  *                 discretion of IBM.                           *
  ****************************************************************
  *
  

Problem conclusion

• This problem was fixed.
  Affected platforms:  AIX, HP-UX, Solaris, Linux, and Windows.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  TSM SERVER

• Fixed component ID

  5698ISMSV

Applicable component levels

• R63A PSY

     UP

• R63H PSY

     UP

• R63L PSY

     UP

• R63S PSY

     UP

• R63W PSY

     UP