IBM Support

IT15819: "ANR9999D_1487689131 SSRECONSTRUCT SPACE NOT PREALLOCATED IN POOL XX" DURING DATA MOVEMENT OPERATION.

Subscribe

You can track all active APARs for this component.

APAR status

  • Closed as program error.

Error description

  • A data movement process can fail with:
    
    ANR9999D_1487689131 ssReconstruct(ssrecons.c:678)
     Thread<170>: Space not preallocated in pool XX.
    .
    ANR1156W Move data process terminated for volume XYZ -
      internal server error detected.~
    
    when switching between aggregated (reconstructed) and
    non-aggregated (copied) objects going to different storage pools
    under the same transaction.
    
    This is a different issue than what previous APARS IC97229  and
    IC92336 corrected.
    
    Example:
    
    Storage pool hierarchy is as such:
    
    DISKPOOL1(45) maxsize: 512KB -> DISKPOOL2(40) maxsize: 1GB ->
    DISKPOOL3(46)
    
    Allocating space fails for a non-aggregate in storage pool
    DISKPOOL2(40) with rc=3001 for a large file due to maxsize:
    
    14:21:36.337 [170][afmove.c][7191][MoveBatch]:Processing bitfile
    6843998738.
    14:21:36.337
    [170][pvrclass.c][7741][pvrTestSetRclmTypInDevcl]:Device class
    CLASS, snaplockClass 1, reclamationType 0
    14:21:36.337 [170][aftxn.c][979][AfAllocBitfileEx]:Entry from
    afcreate.c(1315)
    14:21:36.337 [170][afcreate.c][2291][AfAllocSpace]:return code
    3001 from ssAlloc or ssSWAlloc for Ck1=1833 Ck2=1 pool 40
    14:21:36.337 [170][afcreate.c][1341][AfCopy]:AfAllocSpace
    returned rc=3001 for destPoolId=40, ck1=1833, ck2=1, alloc
    mode=2, size=1453860694.
    
    So it retries storing the file in the DISKPOOL3(46) pool.
    
    14:21:36.339 [170][asalloc.c][2680][AsReserveSpace]:Reserving
    space in storage pool 46.
    
    Here is the next file which is an aggregate being stored in
    DISKPOOL2(40).
    
    14:22:37.271 [170][afmove.c][7191][MoveBatch]:Processing bitfile
    6844012316.
    
    14:22:37.289 [170][asalloc.c][2680][AsReserveSpace]:Reserving
    space in storage pool 40.
    
    Which fails because the pool got switched from the last file and
    now there is stale pool information:
    
    14:22:37.301 [170][asalloc.c][2816][AsReserveSpace]:Storage pool
    40 is not collocated.
    14:22:37.302 [170][ssalloc.c][1118][ssAlloc]:ssAlloc: rc for
    reserve is 0.
    14:22:37.312
    [170][output.c][7647][PutConsoleMsg]:ANR9999D_1487689131
    ssReconstruct(ssrecons.c:678) Thread<170>: Space not
    preallocated in pool 46.~
    14:22:38.019 [170][output.c][7647][PutConsoleMsg]:ANR9999D
    Thread<170> issued message 9999 from:~
    14:22:38.019 [170][output.c][7647][PutConsoleMsg]:ANR9999D
    Thread<170>  00007FFA029159D8 OutDiagToCons()+158~
    14:22:38.020 [170][output.c][7647][PutConsoleMsg]:ANR9999D
    Thread<170>  00007FFA0290F4CD outDiagfExt()+10d~
    14:22:38.020 [170][output.c][7647][PutConsoleMsg]:ANR9999D
    Thread<170>  00007FFA0287FB5C ssReconstruct()+43c~
    14:22:38.020 [170][output.c][7647][PutConsoleMsg]:ANR9999D
    Thread<170>  00007FFA021CA4C7 AfReconstruct()+417~
    14:22:38.020 [170][output.c][7647][PutConsoleMsg]:ANR9999D
    Thread<170>  00007FFA0219146C BfReconstruct()+380c~
    14:22:38.021 [170][output.c][7647][PutConsoleMsg]:ANR9999D
    Thread<170>  00007FFA021DAF79 MoveBatch()+10d9~
    14:22:38.021 [170][output.c][7647][PutConsoleMsg]:ANR9999D
    Thread<170>  00007FFA021D7F8C MoveVolume()+eac~
    14:22:38.021 [170][output.c][7647][PutConsoleMsg]:ANR9999D
    Thread<170>  00007FFA021D37D3 AfMoveVolume()+313~
    14:22:38.021 [170][output.c][7647][PutConsoleMsg]:ANR9999D
    Thread<170>  00007FFA021D3FAD AfMoveDataThread()+10d~
    14:22:38.021 [170][output.c][7647][PutConsoleMsg]:ANR9999D
    Thread<170>  00007FFA01F77641 startThread()+141~
    14:22:38.022 [170][output.c][7647][PutConsoleMsg]:ANR9999D
    Thread<170>  00007FFA01B44F7F beginthreadex()+107~
    14:22:38.022 [170][output.c][7647][PutConsoleMsg]:ANR9999D
    Thread<170>  00007FFA01B45126 endthreadex()+192~
    14:22:38.022 [170][output.c][7647][PutConsoleMsg]:ANR9999D
    Thread<170>  00007FFA1A4A13D2 BaseThreadInitThunk()+22~
    14:22:38.022 [170][output.c][7647][PutConsoleMsg]:ANR9999D
    Thread<170>  00007FFA1BB254E4 RtlUserThreadStart()+34~
    14:22:38.023
    [170][afcreate.c][1815][AfReconstruct]:ssReconstruct failed with
    rc = 9999, srcBfId = 6844012316, srcPoold = 42, targetBfId =
    6939093381, destPoolId = 40
    14:22:38.023
    [170][bfcreate.c][5930][BfReconstruct]:AfReconstruct returned
    rc=9979 for destPoolId=40, bfId=6844012316,
    targetBfId=6939093381, ck1=1833, ck2=1, totalSize=807834,
    srcPoolId=42.
    
    
    Tivoli Storage Manager versions affected:
    Tivoli Storage Manager Server: 6.3.x and 7.1.X and higher on all
    platforms
    
    
    
    Initial Impact: Low
    
    
    Additional Keywords: TSM IBM Spectrum Protect move stgpool
    maxsize error
    

Local fix

  • Specifying 'reconstruct=no' on data movement commands will avoid
     this issue unless deduplication is involved.
    or
    Issue "move data", such that it moves data to the last pool in
    the maxsize storage pool setting hierarchy.
    

Problem summary

  • ****************************************************************
    * USERS AFFECTED:                                              *
    * All Tivoli Storage Manager and Spectrum Protect server       *
    * users.                                                       *
    ****************************************************************
    * PROBLEM DESCRIPTION:                                         *
    * See ERROR DESCRIPTION.                                       *
    ****************************************************************
    * RECOMMENDATION:                                              *
    * Apply fixing level when available. This problem is currently *
    * projected to be fixed in levels 7.1.8 and 8.1.2. Note that   *
    * this is subject to change at the discretion of IBM.          *
    ****************************************************************
    

Problem conclusion

  • This problem was fixed.
    Affected platforms:  AIX, HP-UX, Solaris, Linux, and Windows.
    

Temporary fix

Comments

APAR Information

  • APAR number

    IT15819

  • Reported component name

    TSM SERVER

  • Reported component ID

    5698ISMSV

  • Reported release

    71W

  • Status

    CLOSED PER

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt / Xsystem

  • Submitted date

    2016-06-22

  • Closed date

    2017-02-27

  • Last modified date

    2017-02-27

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

  • Fixed component name

    TSM SERVER

  • Fixed component ID

    5698ISMSV

Applicable component levels

  • R71A PSY

       UP

  • R71H PSY

       UP

  • R71L PSY

       UP

  • R71S PSY

       UP

  • R71W PSY

       UP

  • R81A PSY

       UP

  • R81L PSY

       UP

  • R81W PSY

       UP



Document information

More support for: Tivoli Storage Manager

Software version: 7.1.3

Reference #: IT15819

Modified date: 27 February 2017