IC57753: ANR8779E WITH ERROR NUMBER=16 WHEN SAN DISCOVERY FAILS OR IS DISABLED.

APAR status

• Closed as program error.

Error description

• Customers' may run into an issue when TSM discovers a serial
  number mismatch on a drive it attempts to open.  This will
  happen when the drive we successfully opened reports a different
  serial number than what is stored in the TSM database,
  indicating that the wrong drive was opened.  When the serial
  mismatch occurs, TSM attempts to resolve the mismatch with SAN
  discovery.  However, if SAN Discovery fails or is disabled, then
  not only will TSM fail to open the intended drive, it will
  additionally neglect to close the wrong drive it had just opened
  while handling the SAN discovery failure or its disablement.
  Thus, there will be a SCSI reservation left on a drive that will
  not be released unless TSM or that drive is recycled.
  .
  If the above situation occurs, then the error number=16 will be
  seen on subsequent attempts to open the drive with a stale
  reservation leftover from this described behavior.  Thus, the
  server reporting the error number=16 generally did not cause the
  problem, but was only affected by the aftermath of this
  situation.  In many cases the TSM server or storage agent that
  left the stale reservation will throw an ANR8963E error message.
  .
  Customer/L2 Diagnostics (if applicable)
  Messages seen:
  ANR8779E Unable to open drive drive_name, error number=16
   ANR8963E Unable to find path to match the serial number defined
  for drive drive name  in library library nam
   .
  Tracing MMS NA PVRVOL PVRMP may show trace points similar to the
  following:
  .
  11:08:10.377 [16][pvr.c][5399]: (PvrOpenTapeDrive) Drive
  OXMF08R04 devtype 25 open rc 94 with handle 46 nonDelayFlag 0
  will call PvrOpenDevice again with nodelay
  11:08:10.394 [16][pspvr.c][2775]: device /dev/rmt12 is opened
  with handle 10 pass handel 10 back
  11:08:10.394 [16][pvr.c][5406]: (PvrOpenTapeDrive) Drive
  OXMF08R04 devtype 25 open rc 0 with handle 10 and nonDelayFlag
  is TRUE.
  11:08:10.394 [16][mmsdrive.c][7922]: MmsCheckTapeId: Checking
  drive OXMF08R04 information with openRc 0
  ...
  11:13:26.127 [16][pspvr.c][2678]: PvrDiscoverPath: rc = 34
  result = 268
  11:13:26.128 [16][mmsdrive.c][8478]: (MmsCheckTapeId)
  PvrDiscoverPath did not find a path to match desc serial
  [000007859353] for drive OXMF08R04
  11:13:26.128 [16][output.c][6361]: ANR8963E Unable to find path
  to match the serial number defined for drive OXMF08R04 in
  library IBM3584OXM3592-01 .~
  ...
  11:13:26.152 [16][pvr.c][5414]: (PvrOpenTapeDrive) Drive
  OXMF08R04 handle 10 checktapeId  rc is 30
  11:13:31.174 [16][pspvr.c][2740]: open() with errno is 11
  devName is /dev/rmt12
  .
  *NOTE*
  An ANR8779E with error number=11 (EAGAIN) may be also be seen on
  the culprit server or storage agent.
  .
  The fix needs to be applied to TSM servers (Library Managers and
  Library Clients), and Storage Agents
  .
  Platforms affected:
  TSM 5.3, 5.4, 5.5 (AIX, Solaris, HP, Linux, Windows)
   .
  Initial Impact: High
  .
  Additional Keywords: ANR8779E ANR8963E SanDiscovery drive
  errno=16 error number=16 errno=11 error number=11
  

Local fix

• Recycle drive
  

Problem summary

• ****************************************************************
  * USERS AFFECTED: All TSM servers and storage agents using     *
  *                 tape drives.                                 *
  ****************************************************************
  * PROBLEM DESCRIPTION: See ERROR DESCRIPTION.                  *
  ****************************************************************
  * RECOMMENDATION: Apply fixing level when available.  This     *
  *                 problem is currently projected to be fixed   *
  *                 in levels 5.4.4.1, 5.4.5, 5.5.1.1 and 5.5.2. *
  *                                                              *
  *                 Note that this is subject to change at the   *
  *                 discretion of IBM.                           *
  ****************************************************************
  See ERROR DESCRIPTION.
  

Problem conclusion

• The described problem has been resolved.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  TSM SERVER

• Fixed component ID

  5698ISMSV

Applicable component levels

• R53A PSY

     UP

• R53H PSY

     UP

• R53L PSY

     UP

• R53S PSY

     UP

• R53W PSY

     UP

• R53Z PSY

     UP

• R54A PSY

     UP

• R54H PSY

     UP

• R54L PSY

     UP

• R54S PSY

     UP

• R54W PSY

     UP

• R54Z PSY

     UP

• R55A PSY

     UP

• R55H PSY

     UP

• R55L PSY

     UP

• R55S PSY

     UP

• R55W PSY

     UP

• R55Z PSY

     UP