IT18399: ANR3731E WRITE TO IBM COS FAILS WITH 500 OR 503 HTTP STATUS CODE

7.1.7.200-TIV-TSMSRV-Linuxs390x
7.1.7.200-TIV-TSMSRV-Linuxppc64
7.1.7.200-TIV-TSMSRV-WIN
7.1.7.200-TIV-TSMSRV-SolarisSPARC
7.1.7.200-TIV-TSMSRV-Linuxx86_64
7.1.7.200-TIV-TSMSRV-HP-UX
7.1.7.200-TIV-TSMSRV-AIX
IBM Spectrum Protect Server V7.1.7.X interim fix downloads
IBM Spectrum Protect Server V7.1 Fix Pack 8 (7.1.8.000) Downloads

APAR status

• Closed as program error.

Error description

• While transferring/writing/storing to IBM COS (formerly
  Cleversafe) the following error message may be seen:
  ANR3731E A request to the cloud service provider for the write
  object operation on the <Cloud Pool Name> storage pool failed
  with the 503 HTTP status code
  A 500 HTTP status code may also be seen.
  
  The IBM COS has had a problem completing the write requests from
  the IBM Spectrum Protect server due to the size of the
  multi-part objects being sent and the frequency of the retries
  when a failure occurs. This APAR is being taken to change the
  part size the server is sending to a larger value and increase
  the retry time to avoid causing these failures in the IBM COS.
  Note that these failures can occur at cloud pool ingest time
  when there is no directory container cache in the cloud pool. Or
  they can occur at data transfer time when there is directory
  container cache in the cloud pool.
  The dsmffdc.log may also show the following:
  [ FFDC_GENERAL_SERVER_ERROR ]: (sdcloud.c:3567)
  com.tivoli.dsm.cloud.api.ProviderS3 uploadFile Retrying upload
  of 000000000000216d.dcf; attempts = 1
  [ FFDC_GENERAL_SERVER_ERROR ]: (sdcloud.c:3567)
  com.tivoli.dsm.cloud.api.ProviderS3 handleException
  com.amazonaws.AmazonClientException Unable to complete
  multi-part upload. Individual part upload failed : Unable to
  execute HTTP request: Read timed out
  Tivoli Storage Manager Versions Affected: 7.1.6 and 7.1.7 all
  platforms (Fixed in 8.1)
  Initial Impact: Medium
  Additional Keywords: TSM
  

Local fix

• Contact L2 support for test-fix code.
  

Problem summary

• ****************************************************************
  * USERS AFFECTED:                                              *
  * All IBM Spectrum Protect server users with a cloud storage   *
  * pool backed by IBM Cloud Object Storage.                     *
  ****************************************************************
  * PROBLEM DESCRIPTION:                                         *
  * See error description.                                       *
  ****************************************************************
  * RECOMMENDATION:                                              *
  * Apply fixing level when available. This problem is fixed in  *
  * 8.1 and currently projected to be fixed in levels 7.1.7.200  *
  * and 7.1.8. Note that this is subject to change at the        *
  * discretion of IBM.                                           *
  ****************************************************************
  

Problem conclusion

• This problem was fixed.
  Affected platforms for reported release: AIX, Linux, Windows,
  and Solaris.
  Platforms fixed: AIX, Linux, Windows, and Solaris.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  TSM SERVER

• Fixed component ID

  5698ISMSV

Applicable component levels