LI80574: BACKUP FOR CERTAIN PORTAL SITES FAILS

APAR status

• Closed as program error.

Error description

• In case of a failure we find these entries in the www-pod-log
  (see attached admin-0.log):
  [ syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: failed to open stream: Permission denied
  mysql.php:318
  [ syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Command Finished: /opt/ibm/bin/backup_site -b
  [ syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Could not write database backup file mysqldump
  Further investigations within the www-pod-admin container
  reveals that a reason for the failure might be erroneous file
  permissions in the directory
  /var/aegir/platforms/devportal-8.x-2018.4.1.1-20181214-1128/site
  s/businesshub.ab-test1.api-portal-dev.hub-test.com
  We believe that because after changing the file permission with
  command "chmod 755..." manually the backup worked perfectly
  well.
  As a manual change of the file permission within a container is
  no solution, we are asking to correct the root cause of the
  backup failure.
  Please find attached the logs files for the www-pod, db-pod and
  nginx pod.
  https://ecurep.mainz.de.ibm.com/ae5/#id=TS001826272&path=TS00182
  6272%2F2019-01-23%2F
  Error in logs
  [    lsyncd stdout] 9b1b9a:9b1b9a:089090 2019-01-23 17:07:25:
  17:07:25 Normal: Finished events list = 0
  [  director stderr] 9b1b9a:9b1b9a:038418 2019-01-23 17:07:26:
  c54a9b39 2019-01-23 17:07:26: Site with URL
  api-portal-dev.hub-test.ose.db.de/businesshub/db-openapi-dev
  (api-portal-dev.hub-test.ose.db.de@businesshub@db-openapi-dev-20
  190123.170718.tar.gz) successfully uploaded
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:26:
  backup_site: Site with URL
  api-portal-dev.hub-test.ose.db.de/businesshub/db-openapi-dev
  (api-portal-dev.hub-test.ose.db.de@businesshub@db-openapi-dev-20
  190123.170718.tar.gz) successfully uploaded
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:26:
  backup_site: Command Finished: /opt/ibm/bin/backup_site -b
  055bc55b-1791-4e20-a021-9cbc817475d0.5f8f1cbc-bae7-48a7-b668-031
  9c3b830cf with RC 0
  [  director stderr] 9b1b9a:9b1b9a:038418 2019-01-23 17:07:26:
  c54a9b39 child process "FROM_EXEC=1 backup_site -b
  055bc55b-1791-4e20-a021-9cbc817475d0.5f8f1cbc-bae7-48a7-b668-031
  9c3b830cf" exited with code: 0
  [  director stderr] 9b1b9a:9b1b9a:038418 2019-01-23 17:07:26:
  c54a9b39 Spawning command: FROM_EXEC=1 backup_site -b
  055bc55b-1791-4e20-a021-9cbc817475d0.866561bb-6a20-473d-9403-b36
  2a6cba2a9
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:26:
  backup_site: Command Started: /opt/ibm/bin/backup_site -b
  055bc55b-1791-4e20-a021-9cbc817475d0.866561bb-6a20-473d-9403-b36
  2a6cba2a9
  [  director stderr] 9b1b9a:9b1b9a:038418 2019-01-23 17:07:26:
  c54a9b39 2019-01-23 17:07:26: Making a backup for site
  api-portal-dev.hub-test.ose.db.de/businesshub/ab-test1
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:26:
  backup_site: Making a backup for site
  api-portal-dev.hub-test.ose.db.de/businesshub/ab-test1
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:26:
  backup_site: Running: drush8 --format=json sa
  @businesshub.ab-test1.api-portal-dev.hub-test.com
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:26:
  backup_site: backing up admin_invite data to site DB:
  businesshubabtes
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Running: drush8
  @businesshub.ab-test1.api-portal-dev.hub-test.ose.db.de
  provision-backup
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Error occurred in script backup_site at line: 105.
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site:
  fopen(/var/aegir/platforms/devportal-8.x-2018.4.1.1-20181214-112
  8/sites/businesshub.ab-test1.api-portal-dev.hub-test.com/d
  atabase.sql):  [warning]
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Line exited with status: 1
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: failed to open stream: Permission denied
  mysql.php:318
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Command Finished: /opt/ibm/bin/backup_site -b
  055bc55b-1791-4e20-a021-9cbc817475d0.866561bb-6a20-473d-9403-b36
  2a6cba2a9 with RC 1
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Could not write database backup file mysqldump
                        [error]
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: filesize(): stat failed for
                      [warning]
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site:
  /var/aegir/platforms/devportal-8.x-2018.4.1.1-20181214-1128/site
  s/businesshub.ab-test1.api-portal-dev.hub-test.com/databas e.sql
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: mysql.php:332
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Could not generate database backup from mysqldump.
  (error: )             [error]
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Deleted mysql dump from sites directory
                      [success]
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Error occurred in script drush at line: 76.
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Line exited with status: 1
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Running: drush8
  @businesshub.ab-test1.api-portal-dev.hub-test.com
  provision-backup
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site:
  fopen(/var/aegir/platforms/devportal-8.x-2018.4.1.1-20181214-112
  8/sites/businesshub.ab-test1.api-portal-dev.hub-test.com/d
  atabase.sql):  [warning]
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: failed to open stream: Permission denied
  mysql.php:318
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Could not write database backup file mysqldump
                        [error]
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: filesize(): stat failed for
                      [warning]
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site:
  /var/aegir/platforms/devportal-8.x-2018.4.1.1-20181214-1128/site
  s/businesshub.ab-test1.api-portal-dev.hub-test.ose.db.de/databas
  e.sql
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: mysql.php:332
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Could not generate database backup from mysqldump.
  (error: )             [error]
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Deleted mysql dump from sites directory
                      [success]
  [   syslogd stdout] 9b1b9a:9b1b9a:6402ac 2019-01-23 17:07:27:
  backup_site: Error occurred in script drush at line: 76.
  

Local fix

Problem summary

• Portal site directories sometime went readyonly. We now check
  for this and fix it.
  

Problem conclusion

• Fixed in 2018.4.1.2
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  API CONNECT ENT

• Fixed component ID

  5725Z2201

Applicable component levels

• R18X PSY

     UP