IBM Support

QM ETL Job fails with 401 or 403 error when using HTTP Proxy and OAuth authentication

Troubleshooting


Problem

The QM ETL data collection jobs fail with IBM Rational Quality Manager (RQM).

Symptom

You see entries similar to this in qm-etl.log:


RQMPriorityETL:execute AQXRE5002E Artifact data was not pulled into the reporting data warehouse because of the following exception: com.ibm.rational.etl.common.exception.ETLException: org.xml.sax.SAXParseException: Content is not allowed in prolog.

java.sql.SQLException: com.ibm.rational.etl.common.exception.ETLException: org.xml.sax.SAXParseException: Content is not allowed in prolog.



The data collection job "Quality Management" always fails even though the collection user has the QM collection license and the Quality Manager client license, is in JazzAdmins group and is also a member of the QM project. The ID can be used to login qm/admin as well to run jobs.

These 3 jobs are not affected: Common, Repository and Work Items.

Alternatively, the qm-etl.log shows the following error:


2013-01-04 22:02:44,111 [ WebContainer : 12] ERROR com.ibm.team.datawarehouse.service.rqm - RemoteRQMSnapshotService:updateSnapshot AQXRE5002E Artifact data was not pulled into the reporting data warehouse because of the following exception: An exception has occurred during ETL Job execution. ETL job terminating with following error message:com.ibm.rational.etl.common.exception.ETLException: com.ibm.rational.etl.common.exception.ETLException: com.ibm.rational.dataservices.client.auth.AuthenticationException: CRRRE1417E: The HTTP status '401' and the message is 'Unauthorized'. The user may not have privilege to access the project area or the username or password may be incorrect or ETL user does not have Data Collector license or Jazz Admin privilege.



Here is another error that might appear:


2013-09-24 00:03:12,142 [qm: AsynchronousTaskRunner-3 @@ 00:02] ERROR com.ibm.team.datawarehouse.service.rqm - RemoteRQMSnapshotService:runODS AQXRE5002E Artifact data was not pulled into the reporting data warehouse because of the following exception: An exception has occurred during ETL Job execution. ETL job terminating with following error message:com.ibm.rational.etl.common.exception.ETLException: com.ibm.rational.etl.common.exception.ETLException: com.ibm.rational.dataservices.client.auth.AuthenticationException: CRRRE1417E: The HTTP status '403' and the message is 'Forbidden'. The user may not have privilege to access the project area or the username or password may be incorrect or ETL user does not have Data Collector license or Jazz Admin privilege...
at com.ibm.team.datawarehouse.service.rqm.internal.etlbuild.AbstractRQMETLBuild.logDetailsForError(AbstractRQMETLBuild.java:70)



The job might run for other projects.

Cause

The fronting Proxy server configuration with IBM HTTP Server or Apache HTTP is changing the URLs. This was reported as a defect under APAR PM81427.

Environment

  1. You have configured the ETL jobs to run with oAuth (JTS) authentication.
  2. You have an HTTP fronting server or reverse proxy such as Apache HTTP or IBM HTTP Server.

    To check which server it is, enter the following in a browser:
    http://<server_name> or https://<server_name>

Diagnosing The Problem

There is an extra setup step for the QM documentation for the fronting IBM HTTP Server (IHS) for the CLM distributed environments. If you do not perform setup with the required steps, the QM ETL fails. The QM ETL issue is caused by missing the configuration in the IBM HTTP Server as mentioned in this document:

https://jazz.net/forum/questions/98087/qm-401-data-collection-job-quality-management-consistently-fails

Resolving The Problem

Complete these steps with IBM HTTP Server:



Complete these steps with Apache Mod Proxy:

Note: Please note the proxy server must be restarted for the change to take affect.

Related information

Apache: http://httpd.apache.org/docs/2.2/mod/mod_proxy.html

IHS:
RQM:
Workaround:

Use FORM based authentication instead of Jazz Team Server for your ETL.

[{"Product":{"code":"SSUVV6","label":"IBM Engineering Test Management"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Component":"Reports","Platform":[{"code":"PF033","label":"Windows"},{"code":"PF027","label":"Solaris"},{"code":"PF016","label":"Linux"},{"code":"PF002","label":"AIX"}],"Version":"4.0;4.0.0.1;4.0.0.2;4.0.1;4.0.2;4.0.3;4.0.4","Edition":"","Line of Business":{"code":"LOB59","label":"Sustainability Software"}}]

Product Synonym

Rational Quality Manager

Document Information

Modified date:
16 June 2018

UID

swg21632841

Page Feedback