IBM Support

PM50450: SERVER HANG WITH WEB CONTAINER THREADS WAITING ON COM/IBM/WS/HTTP/HTTPTRANSPORT.REINITIALIZE

Fixes are available

8.0.0.3: WebSphere Application Server V8.0 Fix Pack 3
7.0.0.23: WebSphere Application Server V7.0 Fix Pack 23
8.0.0.4: WebSphere Application Server V8.0 Fix Pack 4
7.0.0.25: WebSphere Application Server V7.0 Fix Pack 25
8.0.0.5: WebSphere Application Server V8.0 Fix Pack 5
7.0.0.27: WebSphere Application Server V7.0 Fix Pack 27
8.0.0.6: WebSphere Application Server V8.0 Fix Pack 6
7.0.0.29: WebSphere Application Server V7.0 Fix Pack 29
8.0.0.7: WebSphere Application Server V8.0 Fix Pack 7
6.1.0.47: WebSphere Application Server V6.1 Fix Pack 47
8.0.0.8: WebSphere Application Server V8.0 Fix Pack 8
7.0.0.31: WebSphere Application Server V7.0 Fix Pack 31
7.0.0.27: Java SDK 1.6 SR13 FP2 Cumulative Fix for WebSphere Application Server
7.0.0.33: WebSphere Application Server V7.0 Fix Pack 33
8.0.0.9: WebSphere Application Server V8.0 Fix Pack 9
7.0.0.35: WebSphere Application Server V7.0 Fix Pack 35
8.0.0.10: WebSphere Application Server V8.0 Fix Pack 10
7.0.0.37: WebSphere Application Server V7.0 Fix Pack 37
8.0.0.11: WebSphere Application Server V8.0 Fix Pack 11
7.0.0.39: WebSphere Application Server V7.0 Fix Pack 39
8.0.0.12: WebSphere Application Server V8.0 Fix Pack 12
7.0.0.41: WebSphere Application Server V7.0 Fix Pack 41
8.0.0.13: WebSphere Application Server V8.0 Fix Pack 13
7.0.0.43: WebSphere Application Server V7.0 Fix Pack 43
8.0.0.14: WebSphere Application Server V8.0 Fix Pack 14
7.0.0.45: WebSphere Application Server V7.0 Fix Pack 45
8.0.0.15: WebSphere Application Server V8.0 Fix Pack 15
6.1.0.47: Java SDK 1.5 SR16 Cumulative Fix for WebSphere Application Server
7.0.0.23: Java SDK 1.6 SR10 FP1 Cumulative Fix for WebSphere
7.0.0.25: Java SDK 1.6 SR11 Cumulative Fix for WebSphere Application Server
7.0.0.27: Java SDK 1.6 SR12 Cumulative Fix for WebSphere Application Server
7.0.0.29: Java SDK 1.6 SR13 FP2 Cumulative Fix for WebSphere Application Server
7.0.0.45: Java SDK 1.6 SR16 FP60 Cumulative Fix for WebSphere Application Server
7.0.0.31: Java SDK 1.6 SR15 Cumulative Fix for WebSphere Application Server
7.0.0.35: Java SDK 1.6 SR16 FP1 Cumulative Fix for WebSphere Application Server
7.0.0.37: Java SDK 1.6 SR16 FP3 Cumulative Fix for WebSphere Application Server
7.0.0.39: Java SDK 1.6 SR16 FP7 Cumulative Fix for WebSphere Application Server
7.0.0.41: Java SDK 1.6 SR16 FP20 Cumulative Fix for WebSphere Application Server
7.0.0.43: Java SDK 1.6 SR16 FP41 Cumulative Fix for WebSphere Application Server

Subscribe

You can track all active APARs for this component.

APAR status

  • Closed as program error.

Error description

  • Server hang with javacores with webcontainer threads that are
    waiting on the following:
    "Non-deferrable Alarm : 3" J9VMThread:0x35202D00,
    j9thread_t:0x351CA9DC
    java/lang/Thread:0x915AC6D0, state:CW, prio=5
           (native thread ID:0x5C10039, native priority:0x5, native
    policy:UNKNOWN)
          Java callstack:
              at java/lang/Thread.sleep(Native Method)
              at java/lang/Thread.sleep(Thread.java:851(Compiled
    Code))
              at
    com/ibm/ws/http/HttpTransport.reinitialize(HttpTransport.java:13
    9)
              at
    com/ibm/ws/management/connector/soap/SOAPServer.stateChanged(SOA
    PServer.
    java:82)
              at
    com/ibm/ws/ssl/config/SSLConfigManager.notifySSLConfigChangeList
    ener(SSL
    ConfigManager.java:3125)
              at
    com/ibm/ws/ssl/config/SSLConfigManager.initializeServerSSL(SSLCo
    nfigMana
    ger.java:278)
              at
    com/ibm/ws/security/core/distSecurityComponentImpl.configChanged
    (distSec
    urityComponentImpl.java:1866)
              at
    com/ibm/ws/management/component/ConfigChangeHandler$ConfigChange
    EventDis
    patcher.run(ConfigChangeHandler.java:344)
              at
    com/ibm/ws/management/component/ConfigChangeHandler.alarm(Config
    ChangeHa
    ndler.java:158)
              at
    com/ibm/ejs/util/am/_Alarm.run(_Alarm.java:127(Compiled
    Code))
              at
    com/ibm/ws/util/ThreadPool$Worker.run(ThreadPool.java:1550(Compi
    led
    Code))
    .
    There is a while-loop in HttpTransport that is prone to an
    infinite loop if the server socket does not close cleanly when
    the SOAP server is trying to reinitialize. The SSL change
    triggers the SOAP server to reinitialize to pick up the
    new SSL configuration. This infinite loop occurs if the server
    socket does not close in 1.2 seconds. Each javacore was taken
    about every 3 minutes and each shows the same thread blocking
    the other threads, which confirms that the server socket failed
    to close in less than 1.2 seconds and the infinite loop occurs.
    .
    Fix to eliminate the possibility that the code can go into an
    infinite loop (loop caused by the server socket not closing
    in the 1.2 seconds window).
    

Local fix

Problem summary

  • ****************************************************************
    * USERS AFFECTED:  All users of IBM WebSphere Application      *
    *                  Server V7.0 and V8.0                        *
    ****************************************************************
    * PROBLEM DESCRIPTION: The logic to reinitialize a server      *
    *                      socket could cause a hang in the        *
    *                      WebSphere process if the socket is      *
    *                      not closed quickly enough.              *
    ****************************************************************
    * RECOMMENDATION:                                              *
    ****************************************************************
    A hanging socket could cause the WebSphere process to hang.
    Java callstack:
    at java/lang/Thread.sleep(Native Method)
    at java/lang/Thread.sleep(Thread.java:851(CompiledCode))
    at
    com/ibm/ws/http/HttpTransport.reinitialize(HttpTransport.java:13
    9)
    at
    com/ibm/ws/management/connector/soap/SOAPServer.stateChanged(SOA
    PServer.java:82)
    at
    com/ibm/ws/ssl/config/SSLConfigManager.notifySSLConfigChangeList
    ener(SSLConfigManager.java:3125)
    at
    com/ibm/ws/ssl/config/SSLConfigManager.initializeServerSSL(SSLCo
    nfigManager.java:278)
    at
    com/ibm/ws/security/core/distSecurityComponentImpl.configChanged
    (distSecurityComponentImpl.java:1866)
    at
    com/ibm/ws/management/component/ConfigChangeHandler$ConfigChange
    EventDispatcher.run(ConfigChangeHandler.java:344)
    at
    com/ibm/ws/management/component/ConfigChangeHandler.alarm(Config
    ChangeHandler.java:158)
    at
    com/ibm/ejs/util/am/_Alarm.run(_Alarm.java:127(CompiledCode))
    at
    com/ibm/ws/util/ThreadPool$Worker.run(ThreadPool.java:1550(Compi
    ledCode))
    

Problem conclusion

Temporary fix

Comments

APAR Information

  • APAR number

    PM50450

  • Reported component name

    WEBS APP SERV N

  • Reported component ID

    5724H8800

  • Reported release

    700

  • Status

    CLOSED PER

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt

  • Submitted date

    2011-10-19

  • Closed date

    2012-01-05

  • Last modified date

    2013-07-22

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

  • Fixed component name

    WEBS APP SERV N

  • Fixed component ID

    5724H8800

Applicable component levels

  • R700 PSY

       UP

  • R800 PSY

       UP



Document information

More support for: WebSphere Application Server
General

Software version: 7.0

Reference #: PM50450

Modified date: 22 July 2013