IBM Support

PM70063: ABEND S078 RSN=00000010 WHILE RUNNING WEBSPHERE CAUSED BY DOUBLE RELEASE OF STORAGE.

Fixes are available

8.5.0.2: WebSphere Application Server V8.5 Fix Pack 2
8.0.0.6: WebSphere Application Server V8.0 Fix Pack 6
7.0.0.29: WebSphere Application Server V7.0 Fix Pack 29
8.0.0.7: WebSphere Application Server V8.0 Fix Pack 7
8.0.0.8: WebSphere Application Server V8.0 Fix Pack 8
7.0.0.31: WebSphere Application Server V7.0 Fix Pack 31
7.0.0.33: WebSphere Application Server V7.0 Fix Pack 33
8.0.0.9: WebSphere Application Server V8.0 Fix Pack 9
7.0.0.35: WebSphere Application Server V7.0 Fix Pack 35
8.0.0.10: WebSphere Application Server V8.0 Fix Pack 10
7.0.0.37: WebSphere Application Server V7.0 Fix Pack 37
8.0.0.11: WebSphere Application Server V8.0 Fix Pack 11
7.0.0.39: WebSphere Application Server V7.0 Fix Pack 39
8.0.0.12: WebSphere Application Server V8.0 Fix Pack 12
7.0.0.41: WebSphere Application Server V7.0 Fix Pack 41
8.0.0.13: WebSphere Application Server V8.0 Fix Pack 13
7.0.0.43: WebSphere Application Server V7.0 Fix Pack 43
8.0.0.14: WebSphere Application Server V8.0 Fix Pack 14
7.0.0.45: WebSphere Application Server V7.0 Fix Pack 45
8.0.0.15: WebSphere Application Server V8.0 Fix Pack 15
7.0.0.29: Java SDK 1.6 SR13 FP2 Cumulative Fix for WebSphere Application Server
7.0.0.45: Java SDK 1.6 SR16 FP60 Cumulative Fix for WebSphere Application Server
7.0.0.31: Java SDK 1.6 SR15 Cumulative Fix for WebSphere Application Server
7.0.0.35: Java SDK 1.6 SR16 FP1 Cumulative Fix for WebSphere Application Server
7.0.0.37: Java SDK 1.6 SR16 FP3 Cumulative Fix for WebSphere Application Server
7.0.0.39: Java SDK 1.6 SR16 FP7 Cumulative Fix for WebSphere Application Server
7.0.0.41: Java SDK 1.6 SR16 FP20 Cumulative Fix for WebSphere Application Server
7.0.0.43: Java SDK 1.6 SR16 FP41 Cumulative Fix for WebSphere Application Server
Obtain the fix for this APAR.

Subscribe

You can track all active APARs for this component.

APAR status

  • Closed as program error.

Error description

  • Abend S078 rsn=00000010
    SEARCH ARGUMENT ABSTRACT
        PIDS/5655N0200 RIDS/BBODPCRT#L RIDS/BBOSSNAT AB/S0A78
        PRCS/00000010
        REGS/0C038 RIDS/BBODARR#R
        .
        Symptom             Description
        -------             -----------
        PIDS/5655N0200      Program id: 5655N0200
        RIDS/BBODPCRT#L     Load module name: BBODPCRT
        RIDS/BBOSSNAT       Csect name: BBOSSNAT
        AB/S0A78            System abend code: 0A78
        PRCS/00000010       Abend reason code: 00000010
        REGS/0C038          Register/PSW difference for R0C: 038
        RIDS/BBODARR#R      Recovery routine csect name: BBODARR
        .
    Task Completion Code: 84a78000
    .
    Traceback:
    DSA Entry       E  Offset Load Mod      Service  Status
    1   csnap       +000000B0 CELQLIB       D1E10:e  Call
    2   RasSignalHandler2
                    +00000E80 bbgras        CF21115  Call
    3   __zerro     +00000FB0 CELQLIB       D1E10:e  Call
    4   __zerros    +00000342 CELQLIB       D1E10:e  Call
    5   CEEHDSP     +000043C0 CELQLIB       D1E10    Call
    6   CEEOSIGJ    +00000992 CELQLIB       D1E10    Call
    7   CELQHROD    +00000262 CELQLIB       D1E10    Call
    8   CEEOSIGG    +1D77D720 CELQLIB       D1E10    Call
    9   CELQHROD    +00000262 CELQLIB       D1E10    Call
    10  bbossnap    -0000A012 libbbgsec.so  CF21115 Exception
    11  ntv_destroyCredential(JNIEnv_*,_jobject*,_jobject*)
                    +00000218 libbbgsec.so  CF21115  Call
    12  SIDECARINVOKEREFLECTMETHOD
                    +00000000 libj9vm24.so           Call
    13  JVM_InvokeMethod
                    +000000B2 libjvm.so     j201111  Call
    14  JVM_InvokeMethod
                    +0000002A libjvm.so     j201111  Call
    20  gpCheckCallin
                    +000000A4 libj9vm24.so  j201111  Call
    21  callVirtualObjectMethodA
                    +0000005E libj9vm24.so  j201111  Call
    22  ORBEJSBridge::invoke(void*)
                    +000011FE bbgorb        CF21115  Call
    23  threadDispatch
        (BOSS_Object_Key*,Internal_CORBA_Request&,ORB_
                    +00000EAE bbgboa        CF21115  Call
    24  SR_ExecutionThread::RemoveAndProcessWork
        (ThreadCleanUp*,TCB*
                    +00001BBC bbgboa        CF21115  Call
    25  SR_ExecutionRoutine
                    +000001B8 bbgboa        CF21115  Call
    26  CELQPCMM    +00000FAC CELQLIB       D1E10    Call
    .
    Offset     Function
    ------     --------
    00000000   bbossnap
    00000218   ntv_destroyCredential(JNIEnv_*,_jobject*,_jobject*)
    849ccd68   SIDECARINVOKEREFLECTMETHOD
    000000b2   JVM_InvokeMethod
    0000002a   JVM_InvokeMethod
    0000002a   Java_sun_reflect_NativeMethodAccessorImpl_invoke0
    849d16a8   RUNCALLINMETHOD
    0000003e   gpProtectedRunCallInMethod
    0000001c   signalProtectAndRunGlue
    0000071a   j9sig_protect
    000000a4   gpCheckCallin
    0000005e   callVirtualObjectMethodA
    000011fe   ORBEJSBridge::invoke(void*)
    00000eae   threadDispatch
    00001bbc   SR_ExecutionThread::RemoveAndProcessWork
               (ThreadCleanUp*,TCB*)
    000001b8   SR_ExecutionRoutine
    00000fac   CELQPCMM
    .
    Java stack:
    -----------
    Method
    ------
    com/ibm/ws/security/zOS/PlatformCredentialManager.
    ntv_destroyCredential
    com/ibm/ws/security/zOS/PlatformCredentialManager.
    ntv_destroyCredential
    com/ibm/ws/security/zOS/PlatformCredentialManager.
    destroyCredential
    com/ibm/ws/security/zOS/PlatformCredentialManager.
    removePlatformCredentialFromCache
    com/ibm/ws/security/auth/AuthCache.removeEntry
    com/ibm/ws/security/core/SecurityAdmin.purgeUserFromAuthCache
    sun/reflect/NativeMethodAccessorImpl.invoke0
    sun/reflect/NativeMethodAccessorImpl.invoke
    sun/reflect/DelegatingMethodAccessorImpl.invoke
    java/lang/reflect/Method.invoke
    sun/reflect/misc/Trampoline.invoke
    sun/reflect/GeneratedMethodAccessor41.invoke
    sun/reflect/DelegatingMethodAccessorImpl.invoke
    java/lang/reflect/Method.invoke
    sun/reflect/misc/MethodUtil.invoke
    javax/management/modelmbean/RequiredModelMBean.invokeMethod
    javax/management/modelmbean/RequiredModelMBean.invoke
    com/sun/jmx/interceptor/DefaultMBeanServerInterceptor.invoke
    com/sun/jmx/mbeanserver/JmxMBeanServer.invoke
    com/ibm/ws390/management/connector/corba/CorbaConnectorImpl.
    invoke
    com/ibm/ws390/management/connector/corba/
    _CorbaConnectorImplBase._invoke
    com/ibm/ws390/orb/CommonBridge.invoke
    com/ibm/ws390/orb/ORBEJSBridge.invoke
    sun/reflect/GeneratedMethodAccessor39.invoke
    sun/reflect/DelegatingMethodAccessorImpl.invoke
    java/lang/reflect/Method.invoke
    com/ibm/ws390/orb/parameters/ORBEJSBridgeInvoke.
    ORBEJSBridgeInvokeParmSetter
    ~~~
      There is a Double storage release showing in the SYSTRACE for
     the asid that abended.  The linkage stack entry showed a
     PC call to do the storage release and abended.
    .
    

Local fix

  • NONE...
    

Problem summary

  • ****************************************************************
    * USERS AFFECTED:  All users of IBM WebSphere Application      *
    *                  Server V7.0, V8.0, and V8.5                 *
    ****************************************************************
    * PROBLEM DESCRIPTION: ABEND S078 RSN=00000010 while running   *
    *                      security mbean purgeUserFromAuthCache.  *
    ****************************************************************
    * RECOMMENDATION:                                              *
    ****************************************************************
    The ABEND078 was caused by 2 threads racing to remove the same
    user from AuthCache, resulting in each thread attempting to
    free the same storage representing the same user. This can
    only occur when using the z/OS localOS registry, RACF.
    Thread1 was performing normal AuthCache
    expulsion due to cache timeout. Thread2 was performing
    expulsion of the same ID via the purgeUserFromAuthCache mbean.
    Application Server code was not properly synchronizing this
    operation.
    Note that this condition can occur without mbean
    purgeUserFromAuthCache involvement. It can occur with 2
    seperate threads performing normal AuthCache expulsion
    activity.
    

Problem conclusion

  • Thread synchronization has been corrected, preventing multiple
    threads from attempting to free the same cached identity.
    
    APAR PM70063 is currently targeted for inclusion in Fix Packs
    7.0.0.29, 8.0.0.6, and 8.5.0.2 of WebSphere Application Server.
    
    Please refer to URL:
    //www.ibm.com/support/docview.wss?rs=404&uid=swg27006970
    for Fix Pack availability.
    

Temporary fix

Comments

  • ž**** PE13/07/02 PTF IN ERROR. SEE APAR PM92213  FOR DESCRIPTION
    ž**** PE13/08/14 FIX IN ERROR. SEE APAR PM95128  FOR DESCRIPTION
    

APAR Information

  • APAR number

    PM70063

  • Reported component name

    WEBSPHERE FOR Z

  • Reported component ID

    5655I3500

  • Reported release

    700

  • Status

    CLOSED PER

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt

  • Submitted date

    2012-08-01

  • Closed date

    2012-11-13

  • Last modified date

    2013-11-18

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

  • Fixed component name

    WEBSPHERE FOR Z

  • Fixed component ID

    5655I3500

Applicable component levels

  • R700 PSY UK94926

       UP13/06/20 P F306

Fix is available

  • Select the PTF appropriate for your component level. You will be required to sign in. Distribution on physical media is not available in all countries.



Document information

More support for: WebSphere Application Server for z/OS
General

Software version: 7.0

Reference #: PM70063

Modified date: 18 November 2013