IBM Support

IT17801: OPEN FILE HANDLES ON STORAGE SERVER NOT RELEASED CAUSING MEMORY LEAK

Subscribe

You can track all active APARs for this component.

 

APAR status

  • Closed as program error.

Error description

  • Open File handles on Storage Server are not released
    causingmemory leak.
    Restart IBM B2B Advanced Communications to release file handles.
    
    When being under load testing for an extended period (2-3h) B2B
    Advanced Communications 1.0.0.4_3 seem to cause the the Windows
    server
    that hosts the MEIG_Payload (and Non_repudiation) store to
    'leak'
    memory. Monitoring the server revealed the memory of the box
    gradually increases and does
    NOT go down even after the test has completed.
    
    After several tests, the memory of the
    box increases and causes B2BAC to throw the "STORAGE not
    available/reachable error" and cause complete failure.
    
    Stack Trace from Operational_16.09.09_11.18.54.0.log
    ================================================================
    ======================
    ****************************************************************
    ****************
    product = WebSphere Application Server 8.5.5.6
    (wlp-1.0.9.cl50620150610-1749)
    wlp.install.dir = D:/Program Files/IBM/Multi-Enterprise
    Integration Gateway/Members/Operational/
    java.home = D:\Program Files\IBM\Multi-Enterprise Integration
    Gateway\java\jre
    java.version = 1.7.0
    java.runtime = Java(TM) SE Runtime Environment
    (pwa6470sr9fp10-20150708_01 (SR9 FP10))
    os = Windows Server 2008 R2 (6.1; amd64) (en_AU)
    process = 17444@SYD02H251WVA1
    ****************************************************************
    ****************
    [8/09/16 17:44:51:566 AEST] 000d7826
                                      E BCXAS4513E:
    [\\SYD02H258WVA2\MEIG_STORAGE\nonRepudiation\nonRepudiation_var0
    0\expiration\2016\10\08\07\44\000000020028dca2006e6f6e5265707564
    696174696f6e00cca7a76011e36d2c00000157a3406f6e] error occurred
    during WSHttpDataReaderCallBack handler while initializing
    storage {1}
    com.ibm.b2b.storage.core.spi.exception.FileOpenException:
    \\SYD02H258WVA2\MEIG_STORAGE\nonRepudiation\nonRepudiation_var00
    \expiration\2016\10\08\07\44\000000020028dca2006e6f6e52657075646
    96174696f6e00cca7a76011e36d2c00000157a3406f6e
        at
    com.ibm.b2b.storage.fs.providers.filesystem.FileSystemStore.star
    tPutWritableData(FileSystemStore.java:458)
        at
    com.ibm.b2b.storage.server.jmx.UsageCountingStore.startPutWritab
    leData(UsageCountingStore.java:136)
        at
    com.ibm.b2b.storage.core.providers.dispatch.DispatchStore.startP
    utWritableData(DispatchStore.java:124)
        at
    com.ibm.b2b.comms.as4.transport.http.activity.impl.RawRequestSto
    rageActivity.callStorage(RawRequestStorageActivity.java:247)
        at
    com.ibm.b2b.comms.as4.transport.http.activity.impl.RawRequestSto
    rageActivity.executeActivity(RawRequestStorageActivity.java:142)
        at
    com.ibm.b2b.comms.as4.transport.http.activity.impl.RawRequestSto
    rageActivity.executeActivity(RawRequestStorageActivity.java:70)
        at
    com.ibm.b2b.comms.as4.common.ebms.activity.GenericActivity.perfo
    rmActivity(GenericActivity.java:87)
        at
    com.ibm.b2b.comms.as4.common.ebms.activity.GenericActivity.perfo
    rmActivity(GenericActivity.java:111)
        at
    com.ibm.b2b.comms.as4.ed.transport.http.EbMSDataReaderCallBack.c
    allReaderCallbackChain(EbMSDataReaderCallBack.java:228)
        at
    com.ibm.b2b.comms.as4.ed.transport.http.EbMSDataReaderCallBack.c
    omplete(EbMSDataReaderCallBack.java:177)
        at
    com.ibm.b2b.comms.generichttp.GenericHTTPApplicationChannelReadC
    allback.complete(GenericHTTPApplicationChannelReadCallback.java:
    74)
        at
    com.ibm.b2b.ws.http.channel.internal.inbound.HttpInboundServiceC
    ontextImpl.getRequestBodyBuffer(HttpInboundServiceContextImpl.ja
    va:1617)
        at
    com.ibm.b2b.comms.generichttp.GenericHTTPChainDataReaderImpl.rea
    d(GenericHTTPChainDataReaderImpl.java:141)
        at
    com.ibm.b2b.comms.as4.transport.http.activity.impl.RequestDataRe
    adActivity.executeActivity(RequestDataReadActivity.java:80)
        at
    com.ibm.b2b.comms.as4.transport.http.activity.impl.RequestDataRe
    adActivity.executeActivity(RequestDataReadActivity.java:45)
        at
    com.ibm.b2b.comms.as4.common.ebms.activity.GenericActivity.perfo
    rmActivity(GenericActivity.java:87)
        at
    com.ibm.b2b.comms.as4.common.ebms.activity.GenericActivity.perfo
    rmActivity(GenericActivity.java:111)
        at
    com.ibm.b2b.comms.as4.common.ebms.activity.GenericActivity.perfo
    rmActivity(GenericActivity.java:111)
        at
    com.ibm.b2b.comms.as4.common.ebms.activity.GenericActivity.perfo
    rmActivity(GenericActivity.java:111)
        at
    com.ibm.b2b.comms.as4.common.ebms.activity.GenericActivity.perfo
    rmActivity(GenericActivity.java:111)
        at
    com.ibm.b2b.comms.as4.ed.transport.http.AS4EDHTTPTransportReceiv
    er.readyToAccept(AS4EDHTTPTransportReceiver.java:287)
        at
    Proxy5c977a5a_643a_4f95_b9c8_c91d0fd86928.readyToAccept(Unknown
    Source)
        at
    com.ibm.b2b.comms.generichttp.multiplexer.GenericHTTPDataMultipl
    exer.multiplexInternal(GenericHTTPDataMultiplexer.java:306)
        at
    com.ibm.b2b.comms.generichttp.multiplexer.GenericHTTPDataMultipl
    exer.multiplex(GenericHTTPDataMultiplexer.java:149)
        at
    Proxyf6db6575_0e88_4459_bc84_f5ed1939c57c.multiplex(Unknown
    Source)
        at
    com.ibm.b2b.comms.generichttp.GenericHTTPApplicationConnectionLi
    nk.configureAndStartListener(GenericHTTPApplicationConnectionLin
    k.java:174)
        at
    com.ibm.b2b.comms.generichttp.GenericHTTPApplicationConnectionLi
    nk.ready(GenericHTTPApplicationConnectionLink.java:431)
        at
    com.ibm.b2b.ws.http.channel.internal.inbound.HttpInboundLink.han
    dleDiscrimination(HttpInboundLink.java:474)
        at
    com.ibm.b2b.ws.http.channel.internal.inbound.HttpInboundLink.han
    dleNewRequest(HttpInboundLink.java:407)
        at
    com.ibm.b2b.ws.http.channel.internal.inbound.HttpInboundLink.pro
    cessRequest(HttpInboundLink.java:309)
        at
    com.ibm.b2b.ws.http.channel.internal.inbound.HttpInboundLink.rea
    dy(HttpInboundLink.java:281)
        at
    com.ibm.b2b.ws.tcpchannel.internal.NewConnectionInitialReadCallb
    ack.sendToDiscriminators(NewConnectionInitialReadCallback.java:1
    73)
        at
    com.ibm.b2b.ws.tcpchannel.internal.NewConnectionInitialReadCallb
    ack.complete(NewConnectionInitialReadCallback.java:82)
        at
    com.ibm.b2b.ws.tcpchannel.internal.WorkQueueManager.requestCompl
    ete(WorkQueueManager.java:509)
        at
    com.ibm.b2b.ws.tcpchannel.internal.WorkQueueManager.attemptIO(Wo
    rkQueueManager.java:557)
        at
    com.ibm.b2b.ws.tcpchannel.internal.WorkQueueManager.workerRun(Wo
    rkQueueManager.java:906)
        at
    com.ibm.b2b.ws.tcpchannel.internal.WorkQueueManager$Worker.run(W
    orkQueueManager.java:988)
        at
    java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExec
    utor.java:1157)
        at
    java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe
    cutor.java:627)
        at java.lang.Thread.run(Thread.java:798)
    Caused by: java.nio.file.FileSystemException:
    \\SYD02H258WVA2\MEIG_STORAGE\nonRepudiation\nonRepudiation_var00
    \expiration\2016\10\08\07\44\000000020028dca2006e6f6e52657075646
    96174696f6e00cca7a76011e36d2c00000157a3406f6e: Insufficient
    system resources exist to complete the requested service.
    
        at
    sun.nio.fs.WindowsException.translateToIOException(WindowsExcept
    ion.java:99)
        at
    sun.nio.fs.WindowsException.rethrowAsIOException(WindowsExceptio
    n.java:103)
        at
    sun.nio.fs.WindowsChannelFactory.newAsynchronousFileChannel(Wind
    owsChannelFactory.java:212)
        at
    sun.nio.fs.WindowsFileSystemProvider.newAsynchronousFileChannel(
    WindowsFileSystemProvider.java:152)
        at
    java.nio.channels.AsynchronousFileChannel.open(AsynchronousFileC
    hannel.java:260)
        at
    com.ibm.b2b.storage.fs.providers.filesystem.FileSystemStore.star
    tPutWritableData(FileSystemStore.java:452)
        ... 39 more
    

Local fix

  • STRRTC - 40545
    JG / JG
    Circumvention: None
    

Problem summary

  • Users Affected:
    Australian Taxation Office
    
    Problem Description:
    Memory leak in AS4 as open file handles not released on
    storage server.
    
    
    Platforms Affected:
    All
    

Problem conclusion

  • Resolution Summary:
    A code fix is provided.
    
    Delivered In:
    iFIX1005_3
    

Temporary fix

Comments

APAR Information

  • APAR number

    IT17801

  • Reported component name

    B2B ADV COMMUNI

  • Reported component ID

    5725Q7200

  • Reported release

    100

  • Status

    CLOSED PER

  • PE

    NoPE

  • HIPER

    NoHIPER

  • Special Attention

    NoSpecatt / Xsystem

  • Submitted date

    2016-11-03

  • Closed date

    2017-03-15

  • Last modified date

    2017-03-16

  • APAR is sysrouted FROM one or more of the following:

  • APAR is sysrouted TO one or more of the following:

Fix information

  • Fixed component name

    B2B ADV COMMUNI

  • Fixed component ID

    5725Q7200

Applicable component levels

  • R100 PSY

       UP

[{"Line of Business":{"code":"LOB59","label":"Sustainability Software"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSYJCD","label":"Multi-Enterprise Integration Gateway"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"1.0.0"}]

Document Information

Modified date:
26 September 2021