WebSphere Portal 8 Migration: ConfigEngine upgrade-profile fails at wcm-run-ejb-task with org.omg.CORBA.OBJECT_NOT_EXIST error

Technote (troubleshooting)


Problem

While performing the Migration to WebSphere Portal 8.0 the upgrade-profile Migration Step Build Fails with the following error

org.omg.CORBA.OBJECT_NOT_EXIST: java.rmi.NoSuchObjectException: Stateful bean BeanId(wcm-remote-admin-ejb#wcm-remote-admin-ejb.jar#MigrationService, 5F82F384-013D-4000-E000-8F2B0A010121) was removed or timed out. vmcid: 0x0 minor code: 0 completed: No


Symptom

When executing the ConfigEngine upgrade-profile Migration stem the Task Fails and the <WP-PROFILE>/ConfigEngine/log/ConfigTrace.log contains the following error/exception

org.omg.CORBA.OBJECT_NOT_EXIST: java.rmi.NoSuchObjectException: Stateful bean BeanId(wcm-remote-admin-ejb#wcm-remote-admin-ejb.jar#MigrationService, 5F734581-013D-4000-E000-D4160A010121) was removed or timed out. vmcid: 0x0 minor code: 0 completed: No


Cause

The WebSphere Portal 8 start-up sequence was incorrect.

The wcm application was started before the wps application. Because the wps application was not started first the AuthenticationServerice was not yet Initialized. Since the wcm application needs access to the wps Authentication service, the IBM Web Content Management application also does not initialize correctly. This leads to the failure that occurs when performing the ConfigEngine upgrade-profile task


Diagnosing the problem

The <WP-PROFILE>/ConfigEngine/log/ConfigTrace.log shows the following Exception and stack traces

[java] removing the stateful bean.
[java] java.rmi.NoSuchObjectException: CORBA OBJECT_NOT_EXIST 0x0 No; nested exception is:
[java] org.omg.CORBA.OBJECT_NOT_EXIST:
[java] >> SERVER (id=c82b1e2, host=fidmwmo) TRACE START:
[java] >> org.omg.CORBA.OBJECT_NOT_EXIST: java.rmi.NoSuchObjectException: Stateful bean BeanId(wcm-remote-admin-ejb#wcm-remote-admin-ejb.jar#MigrationService, 5F734581-013D-4000-E000-D4160A010121) was removed or timed out. vmcid: 0x0 minor code: 0 completed: No
[java] >> at com.ibm.ejs.container.activator.StatefulSessionActivationStrategy.atActivate(StatefulSessionActivationStrategy.java:275)
[java] >> at com.ibm.ejs.container.activator.Activator.preInvokeActivateBean(Activator.java:614)
[java] >> at com.ibm.ejs.container.EJSContainer.preInvokeActivate(EJSContainer.java:4110)
[java] >> at com.ibm.ejs.container.EJSContainer.preInvoke(EJSContainer.java:3395)
[java] >> at com.ibm.workplace.wcm.app.migration.ejb.EJSRemoteStatefulMigrationService_3b3089e8.postExecute(Unknown Source)
[java] >> at com.ibm.workplace.wcm.app.migration.ejb._EJSRemoteStatefulMigrationService_3b3089e8_Tie.postExecute(_EJSRemoteStatefulMigrationService_3b3089e8_Tie.java:194)
[java] >> at com.ibm.workplace.wcm.app.migration.ejb._EJSRemoteStatefulMigrationService_3b3089e8_Tie._invoke(_EJSRemoteStatefulMigrationService_3b3089e8_Tie.java:104)
[java] >> at com.ibm.CORBA.iiop.ServerDelegate.dispatchInvokeHandler(ServerDelegate.java:669)
[java] >> at com.ibm.CORBA.iiop.ServerDelegate.dispatch(ServerDelegate.java:523)
[java] >> at com.ibm.rmi.iiop.ORB.process(ORB.java:523)
[java] >> at com.ibm.CORBA.iiop.ORB.process(ORB.java:1575)
[java] >> at com.ibm.rmi.iiop.Connection.doRequestWork(Connection.java:2992)
[java] >> at com.ibm.rmi.iiop.Connection.doWork(Connection.java:2875)
[java] >> at com.ibm.rmi.iiop.WorkUnitImpl.doWork(WorkUnitImpl.java:64)
[java] >> at com.ibm.ejs.oa.pool.PooledThread.run(ThreadPool.java:118)
[java] >> at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1690)
[java] >> SERVER (id=c82b1e2, host=fidmwmo) TRACE END.
[java] vmcid: 0x0 minor code: 0 completed: No
[java] at com.ibm.CORBA.iiop.UtilDelegateImpl.mapSystemException(UtilDelegateImpl.java:281)
[java] at javax.rmi.CORBA.Util.mapSystemException(Util.java:84)
[java] at com.ibm.workplace.wcm.app.migration.ejb._MigrationService_Stub.postExecute(_MigrationService_Stub.java:415)
[java] at com.ibm.workplace.wcm.app.migration.ejb.MigrationBeanClient.runTask(MigrationBeanClient.java:143)
[java] at com.ibm.workplace.wcm.app.migration.ejb.MigrationBeanClient.main(MigrationBeanClient.java:204)
[java] Caused by: org.omg.CORBA.OBJECT_NOT_EXIST:
[java] >> SERVER (id=c82b1e2, host=fidmwmo) TRACE START:
[java] >> org.omg.CORBA.OBJECT_NOT_EXIST: java.rmi.NoSuchObjectException: Stateful bean BeanId(wcm-remote-admin-ejb#wcm-remote-admin-ejb.jar#MigrationService, 5F734581-013D-4000-E000-D4160A010121) was removed or timed out. vmcid: 0x0 minor code: 0 completed: No
[java] >> at com.ibm.ejs.container.activator.StatefulSessionActivationStrategy.atActivate(StatefulSessionActivationStrategy.java:275)
[java] >> at com.ibm.ejs.container.activator.Activator.preInvokeActivateBean(Activator.java:614)
[java] >> at com.ibm.ejs.container.EJSContainer.preInvokeActivate(EJSContainer.java:4110)
[java] >> at com.ibm.ejs.container.EJSContainer.preInvoke(EJSContainer.java:3395)
[java] >> at com.ibm.workplace.wcm.app.migration.ejb.EJSRemoteStatefulMigrationService_3b3089e8.postExecute(Unknown Source)
[java] >> at com.ibm.workplace.wcm.app.migration.ejb._EJSRemoteStatefulMigrationService_3b3089e8_Tie.postExecute(_EJSRemoteStatefulMigrationService_3b3089e8_Tie.java:194)
[java] >> at com.ibm.workplace.wcm.app.migration.ejb._EJSRemoteStatefulMigrationService_3b3089e8_Tie._invoke(_EJSRemoteStatefulMigrationService_3b3089e8_Tie.java:104)
[java] >> at com.ibm.CORBA.iiop.ServerDelegate.dispatchInvokeHandler(ServerDelegate.java:669)
[java] >> at com.ibm.CORBA.iiop.ServerDelegate.dispatch(ServerDelegate.java:523)
[java] >> at com.ibm.rmi.iiop.ORB.process(ORB.java:523)
[java] >> at com.ibm.CORBA.iiop.ORB.process(ORB.java:1575)
[java] >> at com.ibm.rmi.iiop.Connection.doRequestWork(Connection.java:2992)
[java] >> at com.ibm.rmi.iiop.Connection.doWork(Connection.java:2875)
[java] >> at com.ibm.rmi.iiop.WorkUnitImpl.doWork(WorkUnitImpl.java:64)
[java] >> at com.ibm.ejs.oa.pool.PooledThread.run(ThreadPool.java:118)
[java] >> at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1690)
[java] >> SERVER (id=c82b1e2, host=fidmwmo) TRACE END.
[java] vmcid: 0x0 minor code: 0 completed: No
[java] at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
[java] at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:56)
[java] at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:39)
[java] at java.lang.reflect.Constructor.newInstance(Constructor.java:527)
[java] at com.ibm.rmi.iiop.ReplyMessage._getSystemException(ReplyMessage.java:348)
[java] at com.ibm.rmi.iiop.ReplyMessage.getSystemException(ReplyMessage.java:210)
[java] at com.ibm.rmi.iiop.ClientResponseImpl.getSystemException(ClientResponseImpl.java:235)
[java] at com.ibm.rmi.corba.ClientDelegate.intercept(ClientDelegate.java:1005)
[java] at com.ibm.rmi.corba.ClientDelegate.invoke(ClientDelegate.java:460)
[java] at com.ibm.CORBA.iiop.ClientDelegate.invoke(ClientDelegate.java:1205)
[java] at com.ibm.rmi.corba.ClientDelegate.invoke(ClientDelegate.java:801)
[java] at com.ibm.CORBA.iiop.ClientDelegate.invoke(ClientDelegate.java:1235)
[java] at org.omg.CORBA.portable.ObjectImpl._invoke(ObjectImpl.java:484)
[java] at com.ibm.workplace.wcm.app.migration.ejb._MigrationService_Stub.postExecute(_MigrationService_Stub.java:405)
[java] ... 2 more
The <WP-PROFILE>/logs/WebSphere_Portal/SystemOut.log contains the following error/exception
webapp E com.ibm.ws.webcontainer.webapp.WebApp commonInitializationFinally SRVE0266E: Error occured while initializing servlets: {0}
javax.servlet.ServletException: SRVE0207E: Uncaught initialization exception created by servlet
at com.ibm.ws.webcontainer.servlet.ServletWrapper.init(ServletWrapper.java:398)
at com.ibm.ws.webcontainer.servlet.ServletWrapperImpl.init(ServletWrapperImpl.java:168)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.loadOnStartupCheck(ServletWrapper.java:1351)
at com.ibm.ws.webcontainer.webapp.WebApp.doLoadOnStartupActions(WebApp.java:609)
at com.ibm.ws.webcontainer.webapp.WebApp.commonInitializationFinally(WebApp.java:578)
at com.ibm.ws.webcontainer.webapp.WebAppImpl.initialize(WebAppImpl.java:421)
at com.ibm.ws.webcontainer.webapp.WebGroupImpl.addWebApplication(WebGroupImpl.java:88)
at com.ibm.ws.webcontainer.VirtualHostImpl.addWebApplication(VirtualHostImpl.java:169)
at com.ibm.ws.webcontainer.WSWebContainer.addWebApp(WSWebContainer.java:749)
at com.ibm.ws.webcontainer.WSWebContainer.addWebApplication(WSWebContainer.java:634)
at com.ibm.ws.webcontainer.component.WebContainerImpl.install(WebContainerImpl.java:422)
at com.ibm.ws.webcontainer.component.WebContainerImpl.start(WebContainerImpl.java:714)
at com.ibm.ws.runtime.component.ApplicationMgrImpl.start(ApplicationMgrImpl.java:1160)
at com.ibm.ws.runtime.component.DeployedApplicationImpl.fireDeployedObjectStart(DeployedApplicationImpl.java:1369)
at com.ibm.ws.runtime.component.DeployedModuleImpl.start(DeployedModuleImpl.java:639)
at com.ibm.ws.runtime.component.DeployedApplicationImpl.start(DeployedApplicationImpl.java:967)
at com.ibm.ws.runtime.component.ApplicationMgrImpl.startApplication(ApplicationMgrImpl.java:766)
at com.ibm.ws.runtime.component.ApplicationMgrImpl.start(ApplicationMgrImpl.java:2153)
at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.start(CompositionUnitMgrImpl.java:445)
at com.ibm.ws.runtime.component.CompositionUnitImpl.start(CompositionUnitImpl.java:123)
at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.start(CompositionUnitMgrImpl.java:388)
at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.access$500(CompositionUnitMgrImpl.java:116)
at com.ibm.ws.runtime.component.CompositionUnitMgrImpl$CUInitializer.run(CompositionUnitMgrImpl.java:994)
at com.ibm.wsspi.runtime.component.WsComponentImpl$_AsynchInitializer.run(WsComponentImpl.java:349)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1690)
Caused by: java.lang.ExceptionInInitializerError
at java.lang.J9VMInternals.initialize(J9VMInternals.java:250)
at com.ibm.workplace.wcm.factory.WPSWCMServiceManager.getAuthenticationService(WPSWCMServiceManager.java:366)
at com.presence.connect.wmmcomms.AuthenticationUtils.<clinit>(AuthenticationUtils.java:64)
at java.lang.J9VMInternals.initializeImpl(Native Method)
at java.lang.J9VMInternals.initialize(J9VMInternals.java:228)
at com.presence.connect.Connect.init(Connect.java:540)
at com.presence.connect.Connect.safeInit(Connect.java:231)
at com.presence.connect.Connect.getInstance(Connect.java:205)
at com.presence.connect.ConnectServlet.init(ConnectServlet.java:84)
at com.ibm.ws.cache.servlet.ServletWrapper.init(ServletWrapper.java:238)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.init(ServletWrapper.java:336)
... 24 more
Caused by: java.lang.IllegalStateException: Required service AuthenticationService is not available
at com.ibm.wps.services.ServiceManager.getService(ServiceManager.java:501)
at com.ibm.wps.services.ServiceManager.getService(ServiceManager.java:509)
at com.ibm.wps.services.authentication.Authentication.<clinit>(Authentication.java:31)
at java.lang.J9VMInternals.initializeImpl(Native Method)
at java.lang.J9VMInternals.initialize(J9VMInternals.java:228)
... 34 more
Looking at the Startup sequence in the SystemOut.log we see the following Application Startup Sequence
1) WSVR0200I: Starting application: ibmasyncrsp
2) WSVR0200I: Starting application: wcm
3) WSVR0200I: Starting application: wps_scheduler
4) WSVR0200I: Starting application: wps_theme
5) WSVR0200I: Starting application: wps

The cause therefore is due to the start-up sequence. The wcm application must be started after the wps application since it uses the wps services.


Resolving the problem

1) Ensure the WAS EJBDeploy Tool for pre-EJB 3.0 Modules are installed on the 8.0 Portal environment since they are not installed by default on 8.0 see the following document
http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/TD105993 on how to add the EJBDeploy tool using the Installation Manager
2)Remove and redeploy the WCM Remote Admin Application using the following ConfigEngine Tasks
2.1) ConfigEngine remove-wcm-remote-admin task - this removed the wcm remote admin application
2.2) ConfigEngine configure-wcm-migration -this redeploy's the wcm remote admin application
3) reset the WCM Event log - see the following documentation for this step
3.1) http://www-10.lotus.com/ldd/portalwiki.nsf/xpDocViewer.xsp?lookupName=IBM+Web+Content+Manager+8+Product+Documentation#action=openDocument&res_title=Resetting_the_web_content_event_log_wcm8&content=pdcontent
4) Synchronize the Nodes
5) stop and restart the cluster
6) Ensure the wps application starts before the wcm and the wps_scheduler Application as follows
6.1) Change the weights on the following applications as stated below:
6.2) From the DMGR console, navigate to Applications -> Application
Types -> WebSphere enterprise applications.
6.3) For the weight on wps application, click Startup Behavior under Detailed properties and make sure the weight is 10
6.4) For the wps modules navigate to Manage Modules under the wps application
and set the weights as indicated below
WebSphere Portal Server = 10000
WebSphere Portal Server WSRP Facade = 10000
WebSphere Portal XmlAccess Facade = 10000
6.5) For the weight on the wps_scheduler, click Startup Behavior under
Detail properties and make sure the weight is 10
6.6) for the wps_scheduler modules navigate to Manage Modules under the wps_scheduler application and set the weights as indicated below
WPS Task Scheduler = 5000
6.7)For changing weight on wcm application, click Startup Behavior under Detail
properties and make sure the weight is 20.
6.8) For the remaining applications as indicated below, you can navigate to
"Manage Modules" under wcm application and set the weights as indicated below:
ilwwcm.war = 10000
ilwwcm-syndicationservlet.war = 10000
editor-editlive-config.war = 10000
WCM_EJBs.jar = 5000
7) Save the configuration.
8) Synchronize the Nodes
9) Perform the upgrade-profile step again with the -Dwp.migration.framework.resume=post-apply-PTF

Rate this page:

(0 users)Average rating

Document information


More support for:

WebSphere Portal
Migration

Software version:

8.0, 8.0.0.0, 8.0.0.1

Operating system(s):

AIX, HP-UX, IBM i, Linux, Solaris, Windows, z/OS

Reference #:

1631343

Modified date:

2014-02-17

Translate my page

Machine Translation

Content navigation