Skip to main content

Support & downloads  >  

High CPU Usage/Potential Server Hang due to Platform Statistics running on Domino Server

 Technote (troubleshooting)
 
 
Problem
After upgrading to Lotus Domino 8.5/8.5.1 your server CPU may Spike and server performance is degraded.

Rebooting the Domino server will temporarily alleviate your issue and soon you notice the issue occurs again.
 
 
Cause
This issue has been observed in Domino 8.5 and 8.5.1 when Platform Statistics is enabled.
 
Environment
Windows 32-bit Domino 8.5 and 8.5.1
 
Diagnosing the problem
Capturing a manual NSD at the time of the problem will indicate a similar stack:
############################################################
### thread 36/53: [ nSERVER: 14a0: 10f0]
### FP=0x1fd9f90c, PC=0x600013d6, SP=0x1fd9f8d0
### stkbase=0x1fda0000, total stksize=262144, used stksize=1840
############################################################
@[ 1] 0x600013d6 nnotes.OSUnlockSem@4+54 (153fdbc)
@[ 2] 0x60001ae3 nnotes.UnlockMemHandle@4+19 (153fd94)
@[ 3] 0x60177fef nnotes.OSMemGetFaultHandleExt@8+47 (970014,60fef520)
@[ 4] 0x600096ee nnotes.OSMemGetFaultHandle@4+14 (2c43)
@[ 5] 0x60009791 nnotes.OSLockPool@8+17 (1fd9fbf4,2c43)
@[ 6] 0x600116ed nnotes.OSSwitchPoolByIndex@8+77 (1fd9fbf4,60110002)
@[ 7] 0x60041a32 nnotes.SwitchToPoolNum@8+18 (1fd9fa64,60110002)
@[ 8] 0x6011107f nnotes.remove_tree@28+31 (1fd9fa64,1f07c802,60110650,1fd9fbdc,0,1fd9f9cc,f10f10)
@[ 9] 0x601114bf nnotes.remove_tree@28+1119 (1fd9fa64,3d3401,60110650,1fd9fbdc,0,1fd9fa34,f10f10)
@[10] 0x60110f59 nnotes.IndexKeyDelete@24+153 (1f3d3401,2910,1fd900f8,60110650,0,1fd9fa78)
@[11] 0x606665c3 nnotes.StatDelete@8+179 (60c84fe4,1fd9fc14)
@[12] 0x601b80d1 nnotes.PerfProcessObject::perfStatDelete+161 (f5c1108,0,f5c1a70,1fd9fe60)
@[13] 0x601bd542 nnotes._postProcessList+34 (20e38ea0,1fd9fe70,601bd70d,20e38ea0)
@[14] 0x601bd6f1 nnotes.buildProcObjList+33 (20e38ea0,1,1fd9fe80,601bd818)
@[15] 0x601bd70d nnotes.BuildPerfDataObjects+13 (20e38ea0,20e38ea0,1fd9fea8,601b5e14)
@[16] 0x601bd818 nnotes.WinPlatformStats::Collect+152 (1,100736c9,2,f9d6936)
@[17] 0x601b5e14 nnotes.PStatsCollectAndPublish+20 (f5c1108,f9d0002,3e8,22)
@[18] 0x10074eda nserverl.PlatformStatsTask@8+634 (4ba00022,589c0001)
@[19] 0x10001a2e nserverl.Scheduler@4+750 (0)
@[20] 0x600fe5af nnotes.ThreadWrapper@4+175 (0)
[21] 0x77e64829 kernel32.GetModuleHandleA+223 (0,0,0,0)

or

############################################################
### thread 45/48: [ nSERVER: 0d48: 163c]
### FP=0x085cf6c8, PC=0x6000126b, SP=0x085cf6ac
### stkbase=0x085d0000, total stksize=262144, used stksize=2388
############################################################
@[ 1] 0x6000126b nnotes.OSLockSemInt@8+75 (f835ac,1)
@[ 2] 0x6000120e nnotes.OSLockSem@4+14 (f835a9)
@[ 3] 0x6000154e nnotes.OSLockReadSem@4+142 (f835f4)
@[ 4] 0x60014bf4 nnotes.GetEnvConfigString@16+36(60ed82b0,60d2e6c4,85cf97c,100)
@[ 5] 0x600146d3 nnotes.OSGetEnvironmentString@12+163(60d2e6c4,85cf97c,ff)
@[ 6] 0x6004b81e nnotes.OSGetEnvironmentLongWithDefault@8+30(60d2e6c4,0)
@[ 7] 0x6001843e nnotes.OSGetEnvironmentLong@4+14 (60d2e6c4)
@[ 8] 0x606657b6 nnotes.StatDelete@8+22 (60c82fe4,85cfc14)
@[ 9] 0x601b8691 nnotes.PerfProcessObject::perfStatDelete+161(138c388,0,138ccf0,85cfe60)
@[10] 0x601bda62 nnotes._postProcessList+34(8835bd8,85cfe70,601bdc2d,8835bd8)
@[11] 0x601bdc11 nnotes.buildProcObjList+33 (8835bd8,1,85cfe80,601bdd38)
@[12] 0x601bdc2d nnotes.BuildPerfDataObjects+13(8835bd8,8835bd8,85cfea8,601b63d4)
@[13] 0x601bdd38 nnotes.WinPlatformStats::Collect+152(1,10073579,2,36abae2)
@[14] 0x601b63d4 nnotes.PStatsCollectAndPublish+20(138c388,36a0002,3e8,2a)
@[15] 0x10074d8a nserverl.PlatformStatsTask@8+634 (9b5d002a,46380001)
@[16] 0x10001a2e nserverl.Scheduler@4+750 (0)
@[17] 0x600fe6ef nnotes.ThreadWrapper@4+175 (0)
[18] 0x77e6482f kernel32.GetModuleHandleA+223 (0,0,0,0)

or

############################################################
### thread 73/78: [ nSERVER: 1478: 18cc]
### FP=0x0bf5fa10, PC=0x7c82860c, SP=0x0bf5f9a8
### stkbase=0x0bf60000, total stksize=262144, used stksize=1624
############################################################
[ 1] 0x7c82860c ntdll.KiFastSystemCallRet+0 (3e8,0,bf5fa30,60090c6a)
[ 2] 0x77e424fd kernel32.Sleep+15 (3e8,0,bf5fa44,60183cdb)
@[ 3] 0x60090c6a nnotes.OSDelayThread@4+42 (3e8)
@[ 4] 0x60183cdb nnotes.StaticHangEnable@0+75 ()
@[ 5] 0x60177fe2 nnotes.OSMemGetFaultHandleExt@8+34 (2910,0)
@[ 6] 0x600096ee nnotes.OSMemGetFaultHandle@4+14 (2910)
@[ 7] 0x60009791 nnotes.OSLockPool@8+17 (bf5fbf4,2910)
@[ 8] 0x60666551 nnotes.StatDelete@8+65 (60c84fe4,bf5fc14)
@[ 9] 0x601b80d1 nnotes.PerfProcessObject::perfStatDelete+161 (60bf1c4,0,60bfb2c,bf5fe60)
@[10] 0x601bd542 nnotes._postProcessList+34 (c2880c8,bf5fe70,601bd70d,c2880c8)
@[11] 0x601bd6f1 nnotes.buildProcObjList+33 (c2880c8,1,bf5fe80,601bd818)
@[12] 0x601bd70d nnotes.BuildPerfDataObjects+13 (c2880c8,c2880c8,bf5fea8,601b5e14)
@[13] 0x601bd818 nnotes.WinPlatformStats::Collect+152 (1,100736c9,2,371c436)
@[14] 0x601b5e14 nnotes.PStatsCollectAndPublish+20 (60bf1c4,3710002,3e8,48)
@[15] 0x10074eda nserverl.PlatformStatsTask@8+634 (d710048,9f380001)
@[16] 0x10001a2e nserverl.Scheduler@4+750 (0)
@[17] 0x600fe5af nnotes.ThreadWrapper@4+175 (0)
[18] 0x77e6482f kernel32.GetModuleHandleA+223 (0,0,0,0)
 
Resolving the problem

Disabling Platform Statistics on the Domino Server using the following ini parameter has resolved this issue from re-occurring, however this does require a server restart:

Platform_Statistics_disabled=1

This issue has been reported to Quality Engineering as SPR#JPMS7VARS4 and is currently being investigated by our Development Team.

This document is based on the following Software Problem Report (SPR):
JPMS7VARS4
 
 
 

Copyright and trademark information
IBM, the IBM logo and ibm.com are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml.
Rate this page
Please take a moment to complete this form to help us better serve you.
This material provides me with the information I need.




This material is clear and easy to understand.




Did the information help you to achieve your goal?
What updates, improvements, or related information would you like to see in this document?
Your response will be used to improve our document content. Requests for assistance, if applicable, should be submitted through your normal support channel as we cannot respond from this site.
Input the verification number to submit feedback:
Document information
 Product categories:
 Software
 Messaging Applications
 Advanced Messaging
 Lotus Domino
 Lotus Domino Server
 Operating system(s):
  Windows
 Software version:
  8.5, 8.5.0.1, 8.5.1
 Software edition:
  All Editions
 Reference #:
  1409427
 IBM Group:
 Software Group
 Modified date:
 2009-11-03

Translate My Page
 
 

Rate this page

Help us improve this page. Your response will be used to improve our document content. Requests for assistance, if applicable, should be submitted through your normal support channel as we cannot respond from this site.