Unread marks slow to synchronize in some cases with Domino mail servers that interact with BlackBerry Enterprise Server version 5.0.3

Flash (Alert)


Abstract

This technote provides details on an issue with unread marks being slow to sync between BlackBerry devices and Domino servers interacting with BlackBerry Enterprise Server v5.0.3.

Content

Issue Description

There have been multiple reports of unread marks being slow to synchronize between Research In Motion's BlackBerry devices with some IBM Lotus Domino mail servers that interact with BlackBerry Enterprise Server version 5.0.3.

Having a large number of unread messages in user mail files could potentially lead to a looping condition on the BlackBerry Enterprise Server, which could then potentially impact the performance of Domino mail servers (e.g., could lead to a server hang or slow response times).


Symptoms & How to Diagnosis

Additional symptoms of this issue as reported to IBM Support:
  • Unread marks are slow to sync from the Domino mail server to the devices
  • High CPU usage
  • High Disk Queue lengths
  • Users connections to server are slow


To diagnose the issue, you should capture a manual data set (NSD, Console Log, and Semdebug) at the time the problem occurs. Then review the captured data to see if the following function calls appear:
  • DbGetMultNoteInfo
  • iNSFDbGetMultNoteInfo
  • NSFDbGetMultNoteInfo
  • ServerGetMultNoteInfo

See the "Crash Stacks" section below for stacks captured on Windows, AIX, IBM i, and Linux.


Potential Fixes & Additional Information

For more information on this issue and information on potential fixes, refer to Research In Motion article ID# KB29147.


NOTE: Although seemingly similar in some aspects, this issue is different than the one described in technote #1470828 - " Potential hang while upgrading the BlackBerry Enterprise Server on IBM Lotus Domino to 5.0.3"



Crash Stacks

Crash stacks provided below captured from Windows, AIX, IBM i, and Linux.

Windows:
############################################################
### thread 35/141: [ nSERVER: 11b4: 1384]
### FP=0x23bef0e8, PC=0x7c82845c, SP=0x23bef078
### stkbase=0x23bf0000, total stksize=262144, used stksize=3976
############################################################
[ 1] 0x7c82845c ntdll.KiFastSystemCallRet+0 (3e6c,ffffffff,0,23bef12c)
[ 2] 0x77e61c8d kernel32.WaitForSingleObject+18 (3e6c,ffffffff,2e017e08,2e017e06)
@[ 3] 0x600cf986 nnotes.WaitOnNativeSemaphore@16+150 (2c8,ffffffff,0,0)
@[ 4] 0x60129446 nnotes.WaitOnNativeSemaphoreCounted@12+22 (2c8,2e017e08,0)
@[ 5] 0x6000a4f5 nnotes.OSLockWriteFRWSemInt@12+405 (0,2c8,0)
@[ 6] 0x6000a350 nnotes.OSLockWriteFRWSem@4+16 (2e017e06)
@[ 7] 0x601efe4f nnotes.OSWaitFairEvent@8+15 (2e017e04,0)
@[ 8] 0x6097023b nnotes.newLkLock+5083 (23befb78,23befab0,20002,ffffffff)
@[ 9] 0x6096d34c nnotes._LkLock@24+364 (23befb78,23befab0,20002,ffffffff,0,23bef644)
@[10] 0x6096e187 nnotes.LkConvert@16+807 (23befb78,0,2,ffffffff)
@[11] 0x6017670f nnotes.DbGetMultNoteInfoByUNID@24+1615
@[12] 0x60179971 nnotes.iNSFDbGetMultNoteInfoByUNID@24+113
@[13] 0x601793f0 nnotes.NSFDbGetMultNoteInfoByUNID@24+192
@[14] 0x10063d85 nserverl.ServerGetMultNoteInfo@8+421 (0,7528000d)
@[15] 0x10022653 nserverl.DbServer@8+2515 (5ecf0365,aa000075)
@[16] 0x10037cc7 nserverl.WorkThreadTask@8+1655 (1080934,0)
@[17] 0x100018ce nserverl.Scheduler@4+750 (0)
@[18] 0x60155e8f nnotes.ThreadWrapper@4+175 (0)
[19] 0x77e6482f kernel32.GetModuleHandleA+223 (0,0,0,0)



AIX
###################################
###### thread 81/131 :: server, pid=20250644, tid=70320517, ptid=15421) ######
###################################
[1] 0xd01394a8 read(??, ??, ??) + 0x268
[2] 0xd36298f4 FileRead(0xffffffff, 0x3bf, 0x5fa60000, 0xf800) + 0xac
[3] 0xd362b3d0 OSFDFileRead(0x3bf, 0x5fa60000, 0xf800) + 0x2c
[4] 0xd399ec70 FileReadOSFD(0x31990608, 0x3bf, 0x0, 0x0, 0x5fa60000, 0xf800) + 0x3a8
[5] 0xd39a8550 NSFFileSeekReadC(0x31990608, 0x1780fc0, 0x0, 0x0, 0x5fa60000, 0xf800)
[6] 0xd3996acc BucketRead(0x1, 0x28000f42, 0x1, 0x227c, 0x10000, 0x31990ad0, 0x584664f4,
[7] 0xd399ddac SUMBUCKETReadPage(0x28000f42, 0x1, 0x227c, 0x10000, 0x31990ad0,
[8] 0xd3949f48 UBMSetupPage(0x31991108, 0x133a, 0x584664bc, 0x31880, 0x10, 0x0) + 0x82c
[9] 0xd394ab6c UBMReplaceBuffer(0x31991108, 0x31990d20, 0x133a, 0x1, 0x10, 0x0) + 0x3d8
[10] 0xd39493e0 UBMAutoIngestGroupPage(0x31991108, 0x133a, 0x10, 0x0, 0x0, 0x31990de0)
[11] 0xd394aea4 UBMClock(0x31991108, 0x133a, 0x10, 0x0) + 0x5c
[12] 0xd394c74c UBMPinExtended(0x31991108, 0x0, 0x31991ea0) + 0x1070
[13] 0xd394da9c UBMPinA_Extended(0x28000f42, 0x1, 0x227c, 0xf800, 0x0, 0x0, 0x0, 0x0)
[14] 0xd399ce68 DbBucketPinBufferExt(0x319944e8, 0x10001, 0x227c, 0x0, 0x0, 0x0, 0x0,
[15] 0xd399d7b8 DbBucketPinBuffer(0x319944e8, 0x10001, 0x227c, 0x0, 0x0, 0x0, 0x319927d8,
[16] 0xd3989b8c GetBucketAndSlot(0x319944e8, 0x31992c88, 0x0, 0x0, 0x31992364
[17] 0xd3994f38 DbBktPinSlotExtended(0x319944e8, 0x31992c88, 0x0, 0x0, 0x319927d0,
[18] 0xd3995384 DbBktPinSlot(0x319944e8, 0x31992c88, 0x0, 0x0, 0x319927d0, 0x319927d8)
[19] 0xd3a87db0 NoteHeaderByBSIDExt(0x319944e8, 0x31992c88, 0x31993638, 0x0) + 0x7b0
[20] 0xd3a88af8 NoteHeader(0x319944e8, 0x31993a8c, 0x31993638, 0x0) + 0x3c0
[21] 0xd3a76270 DbGetNoteInfoWithHdrStatus(0x319944e8, 0x15f0be, 0x31993ac8,
[22] 0xd3a818c4 DbGetMultNoteInfo(0x319944e8, 0xf903f903, 0x4800480, 0x1c001c0,
[23] 0xd3aba928 iNSFDbGetMultNoteInfo(0x319944e8, 0xf903f903, 0x4800480,
[24] 0xd3aaeca4 NSFDbGetMultNoteInfo(0x5d005d0, 0xf903f903, 0x4800480,
[25] 0x10060cb0 ServerGetMultNoteInfo(0x26dbe0, 0x4340b8) + 0x158
[26] 0x10014ef8 DbServer(0x1225c6e, 0x26dbe0) + 0x4bc
[27] 0x100ad468 WorkThreadTask(0x405b93, 0x0) + 0x924
[28] 0x100c0d7c Scheduler(0x0) + 0x294
[29] 0xd3637d84 ThreadWrapper(0x0) + 0x10c
[30] 0xd04f1c4c _pthread_body(??) + 0xec


IBM i
QSYS QLESPI QLECRTTH 0000000019LECreate_Thread2__FP12crtth_parm_t
QSYS QP0WPINT QP0WSPTHR 0000000019 pthread_create_part2
QDOMINO LIBNOTES THREAD 0000000020 ThreadWrapper
QDOMINO SERVER SCHED 0000000065 Scheduler
QDOMINO SERVER WORKTHRD 0000000180 WorkThreadTask
QDOMINO SERVER DBSERVER 0000000312 DbServer
QDOMINO SERVER SVGNINFO 0000000033 ServerGetMultNoteInfo
QDOMINO LIBNOTES NSFSEM2 0000000009 NSFDbGetMultNoteInfo
QDOMINO LIBNOTES WRAP1 0000000007 iNSFDbGetMultNoteInfo
QDOMINO LIBNOTES DBFHINFO 0000000055 DbGetMultNoteInfo
QDOMINO LIBNOTES DBFHINFO 0000000003 DbGetNoteInfoWithHdrStatus
QDOMINO LIBNOTES NTHEADER 0000000050 NoteHeader
QDOMINO LIBNOTES NTHEADER 0000000001 NoteHeaderByBSID
QDOMINO LIBNOTES NTHEADER 0000000031 NoteHeaderByBSIDExt
QDOMINO LIBNOTES DBALLOCB 0000000001 DbBktPinSlot
QDOMINO LIBNOTES DBALLOCB 0000000013 DbBktPinSlotExtended
QDOMINO LIBNOTES DBALLOCB 0000000003 GetBucketAndSlot
QDOMINO LIBNOTES DBBKTBUF 0000000001 DbBucketPinBuffer
QDOMINO LIBNOTES DBBKTBUF 0000000090 DbBucketPinBufferExt
QDOMINO LIBNOTES PIN 0000000025 UBMPinA_Extended
QDOMINO LIBNOTES PIN 0000000041 UBMPinExtended
QDOMINO LIBNOTES PIN 0000000045 UBMClock
QDOMINO LIBNOTES PIN 0000000050 UBMReplaceBuffer
QDOMINO LIBNOTES PIN 0000000080 UBMSetupPage
QDOMINO LIBNOTES DBBKTBUF 0000000001 SUMBUCKETReadPage
QDOMINO LIBNOTES DBBKTBUF 0000000037 BucketRead
QDOMINO LIBNOTES DBFILEIO 0000000006 NSFFileSeekReadC
QDOMINO LIBNOTES DBFILEIO 0000000002 DbFileSeekOSFD
QDOMINO LIBNOTES DBFILEIO 0000000014 FileSeekOSFD
QDOMINO LIBNOTES FILE 0000000001 OSFDFileSeekExtended
QDOMINO LIBNOTES FILE 0000000010 FileSeek
QSYS QP0LLIB1 QP0LLB64 0000000008 lseek64

Linux
Thread 50 (Thread 2199429704016 (LWP 26097)):
#0 0x00000200029a1cda in OSUpdateFileStatistics ()
from /lib64/libc.so.6
#1 0x000002000034cdac in unix_usleep ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#2 0x0000020000302570 in OSDelayThread ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#3 0x00000200002da572 in StaticHangEnable ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#4 0x00000200002f3ac4 in FileRead ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#5 0x00000200002f3b02 in OSFDFileRead ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#6 0x0000020000b43888 in FileReadOSFD ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#7 0x0000020000b452b4 in NSFFileSeekReadC ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#8 0x000002000097bca8 in BucketRead ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#9 0x000002000097c23e in SUMBUCKETReadPage ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#10 0x0000020000be132c in UBMSetupPage ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#11 0x0000020000be19f2 in UBMMergeBuffers ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#12 0x0000020000be2dd2 in UBMClock ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#13 0x0000020000be353e in UBMPinExtended ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#14 0x0000020000be409c in UBMPinA_Extended ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#15 0x000002000097ecbc in DbBucketPinBufferExt ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#16 0x000002000097ed7e in DbBucketPinBuffer ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#17 0x00000200009133c0 in GetBucketAndSlot ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#18 0x000002000091604a in DbBktPinSlotExtended ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#19 0x00000200009161c2 in DbBktPinSlot ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#20 0x0000020000946c9e in NoteHeaderByBSIDExt ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#21 0x0000020000946e8e in NoteHeaderByBSID ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#22 0x00000200009470a4 in NoteHeader ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#23 0x0000020000988074 in DbGetNoteInfo ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#24 0x000002000098884a in DbGetMultNoteInfoByUNID ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#25 0x0000020000897074 in iNSFDbGetMultNoteInfoByUNID ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#26 0x0000020000887a3a in NSFDbGetMultNoteInfoByUNID ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#27 0x00000000800bf20e in ServerGetMultNoteInfo ()
#28 0x00000000800646b8 in DbServer ()
#29 0x0000000080082e20 in WorkThreadTask ()
#30 0x0000000080037e06 in Scheduler ()
#31 0x00000200003021c4 in ThreadWrapper ()
from /opt/ibm/lotus/notes/latest/zlinux/libnotes.so
#32 0x00000200026d202a in start_thread () from /lib64/libpthread.so.0
#33 0x00000200029a8b86 in thread_start () from /lib64/libc.so.6

Document information


More support for:

IBM Domino

Software version:

8.5, 8.5.1, 8.5.2, 8.5.3

Operating system(s):

AIX, AIX 64bit, IBM i, Linux, Linux iSeries, Linux zSeries, Solaris, Windows, Windows 64bit, i5/OS, z/OS

Reference #:

1579183

Modified date:

2015-06-24

Translate my page

Content navigation