Skip to main content

mt_notifyvp timed out crash on an AIO virtual processor


Technote (troubleshooting)


Problem(Abstract)


In the online.log:
13:31:43 VP Notify mechanism incomplete after 5 minutes. This can be due to slow network file access. Will try 12 more times
...
14:37:52 notifyvp(): vp 8, pid 13441 of class 0 didn't rcv
14:37:52 Assert Failed: mt_notifyvp timed out
14:37:52 IBM Informix Dynamic Server Version 11.70.FC7
14:37:52 Who: Session(0, @, 0, (0))
Thread(4, aio vp 0, 0, 11)
File: mt.c Line: 12078
14:37:52 stack trace for pid 13444 written to /tmp/af.3ec6a90

Symptom

You see messages like this in the online.log:


13:31:43 VP Notify mechanism incomplete after 5 minutes. This can be due to slow network file access. Will try 12 more times
13:37:44 VP Notify mechanism incomplete after 5 minutes. This can be due to slow network file access. Will try 11 more times
13:43:44 VP Notify mechanism incomplete after 5 minutes. This can be due to slow network file access. Will try 10 more times
13:49:45 VP Notify mechanism incomplete after 5 minutes. This can be due to slow network file access. Will try 9 more times
13:55:45 VP Notify mechanism incomplete after 5 minutes. This can be due to slow network file access. Will try 8 more times
14:01:46 VP Notify mechanism incomplete after 5 minutes. This can be due to slow network file access. Will try 7 more times
14:07:48 VP Notify mechanism incomplete after 5 minutes. This can be due to slow network file access. Will try 6 more times
14:13:49 VP Notify mechanism incomplete after 5 minutes. This can be due to slow network file access. Will try 5 more times
14:19:50 VP Notify mechanism incomplete after 5 minutes. This can be due to slow network file access. Will try 4 more times
14:25:51 VP Notify mechanism incomplete after 5 minutes. This can be due to slow network file access. Will try 3 more times
14:31:52 VP Notify mechanism incomplete after 5 minutes. This can be due to slow network file access. Will try 2 more times
14:37:52 VP Notify mechanism incomplete after 5 minutes. This can be due to slow network file access. Will try 1 more times
14:37:52 notifyvp(): vp 8, pid 13441 of class 0 didn't rcv
14:37:52 Assert Failed: mt_notifyvp timed out
14:37:52 IBM Informix Dynamic Server Version 11.70.FC7
14:37:52 Who: Session(0, @, 0, (0))
Thread(4, aio vp 0, 0, 11)
File: mt.c Line: 12078
14:37:52 stack trace for pid 13444 written to /tmp/af.3ec6a90


The stack trace in the af file looks similar to this:

Stack for thread: 4 aio vp 0
base: 0x0000000073dfc000
len: 69632
pc: 0x000000000104f40d
tos: 0x0000000073e0c110
state: running
vp: 11

0x000000000104f40d (oninit) mt_system
0x000000000109979a (oninit) afhandler
0x000000000109ade7 (oninit) afcrash_interface
0x000000000105c5ed (oninit) mt_notifyvp
0x000000000107ca7f (oninit) private_close
0x000000000107d32f (oninit) gf_close
0x00000000010799eb (oninit) aio_workon
0x000000000107be17 (oninit) iothread
0x0000000001069a6b (oninit) startup

Cause

Informix is not getting an I/O response for the file descriptor due to an OS or file system issue.

Resolving the problem

Before the assertion failure occurs and while you see the VP Notify mechanism run OS and file system commands related to the capture of I/O problems and errors like iostat and vmstat. Check the OS log and any other logs related to the file system. Make sure there are no problems with NFS, SAN, NAS and so on if these types of disk are used.

Rate this page:

(0 users)Average rating

Copyright and trademark information

IBM, the IBM logo and ibm.com are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml.

Rate this page:


(0 users)Average rating

Add comments

Document information

Informix Servers


Software version:
11.1, 11.5, 11.7, 11.70


Operating system(s):
AIX, HP-UX, Linux, Mac OS X, Solaris, Windows


Reference #:
1622071


Modified date:
2013-01-10

Translate my page

Content navigation