DB2 - Problem description
| Problem IC75597 | Status: Closed |
DB2 instance crash in cases when Instance is experiencing lockin g issues and the SQL has XML column in SELECT list. | |
| product: | |
DB2 FOR LUW / DB2FORLUW / 950 - DB2 | |
| Problem description: | |
DB2 instance could crash in cases when Instance is experiencing
locking issues (Failed lock excalations for example) and SQL
used has XML column in SELECT list, i.e. the conditions are
1. TABLE MUST HAVE XML (XML in SELECT list. Check the table's
definition for XML column.)
2. Encounter LOCKING ERRORs
Stack will look as following:
</Siginfo_t>
Signal #31 (SIGUSR2); si_code: 9 (SI_EMPTY:siginfo_t contains no
useful information.)
</SignalDetails>
......
sqle_panic
sqldInvCursorPos
sqldInvCursorPos
sqldEndTransaction
sqlrr_cleanup_tran_before_DPS
sqlrrbck
sqlrr_process_close_request
sqlrr_process_close_request
sqlrr_fetch_error
sqlrr_fetch
sqljs_ddm_cntqry
Symptoms of this problem will be as follows:
1. Lock errors will appear in db2diag.log. Example of Lock
Excalation failed:
2010-08-19-16.32.09.494621+600 E2882779A568 LEVEL: Error
PID : 1028104 TID : 53386 PROC : db2sysc 0
INSTANCE: db2inst1 NODE : 000 DB : SAMPLE
APPHDL : 0-54691 APPID:
10.0.0.0.47992.100819024852
AUTHID : AUTHID01
EDUID : 53386 EDUNAME: db2agent (SAMPLE) 0
FUNCTION: DB2 UDB, data management, sqldEscalateLocks, probe:4
MESSAGE : ADM5503E The escalation of "24" locks on table
"VAR01.TABLETB_ITEM" to lock intent "S" has failed. The SQLCODE
is "-911".
2. 901 in db2diag.log with "sqlricls_complex: unexpected
non-NULL table->handle " diagnostic message:
2010-08-19-16.32.10.001219+600 I2887234A882 LEVEL: Severe
PID : 1028104 TID : 56173 PROC : db2sysc 0
INSTANCE: db2inst1 NODE : 000 DB : SAMPLE
APPHDL : 0-55870 APPID:
10.0.0.0.35026.100819063145
AUTHID : AUTHID01
EDUID : 56173 EDUNAME: db2agent (SAMPLE) 0
FUNCTION: DB2 UDB, relation data serv, sqlrr_dump_ffdc,
probe:300
DATA #1 : SQLCA, PD_DB2_TYPE_SQLCA, 136 bytes
sqlcaid : SQLCA sqlcabc: 136 sqlcode: -901 sqlerrml: 51
sqlerrmc: sqlricls_complex: unexpected non-NULL table->handle
sqlerrp : SQLRI1B8
sqlerrd : (1) 0x00000000 (2) 0x00000000 (3) 0x00000000
(4) 0x00000000 (5) 0xFFFFF503 (6) 0x00000000
sqlwarn : (1) (2) (3) (4) (5) (6)
(7) (8) (9) (10) (11)
sqlstate:
3. Diagnostic message will appear with debug information about
an open scan on the permanent table:
2010-08-19-16.32.10.248626+600 I2946467A531 LEVEL: Severe
PID : 1028104 TID : 56173 PROC : db2sysc 0
INSTANCE: db2inst1 NODE : 000 DB : SAMPLE
APPHDL : 0-55870 APPID:
10.0.0.0.35026.100819063145
AUTHID : AUTHID01
EDUID : 56173 EDUNAME: db2agent (SAMPLE) 0
FUNCTION: DB2 UDB, trace services, sqlt_logerr_string (secondary
logging fu, Probe:0
MESSAGE : SQLD_CCB:
DATA #1 : String, 52 bytes
pool(TID)=24, obj(FID)=7447, indexid(IID)=3, class=0
2010-08-19-16.32.10.255504+600 I2948798A532 LEVEL: Severe
PID : 1028104 TID : 56173 PROC : db2sysc 0
INSTANCE: db2inst1 NODE : 000 DB : SAMPLE
APPHDL : 0-55870 APPID:
10.0.0.0.35026.100819063145
AUTHID : AUTHID01
EDUID : 56173 EDUNAME: db2agent (SAMPLE) 0
FUNCTION: DB2 UDB, trace services, sqlt_logerr_string (secondary
logging fu, probe:0
MESSAGE : SQLD_TCB:
DATA #1 : String, 52 bytes
Perm Table(24:7447)=VAR01 .BTX_ASSISTANCE_PROVIDER
At this point instance will Panic.
Detailed Stack:
The stack looks like:
</Siginfo_t>
Signal #31 (SIGUSR2); si_code: 9 (SI_EMPTY:siginfo_t contains no
useful information.)
</SignalDetails>
......
<StackTrace>
------Function + Offset------
pthread_kill + 0x88
_p_raise + 0x68
raise + 0x34
abort + 0xB4
abort@glue74C + 0x94
sqloExitEDU + 0xA0
sqle_panic__Fv + 0x17C
sqldInvCursorPos__FP8sqeAgenti + 0x2B0
sqldInvCursorPos__FP8sqeAgenti@glue2CA + 0x7C
sqldEndTransaction__FP8sqeAgenti + 0x1D4
sqlrr_cleanup_tran_before_DPS__FP8sqlrr_cbiN62PiT9b + 0x3EC
sqlrrbck__FP8sqlrr_cbiN32P15SQLXA_CALL_INFO + 0xA40
sqlrrbck__FP8sqlrr_cbiN32P15SQLXA_CALL_INFO@glueB65 + 0x84
sqlrr_process_close_request__FP8sqlrr_cbiN32 + 0x200
sqlrr_process_close_request__FP8sqlrr_cbiN32@glue1015 + 0x84
sqlrr_fetch_error__FP8sqlrr_cbP14db2UCinterfaceP15db2UCCursorInf
oiT4@glueD98
+ 0x538
sqlrr_fetch__FP14db2UCinterfaceP15db2UCCursorInfo + 0x58
sqljs_ddm_cntqry__FP14db2UCinterfaceP13sqljDDMObject + 0x9E8
sqljsParseRdbAccessed__FP13sqljsDrdaAsCbP13sqljDDMObjectP14db2UC
interface
+ 0x164
.sqljsParse.fdpr.clone.624__FP13sqljsDrdaAsCbP14db2UCinterface +
0x330
@64@sqljsSqlam__FP14db2UCinterfaceP8sqeAgentb + 0x3CC
@64@sqljsDriveRequests__FP8sqeAgentP14db2UCconHandle + 0xB4
@64@sqljsDrdaAsInnerDriver__FP18SQLCC_INITSTRUCT_Tb + 0x2B0
sqljsDrdaAsDriver__FP18SQLCC_INITSTRUCT_T + 0xFC
RunEDU__8sqeAgentFv + 0x80
EDUDriver__9sqzEDUObjFv + 0xE4
sqloEDUEntry + 0x264
</StackTrace> | |
| Problem Summary: | |
**************************************************************** * USERS AFFECTED: * * All. * **************************************************************** * PROBLEM DESCRIPTION: * * DB2 instance crash in cases when Instance is experiencing * * lockin issues and the SQL has XML column in SELECT list. * * * * * * DB2 instance could crash in cases when Instance is * * experiencing locking issues (Failed lock excalations for * * example) and SQL used has XML column in SELECT list, i.e. * * the conditions are * * * * 1. TABLE MUST HAVE XML (XML in SELECT list. Check the * * table's definition for XML column.) * * 2. Encounter LOCKING ERRORs * * * * Stack will look as following: * * </Siginfo_t> * * Signal #31 (SIGUSR2); si_code: 9 (SI_EMPTY:siginfo_t * * contains no useful information.) * * </SignalDetails> * * ...... * * sqle_panic * * sqldInvCursorPos * * sqldInvCursorPos * * sqldEndTransaction * * sqlrr_cleanup_tran_before_DPS * * sqlrrbck * * sqlrr_process_close_request * * sqlrr_process_close_request * * sqlrr_fetch_error * * sqlrr_fetch * * sqljs_ddm_cntqry * * * * * * Symptoms of this problem will be as follows: * * * * 1. Lock errors will appear in db2diag.log. Example of Lock * * Excalation failed: * * * * 2010-08-19-16.32.09.494621+600 E2882779A568 LEVEL: * * Error * * PID : 1028104 TID : 53386 PROC : * * db2sysc 0 * * INSTANCE: db2inst1 NODE : 000 DB : * * SAMPLE * * APPHDL : 0-54691 APPID: * * 10.0.0.0.47992.100819024852 * * AUTHID : AUTHID01 * * EDUID : 53386 EDUNAME: db2agent (SAMPLE) 0 * * FUNCTION: DB2 UDB, data management, sqldEscalateLocks, * * probe:4 * * MESSAGE : ADM5503E The escalation of "24" locks on table * * "VAR01.TABLETB_ITEM" to lock intent "S" has failed. The * * SQLCODE * * is "-911". * * * * 2. 901 in db2diag.log with "sqlricls_complex: unexpected * * non-NULL table->handle " diagnostic message: * * * * 2010-08-19-16.32.10.001219+600 I2887234A882 LEVEL: * * Severe * * PID : 1028104 TID : 56173 PROC : * * db2sysc 0 * * INSTANCE: db2inst1 NODE : 000 DB : * * SAMPLE * * APPHDL : 0-55870 APPID: * * 10.0.0.0.35026.100819063145 * * AUTHID : AUTHID01 * * EDUID : 56173 EDUNAME: db2agent (SAMPLE) 0 * * FUNCTION: DB2 UDB, relation data serv, sqlrr_dump_ffdc, * * probe:300 * * DATA #1 : SQLCA, PD_DB2_TYPE_SQLCA, 136 bytes * * sqlcaid : SQLCA sqlcabc: 136 sqlcode: -901 sqlerrml: 51 * * sqlerrmc: sqlricls_complex: unexpected non-NULL * * table->handle * * sqlerrp : SQLRI1B8 * * sqlerrd : (1) 0x00000000 (2) 0x00000000 (3) * * 0x00000000 * * (4) 0x00000000 (5) 0xFFFFF503 (6) * * 0x00000000 * * sqlwarn : (1) (2) (3) (4) (5) (6) * * * * (7) (8) (9) (10) (11) * * sqlstate: * * * * 3. Diagnostic message will appear with debug information * * about * * an open scan on the permanent table: * * * * 2010-08-19-16.32.10.248626+600 I2946467A531 LEVEL: * * Severe * * PID : 1028104 TID : 56173 PROC : * * db2sysc 0 * * INSTANCE: db2inst1 NODE : 000 DB : * * SAMPLE * * APPHDL : 0-55870 APPID: * * 10.0.0.0.35026.100819063145 * * AUTHID : AUTHID01 * * EDUID : 56173 EDUNAME: db2agent (SAMPLE) 0 * * FUNCTION: DB2 UDB, trace services, sqlt_logerr_string * * (secondary * * logging fu, Probe:0 * * MESSAGE : SQLD_CCB: * * DATA #1 : String, 52 bytes * * pool(TID)=24, obj(FID)=7447, indexid(IID)=3, class=0 * * * * 2010-08-19-16.32.10.255504+600 I2948798A532 LEVEL: * * Severe * * PID : 1028104 TID : 56173 PROC : * * db2sysc 0 * * INSTANCE: db2inst1 NODE : 000 DB : * * SAMPLE * * APPHDL : 0-55870 APPID: * * 10.0.0.0.35026.100819063145 * * AUTHID : AUTHID01 * * EDUID : 56173 EDUNAME: db2agent (SAMPLE) 0 * * FUNCTION: DB2 UDB, trace services, sqlt_logerr_string * * (secondary * * logging fu, probe:0 * * MESSAGE : SQLD_TCB: * * DATA #1 : String, 52 bytes * * Perm Table(24:7447)=VAR01 .BTX_ASSISTANCE_PROVIDER * * * * At this point instance will Panic. * * Detailed Stack: * * * * The stack looks like: * * </Siginfo_t> * * Signal #31 (SIGUSR2); si_code: 9 (SI_EMPTY:siginfo_t * * contains no useful information.) * * </SignalDetails> * * ...... * * <StackTrace> * * ------Function + Offset------ * * pthread_kill + 0x88 * * _p_raise + 0x68 * * raise + 0x34 * * abort + 0xB4 * * abort@glue74C + 0x94 * * sqloExitEDU + 0xA0 * * sqle_panic__Fv + 0x17C * * sqldInvCursorPos__FP8sqeAgenti + 0x2B0 * * sqldInvCursorPos__FP8sqeAgenti@glue2CA + 0x7C * * sqldEndTransaction__FP8sqeAgenti + 0x1D4 * * sqlrr_cleanup_tran_before_DPS__FP8sqlrr_cbiN62PiT9b + 0x3EC * * sqlrrbck__FP8sqlrr_cbiN32P15SQLXA_CALL_INFO + 0xA40 * * sqlrrbck__FP8sqlrr_cbiN32P15SQLXA_CALL_INFO@glueB65 + 0x84 * * sqlrr_process_close_request__FP8sqlrr_cbiN32 + 0x200 * * sqlrr_process_close_request__FP8sqlrr_cbiN32@glue1015 + 0x84 * * sqlrr_fetch_error__FP8sqlrr_cbP14db2UCinterfaceP15db2UCCursorI * + 0x538 * * sqlrr_fetch__FP14db2UCinterfaceP15db2UCCursorInfo + 0x58 * * sqljs_ddm_cntqry__FP14db2UCinterfaceP13sqljDDMObject + 0x9E8 * * sqljsParseRdbAccessed__FP13sqljsDrdaAsCbP13sqljDDMObjectP14db2 * + 0x164 * * .sqljsParse.fdpr.clone.624__FP13sqljsDrdaAsCbP14db2UCinterface * + 0x330 * * @64@sqljsSqlam__FP14db2UCinterfaceP8sqeAgentb + 0x3CC * * @64@sqljsDriveRequests__FP8sqeAgentP14db2UCconHandle + 0xB4 * * @64@sqljsDrdaAsInnerDriver__FP18SQLCC_INITSTRUCT_Tb + 0x2B0 * * sqljsDrdaAsDriver__FP18SQLCC_INITSTRUCT_T + 0xFC * * RunEDU__8sqeAgentFv + 0x80 * * EDUDriver__9sqzEDUObjFv + 0xE4 * * sqloEDUEntry + 0x264 * * </StackTrace> * **************************************************************** * RECOMMENDATION: * * Update to version 9.5 fixpack 8 or later fixpack. * **************************************************************** | |
| Local Fix: | |
Please, use LOCKLIST AUTOMATIC and make sure that there is enough instance memory. | |
| available fix packs: | |
DB2 Version 9.5 Fix Pack 8 for Linux, UNIX, and Windows | |
| Solution | |
This problem is first fixed in version 9.5 fixpack 8. | |
| Workaround | |
Please, use LOCKLIST AUTOMATIC and make sure that there is enough instance memory. | |
| Timestamps | |
Date - problem reported : Date - problem closed : Date - last modified : | 05.04.2011 27.06.2011 27.06.2011 |
| Problem solved at the following versions (IBM BugInfos) | |
9.5.FP8 | |
| Problem solved according to the fixlist(s) of the following version(s) | |
| 9.5.0.8 |
|