I desperately try to format the incoming snmp trap. But somehow it does not take affect.
relevant part of snmptt.conf
Code: Select all
EVENT oraEMNGEvent .1.3.6.1.4.1.111.15.2.0.3 "Status Events" Normal
FORMAT $20: $2
EXEC /usr/local/bin/snmptraphandling.py "$r" "SNMP Traps" "$4" "$@" "$-*" "$20: $2"
SDESC
The variables included in the oraEMNGAlert trap.
Variables:
1: oraEMNGEventNotifType
2: oraEMNGEventMessage
3: oraEMNGEventMessageURL
4: oraEMNGEventSeverity
5: oraEMNGEventSeverityCode
6: oraEMNGEventRepeatCount
7: oraEMNGEventActionMsg
8: oraEMNGEventOccurrenceTime
9: oraEMNGEventReportedTime
10: oraEMNGEventCategories
11: oraEMNGEventCategoryCodes
12: oraEMNGEventType
13: oraEMNGEventName
14: oraEMNGAssocIncidentId
15: oraEMNGAssocIncidentOwner
16: oraEMNGAssocIncidentAcked
17: oraEMNGAssocIncidentStatus
18: oraEMNGAssocIncidentPriority
19: oraEMNGAssocIncidentEscLevel
20: oraEMNGEventTargetName
21: oraEMNGEventTargetNameURL
22: oraEMNGEventTargetType
23: oraEMNGEventHostName
24: oraEMNGEventTargetOwner
25: oraEMNGEventTgtLifeCycleStatus
26: oraEMNGEventTargetVersion
27: oraEMNGEventUserDefinedTgtProp
28: oraEMNGEventSourceObjName
29: oraEMNGEventSourceObjNameURL
30: oraEMNGEventSourceObjType
31: oraEMNGEventSourceObjSubType
32: oraEMNGEventSourceObjOwner
33: oraEMNGEventCAJobName
34: oraEMNGEventCAJobStatus
35: oraEMNGEventCAJobOwner
36: oraEMNGEventCAJobStepOutput
Code: Select all
Tue Nov 17 11:00:14 2015 .1.3.6.1.4.1.111.15.2.0.3 Normal "Status Events" hhostname-somehost: Internal error (ORA 600 [kzsviver:4]) detected in /pkgs/sanitized/u00/app/oracle/diag/rdbms/p1cc/P1CC/alert/log.xml at time/line number: Tue Nov 17 10:57:29 2015/258779.Code: Select all
[1447754417] SERVICE ALERT: sanitized;SNMP Traps;CRITICAL;HARD;1;NOTIF_NORMAL Internal error (ORA 600 [kzsviver:4]) detected in /pkgs/sanitized/u00/app/oracle/diag/rdbms/p1cc/P1CC/alert/log.xml at time/line number: Tue Nov 17 10:55:14 2015/258737. https://sanitized/em/redirect\?pageType=sdk-core-event-console-detailEvent&issueID=24A5112C1DD26219E053181E200A3E2F Critical CRITICAL 0 Nov 17, 2015 11:00:12 AM CET Diagnostics, Fault Diagnostics, Fault Metric Alert adrAlertLogIncidentError:genericInternalErrStack 36589 No New None 0 sanitized https://sanitized/em/redirect\?pageType=TARGET_HOMEPAGE&targetName=sanitized&targetType=oracle_database Database Instance sanitized SYSMAN Production 11.2.0.4.0 Operating System=Linux, Platform=x86_64 BIS target snmp notification BIS target snmp notification,BIS Metric rule SYSMAN 24A5112C1DD26219E053181E200A3E2F adr_ecid=null, adr_problemKey=ORA 600 [kzsviver:4], traceFileName=/pkgs/sanitized/u00/app/oracle/diag/rdbms/p1cc/P1CC/trace/P1CC_ora_41105.trc, alertLogName=/pkgs/sanitized/u00/app/oracle/diag/rdbms/p1cc/P1CC/alert/log.xml, adr_incidentId=196586, adr_impact=null Internal error (ORA 600 [kzsviver:4]) detected in /pkgs/sanitized/u00/app/oracle/diag/rdbms/p1cc/P1CC/alert/log.xml at time/line number: Tue Nov 17 10:55:14 2015/258737. Metric GUID=48055FBF2B327A0550FAA445E0B1E0BB Severity GUID=24A5112C1DCE6219E053181E200A3E2F Cycle GUID=24A5112C1DCE6219E053181E200A3E2F Collection Name=adr_alert_log_rollup Metric Group=Incident Metric=Generic Internal Error Metric Description= Metric value=Errors in file /pkgs/sanitized/u00/app/oracle/diag/rdbms/p1cc/P1CC/trace/P1CC_ora_41105.trc (incident=196586):~ORA-00600: internal error code, arguments: [kzsviver:4], [], [], [], [], [], [], [], [], [], [], [] Key Value=Tue Nov 17 10:55:14 2015/258737 Key Column 1=Time/Line Number Number of keys=1 / enterprises.111.15.3.1.1.2.1 ():NOTIF_NORMAL enterprises.111.15.3.1.1.3.1 ():Internal error (ORA 600 [kzsviver:4]) detected in /pkgs/sanitized/u00/app/oracle/diag/rdbms/p1cc/P1CC/alert/log.xml at time/line number: Tue Nov 17 10:55:14 2015/258737. enterprises.111.15.3.1.1.4.1 ():https://sanitized/em/redirect\?pageType=sdk-core-event-console-detailEvent&issueID=24A5112C1DD26219E053181E200A3E2F enterprises.111.15.3.1.1.5.1 ():Critical enterprises.111.15.3.1.1.6.1 ():CRITICAL enterprises.111.15.3.1.1.7.1 ():0 enterprises.111.15.3.1.1.8.1 (): enterprises.111.15.3.1.1.9.1 (): enterprises.111.15.3.1.1.10.1 ():Nov 17, 2015 11:00:12 AM CET enterprises.111.15.3.1.1.11.1 ():Diagnostics, Fault enterprises.111.15.3.1.1.12.1 ():Diagnostics, Fault enterprises.111.15.3.1.1.13.1 ():Metric Alert enterprises.111.15.3.1.1.14.1 ():adrAlertLogIncidentError:genericInternalErrStack enterprises.111.15.3.1.1.15.1 ():36589 enterprises.111.15.3.1.1.16.1 (): enterprises.111.15.3.1.1.17.1 ():No enterprises.111.15.3.1.1.18.1 ():New enterprises.111.15.3.1.1.19.1 ():None enterprises.111.15.3.1.1.20.1 ():0 enterprises.111.15.3.1.1.21.1 ():sanitized enterprises.111.15.3.1.1.22.1 ():https://sanitized/em/redirect\?pageType=TARGET_HOMEPAGE&targetName=sanitized&targetType=oracle_database enterprises.111.15.3.1.1.23.1 ():Database Instance enterprises.111.15.3.1.1.24.1 ()sanitized enterprises.111.15.3.1.1.25.1 ():SYSMAN enterprises.111.15.3.1.1.26.1 ():Production enterprises.111.15.3.1.1.27.1 ():11.2.0.4.0 enterprises.111.15.3.1.1.28.1 ():Operating System=Linux, Platform=x86_64 enterprises.111.15.3.1.1.29.1 (): enterprises.111.15.3.1.1.30.1 (): enterprises.111.15.3.1.1.31.1 (): enterprises.111.15.3.1.1.32.1 (): enterprises.111.15.3.1.1.33.1 (): enterprises.111.15.3.1.1.34.1 (): enterprises.111.15.3.1.1.35.1 (): enterprises.111.15.3.1.1.36.1 (): enterprises.111.15.3.1.1.37.1 (): enterprises.111.15.3.1.1.38.1 (): enterprises.111.15.3.1.1.39.1 ():BIS target snmp notification enterprises.111.15.3.1.1.40.1 ():BIS target snmp notification,BIS Metric rule enterprises.111.15.3.1.1.41.1 ():SYSMAN enterprises.111.15.3.1.1.42.1 ():24A5112C1DD26219E053181E200A3E2F enterprises.111.15.3.1.1.43.1 (): enterprises.111.15.3.1.1.44.1 ():adr_ecid=null, adr_problemKey=ORA 600 [kzsviver:4], traceFileName=/pkgs/sanitized/u00/app/oracle/diag/rdbms/p1cc/P1CC/trace/P1CC_ora_41105.trc, alertLogName=/pkgs/sanitized/u00/app/oracle/diag/rdbms/p1cc/P1CC/alert/log.xml, adr_incidentId=196586, adr_impact=null enterprises.111.15.3.1.1.45.1 (): enterprises.111.15.3.1.1.46.1 ():Internal error (ORA 600 [kzsviver:4]) detected in /pkgs/sanitized/u00/app/oracle/diag/rdbms/p1cc/P1CC/alert/log.xml at time/line number: Tue Nov 17 10:55:14 2015/258737. enterprises.111.15.3.1.1.47.1 (): enterprises.111.15.3.1.1.48.1 (): enterprises.111.15.3.1.1.49.1 (): enterprises.111.15.3.1.1.50.1 (): enterprises.111.15.3.1.1.51.1 (): enterprises.111.15.3.1.1.61.1 ():Metric GUID=48055FBF2B327A0550FAA445E0B1E0BB enterprises.111.15.3.1.1.62.1 ():Severity GUID=24A5112C1DCE6219E053181E200A3E2F enterprises.111.15.3.1.1.63.1 ():Cycle GUID=24A5112C1DCE6219E053181E200A3E2F enterprises.111.15.3.1.1.64.1 ():Collection Name=adr_alert_log_rollup enterprises.111.15.3.1.1.65.1 ():Metric Group=Incident enterprises.111.15.3.1.1.66.1 ():Metric=Generic Internal Error enterprises.111.15.3.1.1.67.1 ():Metric Description= enterprises.111.15.3.1.1.68.1 ():Metric value=Errors in file /pkgs/sanitized/u00/app/oracle/diag/rdbms/p1cc/P1CC/trace/P1CC_ora_41105.trc (incident=196586):~ORA-00600: internal error code, arguments: [kzsviver:4], [], [], [], [], [], [], [], [], [], [], [] enterprises.111.15.3.1.1.69.1 ():Key Value=Tue Nov 17 10:55:14 2015/258737 enterprises.111.15.3.1.1.70.1 ():Key Column 1=Time/Line Number enterprises.111.15.3.1.1.71.1 (): enterprises.111.15.3.1.1.72.1 (): enterprises.111.15.3.1.1.73.1 (): enterprises.111.15.3.1.1.74.1 (): enterprises.111.15.3.1.1.75.1 (): enterprises.111.15.3.1.1.76.1 (): enterprises.111.15.3.1.1.77.1 (): enterprises.111.15.3.1.1.78.1 (): enterprises.111.15.3.1.1.79.1 (): enterprises.111.15.3.1.1.80.1 (): enterprises.111.15.3.1.1.81.1 (): enterprises.111.15.3.1.1.82.1 (): enterprises.111.15.3.1.1.83.1 (): enterprises.111.15.3.1.1.84.1 ():Number of keys=1 enterprises.111.15.3.1.1.85.1 ():