Nagios Support Forum

Support for Nagios products and services
https://support.nagios.com/forum/

Change FATAL condition to CRITICAL in trap

https://support.nagios.com/forum/viewtopic.php?t=33822

Page 2 of 2

Re: Change FATAL condition to CRITICAL in trap

Posted: Wed Jul 29, 2015 9:58 am
by snapon_admin
ssax wrote:What does your /var/log/messages show for that trap? It doesn't look like it's including that var.
This is everything in /var/log/messages concerning the trap at 14:03 yesterday:

Code: Select all

Jul 28 14:03:01 lisl-ngos-01-pv snmptrapd[16929]: 2015-07-28 14:03:01 <UNKNOWN> [UDP: [<IP ADDRESS>]:9896->[<IP ADDRESS>]]:#012.1.3.6.1.2.1.1.3.0 = Timeticks: (131028291) 15 days, 3:58:02.91#011.1.3.6.1.6.3.1.1.4.1.0 = OID: .1.3.6.1.4.1.111.15.2#011.1.3.6.1.4.1.111.15.3.1.1.2.1 = STRING: "NOTIF_NORMAL"#011.1.3.6.1.4.1.111.15.3.1.1.3.1 = STRING: "Failed to connect to database instance: Failed to connect: java.sql.SQLException: The Network Adapter could not establish the connection."#011.1.3.6.1.4.1.111.15.3.1.1.4.1 = STRING: "https://lisgrid01p.snapon.com:7799/em/redirect?pageType=sdk-core-event-console-detailEvent&issueID=1AC3FC17957527C9E054020820F4DF2F"#011.1.3.6.1.4.1.111.15.3.1.1.5.1 = STRING: "Fatal"#011.1.3.6.1.4.1.111.15.3.1.1.6.1 = STRING: "FATAL"#011.1.3.6.1.4.1.111.15.3.1.1.7.1 = STRING: "0"#011.1.3.6.1.4.1.111.15.3.1.1.8.1 = ""#011.1.3.6.1.4.1.111.15.3.1.1.9.1 = ""#011.1.3.6.1.4.1.111.15.3.1.1.10.1 = STRING: "Jul 28, 2015 2:03:00 PM CDT"#011.1.3.6.1.4.1.111.15.3.1.1.11.1 = STRING: "Availability"#011.1.3.6.1.4.1.111.15.3.1.1.12.1 = STRING: "Availability"#011.1.3.6.1.4.1.111.15.3.1.1.13.1 = STRING: "Target Availability"#011.1.3.6.1.4.1.111.15.3.1.1.14.1 = STRING: "Status"#011.1.3.6.1.4.1.111.15.3.1.1.15.1 = STRING: "264"#011.1.3.6.1.4.1.111.15.3.1.1.16.1 = ""#011.1.3.6.1.4.1.111.15.3.1.1.17.1 = STRING: "No"#011.1.3.6.1.4.1.111.15.3.1.1.18.1 = STRING: "New"#011.1.3.6.1.4.1.111.15.3.1.1.19.1 = STRING: "None"#011.1.3.6.1.4.1.111.15.3.1.1.20.1 = STRING: "0"#011.1.3.6.1.4.1.111.15.3.1.1.21.1 = STRING: "kdblab01.snapon.com"#011.1.3.6.1.4.1.111.15.3.1.1.22.1 = STRING: "https://lisgrid01p.snapon.com:7799/em/redirect?pageType=TARGET_HOMEPAGE&targetName=kdblab01.snapon.com&targetType=oracle_database"#011.1.3.6.1.4.1.111.15.3.1.1.23.1 = STRING: "Database Instance"#011.1.3.6.1.4.1.111.15.3.1.1.24.1 = STRING: "kenrman01t.snapon.com"#011.1.3.6.1.4.1.111.15.3.1.1.25.1 = STRING: "SYSMAN"#011.1.3.6.1.4.1.111.15.3.1.1.26.1 = ""#011.1.3.6.1.4.1.111.15.3.1.1.27.1 = STRING: "11.2.0.3.0"#011.1.3.6.1.4.1.111.15.3.1.1.28.1 = STRING: "
Jul 28 14:03:02 lisl-ngos-01-pv snmptrapd[16929]: 2015-07-28 14:03:02 <UNKNOWN> [UDP: [<IP ADDRESS>]:9896->[<IP ADDRESS>]]:#012.1.3.6.1.2.1.1.3.0 = Timeticks: (131028318) 15 days, 3:58:03.18#011.1.3.6.1.6.3.1.1.4.1.0 = OID: .1.3.6.1.4.1.111.15.2#011.1.3.6.1.4.1.111.15.3.1.1.2.1 = STRING: "NOTIF_NORMAL"#011.1.3.6.1.4.1.111.15.3.1.1.3.1 = STRING: "The database status is UNKNOWN."#011.1.3.6.1.4.1.111.15.3.1.1.4.1 = STRING: "https://lisgrid01p.snapon.com:7799/em/redirect?pageType=sdk-core-event-console-detailEvent&issueID=1AC3FC17956F27C9E054020820F4DF2F"#011.1.3.6.1.4.1.111.15.3.1.1.5.1 = STRING: "Critical"#011.1.3.6.1.4.1.111.15.3.1.1.6.1 = STRING: "CRITICAL"#011.1.3.6.1.4.1.111.15.3.1.1.7.1 = STRING: "0"#011.1.3.6.1.4.1.111.15.3.1.1.8.1 = ""#011.1.3.6.1.4.1.111.15.3.1.1.9.1 = ""#011.1.3.6.1.4.1.111.15.3.1.1.10.1 = STRING: "Jul 28, 2015 2:03:00 PM CDT"#011.1.3.6.1.4.1.111.15.3.1.1.11.1 = STRING: "Availability"#011.1.3.6.1.4.1.111.15.3.1.1.12.1 = STRING: "Availability"#011.1.3.6.1.4.1.111.15.3.1.1.13.1 = STRING: "Metric Alert"#011.1.3.6.1.4.1.111.15.3.1.1.14.1 = STRING: "Response:State"#011.1.3.6.1.4.1.111.15.3.1.1.15.1 = STRING: "263"#011.1.3.6.1.4.1.111.15.3.1.1.16.1 = ""#011.1.3.6.1.4.1.111.15.3.1.1.17.1 = STRING: "No"#011.1.3.6.1.4.1.111.15.3.1.1.18.1 = STRING: "New"#011.1.3.6.1.4.1.111.15.3.1.1.19.1 = STRING: "None"#011.1.3.6.1.4.1.111.15.3.1.1.20.1 = STRING: "0"#011.1.3.6.1.4.1.111.15.3.1.1.21.1 = STRING: "kdblab01.snapon.com"#011.1.3.6.1.4.1.111.15.3.1.1.22.1 = STRING: "https://lisgrid01p.snapon.com:7799/em/redirect?pageType=TARGET_HOMEPAGE&targetName=kdblab01.snapon.com&targetType=oracle_database"#011.1.3.6.1.4.1.111.15.3.1.1.23.1 = STRING: "Database Instance"#011.1.3.6.1.4.1.111.15.3.1.1.24.1 = STRING: "kenrman01t.snapon.com"#011.1.3.6.1.4.1.111.15.3.1.1.25.1 = STRING: "SYSMAN"#011.1.3.6.1.4.1.111.15.3.1.1.26.1 = ""#011.1.3.6.1.4.1.111.15.3.1.1.27.1 = STRING: "11.2.0.3.0"#011.1.3.6.1.4.1.111.15.3.1.1.28.1 = STRING: "Operating System=SunOS, Platform=sparc"#011.1.3.6.1.4.1.111.15.3.1.1.29.1 = ""#011.1.3.6.1.4.1.111.

Re: Change FATAL condition to CRITICAL in trap

Posted: Wed Jul 29, 2015 10:03 am
by snapon_admin
Box293 wrote:Can you do the following:

Code: Select all

service stop snmptt
Now go and send the trap from the sending device.
This will be spooled into a file in /var/spool/snmptt/
Get a copy of this file and upload it here
Then:

Code: Select all

service start snmptt

Uhhh....I feel like this is a problem...

Code: Select all

[root@lisl-ngos-01-pv snmp]# ll /var/spool/snmptt 
total 796
-rw-r--r--. 1 root root  260 Jul 28 18:58 #snmptt-trap-1438127888185436
-rw-r--r--. 1 root root  260 Jul 28 18:58 #snmptt-trap-1438127888370275
-rw-r--r--. 1 root root  260 Jul 28 19:04 #snmptt-trap-1438128289737917
-rw-r--r--. 1 root root  260 Jul 28 19:04 #snmptt-trap-1438128289965182
-rw-r--r--. 1 root root  260 Jul 28 19:18 #snmptt-trap-1438129127321817
-rw-r--r--. 1 root root  260 Jul 28 19:18 #snmptt-trap-1438129127568445
-rw-r--r--. 1 root root  272 Jul 28 19:19 #snmptt-trap-1438129152211239
-rw-r--r--. 1 root root  270 Jul 28 19:19 #snmptt-trap-1438129182336151
-rw-r--r--. 1 root root  261 Jul 28 19:25 #snmptt-trap-1438129528940715
-rw-r--r--. 1 root root  261 Jul 28 19:25 #snmptt-trap-1438129529159434
-rw-r--r--. 1 root root  189 Jul 28 19:26 #snmptt-trap-1438129571021414
-rw-r--r--. 1 root root  261 Jul 28 19:32 #snmptt-trap-1438129942936309
-rw-r--r--. 1 root root  261 Jul 28 19:32 #snmptt-trap-1438129943183083
-rw-r--r--. 1 root root  227 Jul 28 19:40 #snmptt-trap-1438130409474034
-rw-r--r--. 1 root root  261 Jul 28 19:46 #snmptt-trap-1438130760460024
-rw-r--r--. 1 root root  261 Jul 28 19:46 #snmptt-trap-1438130760707030
-rw-r--r--. 1 root root  261 Jul 28 19:52 #snmptt-trap-1438131169321618
-rw-r--r--. 1 root root  261 Jul 28 19:52 #snmptt-trap-1438131169528574
-rw-r--r--. 1 root root  261 Jul 28 19:59 #snmptt-trap-1438131589725145
-rw-r--r--. 1 root root  261 Jul 28 19:59 #snmptt-trap-1438131590025862
-rw-r--r--. 1 root root  339 Jul 28 20:01 #snmptt-trap-1438131676001994
-rw-r--r--. 1 root root  305 Jul 28 20:01 #snmptt-trap-1438131683989820
-rw-r--r--. 1 root root  261 Jul 28 20:05 #snmptt-trap-1438131952330526
-rw-r--r--. 1 root root  261 Jul 28 20:05 #snmptt-trap-1438131952489014
-rw-r--r--. 1 root root  255 Jul 28 20:12 #snmptt-trap-1438132379185320
-rw-r--r--. 1 root root  255 Jul 28 20:12 #snmptt-trap-1438132379352512
-rw-r--r--. 1 root root  261 Jul 28 20:13 #snmptt-trap-1438132426934718
-rw-r--r--. 1 root root  261 Jul 28 20:13 #snmptt-trap-1438132427184995
-rw-r--r--. 1 root root  338 Jul 28 20:21 #snmptt-trap-1438132907226918
-rw-r--r--. 1 root root  304 Jul 28 20:21 #snmptt-trap-1438132915085906
-rw-r--r--. 1 root root  188 Jul 28 20:26 #snmptt-trap-1438133170450417
-rw-r--r--. 1 root root  226 Jul 28 20:40 #snmptt-trap-1438134009263633
-rw-r--r--. 1 root root  250 Jul 28 20:43 #snmptt-trap-1438134226063924
-rw-r--r--. 1 root root  255 Jul 28 20:52 #snmptt-trap-1438134734472567
-rw-r--r--. 1 root root  255 Jul 28 20:52 #snmptt-trap-1438134734697221
-rw-r--r--. 1 root root  255 Jul 28 20:56 #snmptt-trap-1438134977398504
-rw-r--r--. 1 root root  255 Jul 28 20:56 #snmptt-trap-1438134977596429
-rw-r--r--. 1 root root  255 Jul 28 21:04 #snmptt-trap-1438135462790091
-rw-r--r--. 1 root root  255 Jul 28 21:04 #snmptt-trap-1438135463032273
-rw-r--r--. 1 root root  272 Jul 28 21:10 #snmptt-trap-1438135840242257
-rw-r--r--. 1 root root  270 Jul 28 21:10 #snmptt-trap-1438135850232137
-rw-r--r--. 1 root root  340 Jul 28 21:14 #snmptt-trap-1438136098579733
-rw-r--r--. 1 root root  268 Jul 28 21:14 #snmptt-trap-1438136098686369
-rw-r--r--. 1 root root  337 Jul 28 21:14 #snmptt-trap-1438136098774152
-rw-r--r--. 1 root root  268 Jul 28 21:14 #snmptt-trap-1438136098865796
-rw-r--r--. 1 root root  340 Jul 28 21:15 #snmptt-trap-1438136103130068
-rw-r--r--. 1 root root  270 Jul 28 21:15 #snmptt-trap-1438136103220835
-rw-r--r--. 1 root root  340 Jul 28 21:15 #snmptt-trap-1438136104080743
-rw-r--r--. 1 root root  270 Jul 28 21:15 #snmptt-trap-1438136104346878
-rw-r--r--. 1 root root  343 Jul 28 21:15 #snmptt-trap-1438136104440013
-rw-r--r--. 1 root root  274 Jul 28 21:15 #snmptt-trap-1438136104531527
-rw-r--r--. 1 root root  305 Jul 28 21:15 #snmptt-trap-1438136104653716
-rw-r--r--. 1 root root  289 Jul 28 21:15 #snmptt-trap-1438136104752344
-rw-r--r--. 1 root root  305 Jul 28 21:15 #snmptt-trap-1438136104853096
-rw-r--r--. 1 root root  289 Jul 28 21:15 #snmptt-trap-1438136104949023
-rw-r--r--. 1 root root  308 Jul 28 21:15 #snmptt-trap-1438136105105688
-rw-r--r--. 1 root root  293 Jul 28 21:15 #snmptt-trap-1438136105207699
-rw-r--r--. 1 root root  305 Jul 28 21:15 #snmptt-trap-1438136105933717
-rw-r--r--. 1 root root  287 Jul 28 21:15 #snmptt-trap-1438136106053906
-rw-r--r--. 1 root root  302 Jul 28 21:15 #snmptt-trap-1438136106141818
-rw-r--r--. 1 root root  287 Jul 28 21:15 #snmptt-trap-1438136106229490
-rw-r--r--. 1 root root  342 Jul 28 21:15 #snmptt-trap-1438136106615093
-rw-r--r--. 1 root root  274 Jul 28 21:15 #snmptt-trap-1438136106710298
-rw-r--r--. 1 root root  307 Jul 28 21:15 #snmptt-trap-1438136107881175
-rw-r--r--. 1 root root  293 Jul 28 21:15 #snmptt-trap-1438136107969530
-rw-r--r--. 1 root root  269 Jul 28 21:21 #snmptt-trap-1438136477930049
-rw-r--r--. 1 root root  342 Jul 28 21:21 #snmptt-trap-1438136497059721
-rw-r--r--. 1 root root  274 Jul 28 21:21 #snmptt-trap-1438136497147856
-rw-r--r--. 1 root root  307 Jul 28 21:21 #snmptt-trap-1438136497235536
-rw-r--r--. 1 root root  293 Jul 28 21:21 #snmptt-trap-1438136497324790
-rw-r--r--. 1 root root  272 Jul 28 21:21 #snmptt-trap-1438136497922335
-rw-r--r--. 1 root root  340 Jul 28 21:21 #snmptt-trap-1438136517940995
-rw-r--r--. 1 root root  268 Jul 28 21:21 #snmptt-trap-1438136518036163
-rw-r--r--. 1 root root  337 Jul 28 21:21 #snmptt-trap-1438136518126602
-rw-r--r--. 1 root root  268 Jul 28 21:21 #snmptt-trap-1438136518217032
-rw-r--r--. 1 root root  305 Jul 28 21:21 #snmptt-trap-1438136518317630
-rw-r--r--. 1 root root  287 Jul 28 21:21 #snmptt-trap-1438136518405101
-rw-r--r--. 1 root root  302 Jul 28 21:21 #snmptt-trap-1438136518495702
-rw-r--r--. 1 root root  287 Jul 28 21:21 #snmptt-trap-1438136518586611
-rw-r--r--. 1 root root  188 Jul 28 21:26 #snmptt-trap-1438136769876577
-rw-r--r--. 1 root root  269 Jul 28 21:27 #snmptt-trap-1438136877949077
-rw-r--r--. 1 root root  272 Jul 28 21:28 #snmptt-trap-1438136897947176
-rw-r--r--. 1 root root  226 Jul 28 21:40 #snmptt-trap-1438137611280396
-rw-r--r--. 1 root root 1273 Jul 28 22:02 #snmptt-trap-1438138941511041
-rw-r--r--. 1 root root 1172 Jul 28 22:05 #snmptt-trap-1438139151201438
-rw-r--r--. 1 root root 3580 Jul 28 22:14 #snmptt-trap-1438139655286907
-rw-r--r--. 1 root root 3611 Jul 28 22:14 #snmptt-trap-1438139655406327
-rw-r--r--. 1 root root 3593 Jul 28 22:14 #snmptt-trap-1438139655655285
-rw-r--r--. 1 root root 3580 Jul 28 22:20 #snmptt-trap-1438140036871534
-rw-r--r--. 1 root root 3593 Jul 28 22:20 #snmptt-trap-1438140036981981
-rw-r--r--. 1 root root 3611 Jul 28 22:20 #snmptt-trap-1438140037119101
-rw-r--r--. 1 root root 3713 Jul 28 22:22 #snmptt-trap-1438140120095122
-rw-r--r--. 1 root root 3588 Jul 28 22:22 #snmptt-trap-1438140152982375
-rw-r--r--. 1 root root  188 Jul 28 22:26 #snmptt-trap-1438140369279246
-rw-r--r--. 1 root root  337 Jul 28 22:28 #snmptt-trap-1438140539456848
-rw-r--r--. 1 root root  268 Jul 28 22:28 #snmptt-trap-1438140539542414
-rw-r--r--. 1 root root  302 Jul 28 22:28 #snmptt-trap-1438140539627859
-rw-r--r--. 1 root root  287 Jul 28 22:28 #snmptt-trap-1438140539717368
-rw-r--r--. 1 root root  342 Jul 28 22:29 #snmptt-trap-1438140541345304
-rw-r--r--. 1 root root  274 Jul 28 22:29 #snmptt-trap-1438140541431675
-rw-r--r--. 1 root root  307 Jul 28 22:29 #snmptt-trap-1438140541526640
-rw-r--r--. 1 root root  293 Jul 28 22:29 #snmptt-trap-1438140541707631
-rw-r--r--. 1 root root  340 Jul 28 22:29 #snmptt-trap-1438140541870043
-rw-r--r--. 1 root root  268 Jul 28 22:29 #snmptt-trap-1438140542001874
-rw-r--r--. 1 root root  305 Jul 28 22:29 #snmptt-trap-1438140542124015
-rw-r--r--. 1 root root  287 Jul 28 22:29 #snmptt-trap-1438140542214598
-rw-r--r--. 1 root root  226 Jul 28 22:40 #snmptt-trap-1438141214040912
-rw-r--r--. 1 root root  340 Jul 28 22:48 #snmptt-trap-1438141709721264
-rw-r--r--. 1 root root  268 Jul 28 22:48 #snmptt-trap-1438141709839440
-rw-r--r--. 1 root root  340 Jul 28 22:48 #snmptt-trap-1438141714273617
-rw-r--r--. 1 root root  270 Jul 28 22:48 #snmptt-trap-1438141714377833
-rw-r--r--. 1 root root  342 Jul 28 22:48 #snmptt-trap-1438141714935054
-rw-r--r--. 1 root root  274 Jul 28 22:48 #snmptt-trap-1438141715025279
-rw-r--r--. 1 root root  343 Jul 28 22:48 #snmptt-trap-1438141715117039
-rw-r--r--. 1 root root  274 Jul 28 22:48 #snmptt-trap-1438141715211992
-rw-r--r--. 1 root root  305 Jul 28 22:48 #snmptt-trap-1438141717667855
-rw-r--r--. 1 root root  289 Jul 28 22:48 #snmptt-trap-1438141717762519
-rw-r--r--. 1 root root  307 Jul 28 22:48 #snmptt-trap-1438141718341398
-rw-r--r--. 1 root root  293 Jul 28 22:48 #snmptt-trap-1438141718430471
-rw-r--r--. 1 root root  308 Jul 28 22:48 #snmptt-trap-1438141718522266
-rw-r--r--. 1 root root  293 Jul 28 22:48 #snmptt-trap-1438141718614395
-rw-r--r--. 1 root root  305 Jul 28 22:48 #snmptt-trap-1438141724815856
-rw-r--r--. 1 root root  287 Jul 28 22:48 #snmptt-trap-1438141724908172
-rw-r--r--. 1 root root  340 Jul 28 22:48 #snmptt-trap-1438141731285942
-rw-r--r--. 1 root root  270 Jul 28 22:48 #snmptt-trap-1438141731370753
-rw-r--r--. 1 root root  305 Jul 28 22:48 #snmptt-trap-1438141731456197
-rw-r--r--. 1 root root  289 Jul 28 22:48 #snmptt-trap-1438141731543387
-rw-r--r--. 1 root root  261 Jul 28 23:14 #snmptt-trap-1438143281307694
-rw-r--r--. 1 root root  260 Jul 28 23:15 #snmptt-trap-1438143309437794
-rw-r--r--. 1 root root  188 Jul 28 23:26 #snmptt-trap-1438143968682518
-rw-r--r--. 1 root root  261 Jul 28 23:27 #snmptt-trap-1438144036697544
-rw-r--r--. 1 root root  255 Jul 28 23:32 #snmptt-trap-1438144365576598
-rw-r--r--. 1 root root  261 Jul 28 23:35 #snmptt-trap-1438144521907831
-rw-r--r--. 1 root root  261 Jul 28 23:39 #snmptt-trap-1438144773491134
-rw-r--r--. 1 root root  256 Jul 28 23:39 #snmptt-trap-1438144783603280
-rw-r--r--. 1 root root  226 Jul 28 23:40 #snmptt-trap-1438144808696336
-rw-r--r--. 1 root root  259 Jul 28 23:42 #snmptt-trap-1438144949637816
-rw-r--r--. 1 root root  259 Jul 28 23:44 #snmptt-trap-1438145077244211
-rw-r--r--. 1 root root  261 Jul 28 23:50 #snmptt-trap-1438145400313531
-rw-r--r--. 1 root root  259 Jul 28 23:56 #snmptt-trap-1438145769850517
-rw-r--r--. 1 root root  261 Jul 28 23:58 #snmptt-trap-1438145890384844
-rw-r--r--. 1 root root  259 Jul 29 00:08 #snmptt-trap-1438146525189310
-rw-r--r--. 1 root root  261 Jul 29 00:11 #snmptt-trap-1438146685921480
-rw-r--r--. 1 root root  261 Jul 29 00:12 #snmptt-trap-1438146778547180
-rw-r--r--. 1 root root  259 Jul 29 00:14 #snmptt-trap-1438146884685750
-rw-r--r--. 1 root root  272 Jul 29 00:16 #snmptt-trap-1438147012276653
-rw-r--r--. 1 root root  270 Jul 29 00:17 #snmptt-trap-1438147022287666
-rw-r--r--. 1 root root  188 Jul 29 00:26 #snmptt-trap-1438147568102938
-rw-r--r--. 1 root root  272 Jul 29 00:29 #snmptt-trap-1438147785866876
-rw-r--r--. 1 root root  270 Jul 29 00:29 #snmptt-trap-1438147797261307
-rw-r--r--. 1 root root  256 Jul 29 00:37 #snmptt-trap-1438148226827129
-rw-r--r--. 1 root root  272 Jul 29 00:39 #snmptt-trap-1438148380306948
-rw-r--r--. 1 root root  270 Jul 29 00:39 #snmptt-trap-1438148390257970
-rw-r--r--. 1 root root  226 Jul 29 00:40 #snmptt-trap-1438148409735106
-rw-r--r--. 1 root root  272 Jul 29 00:43 #snmptt-trap-1438148622468520
-rw-r--r--. 1 root root  270 Jul 29 00:43 #snmptt-trap-1438148632477465
-rw-r--r--. 1 root root  259 Jul 29 00:46 #snmptt-trap-1438148780330901
-rw-r--r--. 1 root root  261 Jul 29 00:46 #snmptt-trap-1438148792904336
-rw-r--r--. 1 root root  272 Jul 29 00:52 #snmptt-trap-1438149175856656
-rw-r--r--. 1 root root  270 Jul 29 00:53 #snmptt-trap-1438149186278671
-rw-r--r--. 1 root root  259 Jul 29 00:55 #snmptt-trap-1438149336576543
-rw-r--r--. 1 root root  259 Jul 29 00:55 #snmptt-trap-1438149349766472
-rw-r--r--. 1 root root  261 Jul 29 00:56 #snmptt-trap-1438149408826440
-rw-r--r--. 1 root root  272 Jul 29 01:11 #snmptt-trap-1438150310620971
-rw-r--r--. 1 root root  270 Jul 29 01:12 #snmptt-trap-1438150324634529
-rw-r--r--. 1 root root  256 Jul 29 01:20 #snmptt-trap-1438150815690548
-rw-r--r--. 1 root root  188 Jul 29 01:26 #snmptt-trap-1438151167540682
-rw-r--r--. 1 root root  272 Jul 29 01:33 #snmptt-trap-1438151599216599
-rw-r--r--. 1 root root  270 Jul 29 01:33 #snmptt-trap-1438151613228875
-rw-r--r--. 1 root root  226 Jul 29 01:40 #snmptt-trap-1438152008783611
-rw-r--r--. 1 root root  272 Jul 29 01:44 #snmptt-trap-1438152243275503
-rw-r--r--. 1 root root  270 Jul 29 01:44 #snmptt-trap-1438152253283008
-rw-r--r--. 1 root root  188 Jul 29 02:26 #snmptt-trap-1438154766945425
-rw-r--r--. 1 root root  272 Jul 29 02:26 #snmptt-trap-1438154802352396
-rw-r--r--. 1 root root  270 Jul 29 02:26 #snmptt-trap-1438154812339889
-rw-r--r--. 1 root root  272 Jul 29 02:27 #snmptt-trap-1438154822609461
-rw-r--r--. 1 root root  270 Jul 29 02:27 #snmptt-trap-1438154832631795
-rw-r--r--. 1 root root  226 Jul 29 02:40 #snmptt-trap-1438155608888893
-rw-r--r--. 1 root root  259 Jul 29 02:48 #snmptt-trap-1438156123962279
-rw-r--r--. 1 root root  188 Jul 29 03:26 #snmptt-trap-1438158366363860
-rw-r--r--. 1 root root  226 Jul 29 03:40 #snmptt-trap-1438159208881856
-rw-r--r--. 1 root root  332 Jul 29 04:05 #snmptt-trap-1438160710134797
-rw-r--r--. 1 root root  304 Jul 29 04:05 #snmptt-trap-1438160734099570
-rw-r--r--. 1 root root  188 Jul 29 04:26 #snmptt-trap-1438161965783571
-rw-r--r--. 1 root root  259 Jul 29 04:34 #snmptt-trap-1438162495142482
-rw-r--r--. 1 root root  226 Jul 29 04:40 #snmptt-trap-1438162808937696
-rw-r--r--. 1 root root  253 Jul 29 04:40 #snmptt-trap-1438162826500979
-rw-r--r--. 1 root root  254 Jul 29 04:52 #snmptt-trap-1438163534736343
-rw-r--r--. 1 root root  188 Jul 29 05:26 #snmptt-trap-1438165565205663
-rw-r--r--. 1 root root  226 Jul 29 05:36 #snmptt-trap-1438166214355624
-rw-r--r--. 1 root root  332 Jul 29 05:50 #snmptt-trap-1438167049642479
-rw-r--r--. 1 root root  304 Jul 29 05:51 #snmptt-trap-1438167060134910
-rw-r--r--. 1 root root  253 Jul 29 07:20 #snmptt-trap-1438172436050155
-rw-r--r--. 1 root root  253 Jul 29 07:20 #snmptt-trap-1438172436137967
-rw-r--r--. 1 root root  253 Jul 29 07:24 #snmptt-trap-1438172680857592
-rw-r--r--. 1 root root  253 Jul 29 07:24 #snmptt-trap-1438172681110927
-rw-r--r--. 1 root root  253 Jul 29 07:32 #snmptt-trap-1438173171844232
-rw-r--r--. 1 root root  253 Jul 29 07:32 #snmptt-trap-1438173172088315
-rw-r--r--. 1 root root 1246 Jul 29 08:46 #snmptt-trap-1438177598080723
[root@lisl-ngos-01-pv snmp]# service snmptt status
snmptt (pid  28078) is running...

Re: Change FATAL condition to CRITICAL in trap

Posted: Wed Jul 29, 2015 10:20 am
by snapon_admin
Alright I cleared the spool and here's the trap that is coming up unknown for some reason:

Code: Select all

1438182850
<UNKNOWN>
UDP: [<REDACTED>]:9896->[<REDACTED>]
.1.3.6.1.2.1.1.3.0 16:0:09:11.04
.1.3.6.1.6.3.1.1.4.1.0 .1.3.6.1.4.1.111.15.2
.1.3.6.1.4.1.111.15.3.1.1.2.1 "NOTIF_NORMAL"
.1.3.6.1.4.1.111.15.3.1.1.3.1 "The listener is down: TNS-12541: TNS:no listener ."
.1.3.6.1.4.1.111.15.3.1.1.4.1 "https://lisgrid01p.snapon.com:7799/em/redirect?pageType=sdk-core-event-console-detailEvent&issueID=1AC3FC17982827E0E054020820F4DF2F"
.1.3.6.1.4.1.111.15.3.1.1.5.1 "Fatal"
.1.3.6.1.4.1.111.15.3.1.1.6.1 "FATAL"
.1.3.6.1.4.1.111.15.3.1.1.7.1 "0"
.1.3.6.1.4.1.111.15.3.1.1.8.1 ""
.1.3.6.1.4.1.111.15.3.1.1.9.1 ""
.1.3.6.1.4.1.111.15.3.1.1.10.1 "Jul 29, 2015 10:14:05 AM CDT"
.1.3.6.1.4.1.111.15.3.1.1.11.1 "Availability"
.1.3.6.1.4.1.111.15.3.1.1.12.1 "Availability"
.1.3.6.1.4.1.111.15.3.1.1.13.1 "Target Availability"
.1.3.6.1.4.1.111.15.3.1.1.14.1 "Status"
.1.3.6.1.4.1.111.15.3.1.1.15.1 "282"
.1.3.6.1.4.1.111.15.3.1.1.16.1 ""
.1.3.6.1.4.1.111.15.3.1.1.17.1 "No"
.1.3.6.1.4.1.111.15.3.1.1.18.1 "New"
.1.3.6.1.4.1.111.15.3.1.1.19.1 "None"
.1.3.6.1.4.1.111.15.3.1.1.20.1 "0"
.1.3.6.1.4.1.111.15.3.1.1.21.1 "LISTENER_KDBLAB01_kenrman01t.snapon.com"
.1.3.6.1.4.1.111.15.3.1.1.22.1 "https://lisgrid01p.snapon.com:7799/em/redirect?pageType=TARGET_HOMEPAGE&targetName=LISTENER_KDBLAB01_kenrman01t.snapon.com&targetType=oracle_listener"
.1.3.6.1.4.1.111.15.3.1.1.23.1 "Listener"
.1.3.6.1.4.1.111.15.3.1.1.24.1 "kenrman01t.snapon.com"
.1.3.6.1.4.1.111.15.3.1.1.25.1 "SYSMAN"
.1.3.6.1.4.1.111.15.3.1.1.26.1 ""
.1.3.6.1.4.1.111.15.3.1.1.27.1 "11.2.0.3.0"
.1.3.6.1.4.1.111.15.3.1.1.28.1 "Operating System=SunOS, Platform=sparc"
.1.3.6.1.4.1.111.15.3.1.1.29.1 ""
.1.3.6.1.4.1.111.15.3.1.1.30.1 ""
.1.3.6.1.4.1.111.15.3.1.1.31.1 ""
.1.3.6.1.4.1.111.15.3.1.1.32.1 ""
.1.3.6.1.4.1.111.15.3.1.1.33.1 ""
.1.3.6.1.4.1.111.15.3.1.1.34.1 ""
.1.3.6.1.4.1.111.15.3.1.1.35.1 ""
.1.3.6.1.4.1.111.15.3.1.1.36.1 ""
.1.3.6.1.4.1.111.15.3.1.1.37.1 ""
.1.3.6.1.4.1.111.15.3.1.1.38.1 ""
.1.3.6.1.4.1.111.15.3.1.1.39.1 "Nagios Alerts"
.1.3.6.1.4.1.111.15.3.1.1.40.1 "Nagios Alerts,Nagios Rule 1"
.1.3.6.1.4.1.111.15.3.1.1.41.1 "SYSMAN"
.1.3.6.1.4.1.111.15.3.1.1.42.1 "1AC3FC17982827E0E054020820F4DF2F"
.1.3.6.1.4.1.111.15.3.1.1.43.1 ""
.1.3.6.1.4.1.111.15.3.1.1.44.1 ""
.1.3.6.1.4.1.111.15.3.1.1.45.1 ""
.1.3.6.1.4.1.111.15.3.1.1.46.1 "The listener is down: TNS-12541: TNS:no listener ., Incident created by rule (Name = Snap-on Rule Set for All Targets, Incident creation rule for a Target Down availability status; Owner = SYSMAN)."
.1.3.6.1.4.1.111.15.3.1.1.47.1 ""
.1.3.6.1.4.1.111.15.3.1.1.48.1 ""
.1.3.6.1.4.1.111.15.3.1.1.49.1 ""
.1.3.6.1.4.1.111.15.3.1.1.50.1 ""
.1.3.6.1.4.1.111.15.3.1.1.51.1 "Neither Cause Nor Symptom"
.1.3.6.1.4.1.111.15.3.1.1.61.1 "Availability status=Down"
.1.3.6.1.4.1.111.15.3.1.1.62.1 "Severity GUID=1AC3FC17982427E0E054020820F4DF2F"
.1.3.6.1.4.1.111.15.3.1.1.63.1 "Availability Sub-status=99"
.1.3.6.1.4.1.111.15.3.1.1.64.1 "Transition Severity=25"
.1.3.6.1.4.1.111.15.3.1.1.65.1 "Response metric GUID=1EA69E018E163E3E323609D334EE8E20"
.1.3.6.1.4.1.111.15.3.1.1.66.1 "Severity GUID of the first severity in the availability cycle=1BFBE40CFE180EB1E054020820F4DF2F"
.1.3.6.1.4.1.111.15.3.1.1.67.1 ""
.1.3.6.1.4.1.111.15.3.1.1.68.1 ""
.1.3.6.1.4.1.111.15.3.1.1.69.1 ""
.1.3.6.1.4.1.111.15.3.1.1.70.1 ""
.1.3.6.1.4.1.111.15.3.1.1.71.1 ""
.1.3.6.1.4.1.111.15.3.1.1.72.1 ""
.1.3.6.1.4.1.111.15.3.1.1.73.1 ""
.1.3.6.1.4.1.111.15.3.1.1.74.1 ""
.1.3.6.1.4.1.111.15.3.1.1.75.1 ""
.1.3.6.1.4.1.111.15.3.1.1.76.1 ""
.1.3.6.1.4.1.111.15.3.1.1.77.1 ""
.1.3.6.1.4.1.111.15.3.1.1.78.1 ""
.1.3.6.1.4.1.111.15.3.1.1.79.1 ""
.1.3.6.1.4.1.111.15.3.1.1.80.1 ""
.1.3.6.1.4.1.111.15.3.1.1.81.1 ""
.1.3.6.1.4.1.111.15.3.1.1.82.1 ""
.1.3.6.1.4.1.111.15.3.1.1.83.1 ""
.1.3.6.1.4.1.111.15.3.1.1.84.1 ""
.1.3.6.1.4.1.111.15.3.1.1.85.1 ""
.1.3.6.1.6.3.18.1.3.0 <REDACTED>
Keep in mind this particular trap WAS working before I included the Match statements.

Re: Change FATAL condition to CRITICAL in trap

Posted: Wed Jul 29, 2015 3:42 pm
by snapon_admin
I think I'm onto something here. For the MATCH statement, it looks like if you use a regular expression you need to surround it in parenthesis. So instead of:

Code: Select all

MATCH $4: Fatal
It should be:

Code: Select all

MATCH $4: (Fatal)

Re: Change FATAL condition to CRITICAL in trap

Posted: Wed Jul 29, 2015 4:46 pm
by ssax
This should work for you.

Code: Select all

#
#
#
EVENT oraEM4Traps .1.3.6.1.4.1.111.15.2 "Status Events" Normal
FORMAT The variables included in the oraEM4Traps trap. $*
EXEC /usr/local/bin/snmptraphandling.py "$r" "SNMP Traps" "$s" "$@" "$-*" "$4 Status Event occurred on $23 at $9. $2 $Fn"
MATCH $5: (CLEAR)
MATCH $5: (INFORMATION)
This is a sample Event Message to test the SNMP notification delivery to the SNMP Manager. The contents of this messages are all sample data.
The variables included in the oraEM4Traps trap.
Variables:
  1: oraEMNGEventNotifType
  2: oraEMNGEventMessage
  3: oraEMNGEventMessageURL
  4: oraEMNGEventSeverity
  5: oraEMNGEventSeverityCode
  6: oraEMNGEventRepeatCount
  7: oraEMNGEventActionMsg
  8: oraEMNGEventOccurrenceTime
  9: oraEMNGEventReportedTime
  10: oraEMNGEventCategories
  11: oraEMNGEventCategoryCodes
  12: oraEMNGEventType
  13: oraEMNGEventName
  14: oraEMNGAssocIncidentId
  15: oraEMNGAssocIncidentOwner
  16: oraEMNGAssocIncidentAcked
  17: oraEMNGAssocIncidentStatus
  18: oraEMNGAssocIncidentPriority
  19: oraEMNGAssocIncidentEscLevel
  20: oraEMNGEventTargetName
  21: oraEMNGEventTargetNameURL
  22: oraEMNGEventTargetType
  23: oraEMNGEventHostName
  24: oraEMNGEventTargetOwner
  25: oraEMNGEventTgtLifeCycleStatus
  26: oraEMNGEventTargetVersion
  27: oraEMNGEventUserDefinedTgtProp
  28: oraEMNGEventSourceObjName
  29: oraEMNGEventSourceObjNameURL
  30: oraEMNGEventSourceObjType
  31: oraEMNGEventSourceObjSubType
  32: oraEMNGEventSourceObjOwner
  33: oraEMNGEventCAJobName
  34: oraEMNGEventCAJobStatus
  35: oraEMNGEventCAJobOwner
  36: oraEMNGEventCAJobStepOutput
  37: oraEMNGEventCAJobType
  38: oraEMNGEventRuleSetName
  39: oraEMNGEventRuleName
  40: oraEMNGEventRuleOwner
  41: oraEMNGEventSequenceId
  42: oraEMNGEventRCADetails
  43: oraEMNGEventContextAttrs
  44: oraEMNGEventUserComments
  45: oraEMNGEventTypeAttr1
  46: oraEMNGEventTypeAttr2
  47: oraEMNGEventTypeAttr3
  48: oraEMNGEventTypeAttr4
  49: oraEMNGEventTypeAttr5
  50: oraEMNGEventTypeAttr6
  51: oraEMNGEventTypeAttr7
  52: oraEMNGEventTypeAttr8
  53: oraEMNGEventTypeAttr9
  54: oraEMNGEventTypeAttr10
  55: oraEMNGEventTypeAttr11
  56: oraEMNGEventTypeAttr12
  57: oraEMNGEventTypeAttr13
  58: oraEMNGEventTypeAttr14
  59: oraEMNGEventTypeAttr15
  60: oraEMNGEventTypeAttr16
  61: oraEMNGEventTypeAttr17
  62: oraEMNGEventTypeAttr18
  63: oraEMNGEventTypeAttr19
  64: oraEMNGEventTypeAttr20
  65: oraEMNGEventTypeAttr21
  66: oraEMNGEventTypeAttr22
  67: oraEMNGEventTypeAttr23
  68: oraEMNGEventTypeAttr24
  69: oraEMNGEventTypeAttr25
EDESC
#
#
#
EVENT oraEM4Traps .1.3.6.1.4.1.111.15.2 "Status Events" Warning
FORMAT The variables included in the oraEM4Traps trap. $*
EXEC /usr/local/bin/snmptraphandling.py "$r" "SNMP Traps" "$s" "$@" "$-*" "$4 Status Event occurred on $23 at $9. $2 $Fn"
MATCH $5: (WARNING)
This is a sample Event Message to test the SNMP notification delivery to the SNMP Manager. The contents of this messages are all sample data.
The variables included in the oraEM4Traps trap.
Variables:
  1: oraEMNGEventNotifType
  2: oraEMNGEventMessage
  3: oraEMNGEventMessageURL
  4: oraEMNGEventSeverity
  5: oraEMNGEventSeverityCode
  6: oraEMNGEventRepeatCount
  7: oraEMNGEventActionMsg
  8: oraEMNGEventOccurrenceTime
  9: oraEMNGEventReportedTime
  10: oraEMNGEventCategories
  11: oraEMNGEventCategoryCodes
  12: oraEMNGEventType
  13: oraEMNGEventName
  14: oraEMNGAssocIncidentId
  15: oraEMNGAssocIncidentOwner
  16: oraEMNGAssocIncidentAcked
  17: oraEMNGAssocIncidentStatus
  18: oraEMNGAssocIncidentPriority
  19: oraEMNGAssocIncidentEscLevel
  20: oraEMNGEventTargetName
  21: oraEMNGEventTargetNameURL
  22: oraEMNGEventTargetType
  23: oraEMNGEventHostName
  24: oraEMNGEventTargetOwner
  25: oraEMNGEventTgtLifeCycleStatus
  26: oraEMNGEventTargetVersion
  27: oraEMNGEventUserDefinedTgtProp
  28: oraEMNGEventSourceObjName
  29: oraEMNGEventSourceObjNameURL
  30: oraEMNGEventSourceObjType
  31: oraEMNGEventSourceObjSubType
  32: oraEMNGEventSourceObjOwner
  33: oraEMNGEventCAJobName
  34: oraEMNGEventCAJobStatus
  35: oraEMNGEventCAJobOwner
  36: oraEMNGEventCAJobStepOutput
  37: oraEMNGEventCAJobType
  38: oraEMNGEventRuleSetName
  39: oraEMNGEventRuleName
  40: oraEMNGEventRuleOwner
  41: oraEMNGEventSequenceId
  42: oraEMNGEventRCADetails
  43: oraEMNGEventContextAttrs
  44: oraEMNGEventUserComments
  45: oraEMNGEventTypeAttr1
  46: oraEMNGEventTypeAttr2
  47: oraEMNGEventTypeAttr3
  48: oraEMNGEventTypeAttr4
  49: oraEMNGEventTypeAttr5
  50: oraEMNGEventTypeAttr6
  51: oraEMNGEventTypeAttr7
  52: oraEMNGEventTypeAttr8
  53: oraEMNGEventTypeAttr9
  54: oraEMNGEventTypeAttr10
  55: oraEMNGEventTypeAttr11
  56: oraEMNGEventTypeAttr12
  57: oraEMNGEventTypeAttr13
  58: oraEMNGEventTypeAttr14
  59: oraEMNGEventTypeAttr15
  60: oraEMNGEventTypeAttr16
  61: oraEMNGEventTypeAttr17
  62: oraEMNGEventTypeAttr18
  63: oraEMNGEventTypeAttr19
  64: oraEMNGEventTypeAttr20
  65: oraEMNGEventTypeAttr21
  66: oraEMNGEventTypeAttr22
  67: oraEMNGEventTypeAttr23
  68: oraEMNGEventTypeAttr24
  69: oraEMNGEventTypeAttr25
EDESC
#
#
#
EVENT oraEM4Traps .1.3.6.1.4.1.111.15.2 "Status Events" Critical
FORMAT The variables included in the oraEM4Traps trap. $*
EXEC /usr/local/bin/snmptraphandling.py "$r" "SNMP Traps" "$s" "$@" "$-*" "$4 Status Event occurred on $23 at $9. $2 $Fn"
MATCH $5: (FATAL)
MATCH $5: (CRITICAL)
This is a sample Event Message to test the SNMP notification delivery to the SNMP Manager. The contents of this messages are all sample data.
The variables included in the oraEM4Traps trap.
Variables:
  1: oraEMNGEventNotifType
  2: oraEMNGEventMessage
  3: oraEMNGEventMessageURL
  4: oraEMNGEventSeverity
  5: oraEMNGEventSeverityCode
  6: oraEMNGEventRepeatCount
  7: oraEMNGEventActionMsg
  8: oraEMNGEventOccurrenceTime
  9: oraEMNGEventReportedTime
  10: oraEMNGEventCategories
  11: oraEMNGEventCategoryCodes
  12: oraEMNGEventType
  13: oraEMNGEventName
  14: oraEMNGAssocIncidentId
  15: oraEMNGAssocIncidentOwner
  16: oraEMNGAssocIncidentAcked
  17: oraEMNGAssocIncidentStatus
  18: oraEMNGAssocIncidentPriority
  19: oraEMNGAssocIncidentEscLevel
  20: oraEMNGEventTargetName
  21: oraEMNGEventTargetNameURL
  22: oraEMNGEventTargetType
  23: oraEMNGEventHostName
  24: oraEMNGEventTargetOwner
  25: oraEMNGEventTgtLifeCycleStatus
  26: oraEMNGEventTargetVersion
  27: oraEMNGEventUserDefinedTgtProp
  28: oraEMNGEventSourceObjName
  29: oraEMNGEventSourceObjNameURL
  30: oraEMNGEventSourceObjType
  31: oraEMNGEventSourceObjSubType
  32: oraEMNGEventSourceObjOwner
  33: oraEMNGEventCAJobName
  34: oraEMNGEventCAJobStatus
  35: oraEMNGEventCAJobOwner
  36: oraEMNGEventCAJobStepOutput
  37: oraEMNGEventCAJobType
  38: oraEMNGEventRuleSetName
  39: oraEMNGEventRuleName
  40: oraEMNGEventRuleOwner
  41: oraEMNGEventSequenceId
  42: oraEMNGEventRCADetails
  43: oraEMNGEventContextAttrs
  44: oraEMNGEventUserComments
  45: oraEMNGEventTypeAttr1
  46: oraEMNGEventTypeAttr2
  47: oraEMNGEventTypeAttr3
  48: oraEMNGEventTypeAttr4
  49: oraEMNGEventTypeAttr5
  50: oraEMNGEventTypeAttr6
  51: oraEMNGEventTypeAttr7
  52: oraEMNGEventTypeAttr8
  53: oraEMNGEventTypeAttr9
  54: oraEMNGEventTypeAttr10
  55: oraEMNGEventTypeAttr11
  56: oraEMNGEventTypeAttr12
  57: oraEMNGEventTypeAttr13
  58: oraEMNGEventTypeAttr14
  59: oraEMNGEventTypeAttr15
  60: oraEMNGEventTypeAttr16
  61: oraEMNGEventTypeAttr17
  62: oraEMNGEventTypeAttr18
  63: oraEMNGEventTypeAttr19
  64: oraEMNGEventTypeAttr20
  65: oraEMNGEventTypeAttr21
  66: oraEMNGEventTypeAttr22
  67: oraEMNGEventTypeAttr23
  68: oraEMNGEventTypeAttr24
  69: oraEMNGEventTypeAttr25
EDESC

Re: Change FATAL condition to CRITICAL in trap

Posted: Thu Jul 30, 2015 11:32 am
by snapon_admin
Yep, already did that and tested it. Just wanted to post it here in case anyone else needs the info and stumbles upon this thread in the future. Safe to lock this one up, if something else comes up I'll open another thread and bug you in that one. Thanks for all the tips guys!

Re: Change FATAL condition to CRITICAL in trap

Posted: Thu Jul 30, 2015 1:23 pm
by ssax
:) I didn't see your post until I was already done figuring it out so I posted it anyways. Marking as resolved and locking.
All times are UTC-05:00
Page 2 of 2

Powered by phpBB® Forum Software © phpBB Limited