Jump to content

dead but subsys locked


sly

Recommended Posts

I have CentOS VPS server. I decided to update pcmitor agent by installing it on top of existing , fully functional installation.

[root@ ~]# wget http://www.pulseway.com/download/pcmonitor_x64.rpm
[root@ ~]# rpm -ihv pcmonitor_x64.rpm
[root@ ~]#
/etc/init.d/pcmonitor start

Service wont start and i get this instead when i do status:  pcmonitord dead but subsys locked

here is what i got from /var/logs/messages

Dec 28 19:36:12 control pcmonitor: Got exception signal: 11
Dec 28 19:36:12 control kernel: pcmonitord[3144]: segfault at 0 ip 0000003b62e80eb0 sp 00007ff6c39ccf38 error 4 in libc-2.12.so[3b62e00000+18b000]
Dec 28 19:36:12 control abrtd: Directory 'ccpp-2013-12-28-19:36:12-3133' creation detected
Dec 28 19:36:12 control abrt[3145]: Saved core dump of pid 3133 (/usr/sbin/pcmonitord) to /var/spool/abrt/ccpp-2013-12-28-19:36:12-3133 (11710464 bytes)
Dec 28 19:36:12 control abrtd: Package 'pcmonitor' isn't signed with proper key

 

I cant figure it out how to fix it.

I completely removed pcmonitor by doing :  rpm -e pcmonitor-1.1.0-1.x86_64

Also did this:  rm -f -R /var/lock/subsys/pcmonitord

After that i rebooted my server completely and installed pc monitor again and still im getting : pcmonitord dead but subsys locked

Please help, i dont know what to do at this point.

 

Link to comment
Share on other sites

Hi,

Can you, please send core dump file /var/spool/abrt/ccpp-2013-12-28-19:36:12-3133 to support@pulseway.com.

Thanks!

Mark

 

Cant because its deleting it on its own after creating it:

 

Dec 29 11:14:55 control pcmonitor: Got exception signal: 11

Dec 29 11:14:55 control kernel: pcmonitord[29437]: segfault at 0 ip 0000003b62e80eb0 sp 00007f14490f3f38 error 4 in libc-2.12.so[3b62e00000+18b000]

Dec 29 11:14:55 control abrtd: Directory 'ccpp-2013-12-29-11:14:55-29426' creation detected

Dec 29 11:14:55 control abrt[29438]: Saved core dump of pid 29426 (/usr/sbin/pcmonitord) to /var/spool/abrt/ccpp-2013-12-29-11:14:55-29426 (11714560 bytes)

Dec 29 11:14:55 control abrtd: Package 'pcmonitor' isn't signed with proper key

Dec 29 11:14:55 control abrtd: 'post-create' on '/var/spool/abrt/ccpp-2013-12-29-11:14:55-29426' exited with 1

Dec 29 11:14:55 control abrtd: Deleting problem directory '/var/spool/abrt/ccpp-2013-12-29-11:14:55-29426'

 

Above log is from this morning after i installed it yet again. It was fully uninstaled before reinstalling.  I emailed you above log also

Link to comment
Share on other sites

  • Staff

Hi,

 

Can you post the result of the command uname -a.

 

Also, please make sure that uname -c is set to unlimited , and send us the core file created in /var/pcmonitor. If that still doesn't work stop the abrtd daemon and try again

Link to comment
Share on other sites

  • Staff

Hi,

This is not a 'package sign' issue. It's a genuine crash on your system. But to investigate we need more details, like coredump file created after crash.

Sign error must be because your have OpenGPGCheck = yes on /etc/abrt/abrt.conf. Try to set this to OpenGPGCheck = no and restart abrt service.

What's the version of CentOS? What hypervisor are you using?

Regards,

Mark

Link to comment
Share on other sites

Hi,

 

Can you post the result of the command uname -a.

 

Also, please make sure that uname -c is set to unlimited , and send us the core file created in /var/pcmonitor. If that still doesn't work stop the abrtd daemon and try again

 

uname -a

2.6.32-431.el6.x86_64 #1 SMP Fri Nov 22 03:15:09 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux

 

Link to comment
Share on other sites

I stopped abrt but still getting pcmonitord dead but subsys locked message when i try to start it.   i'm not getting signature error when abrt is not running, im only getting this:

Dec 30 17:17:33 control pcmonitor: Got exception signal: 11
Dec 30 17:17:33 control kernel: pcmonitord[19384]: segfault at 0 ip 0000003b62e80eb0 sp 00007f6352252f38 error 4 in libc-2.12.so[3b62e00000+18b000]
 

 

I dont know what unname -c is set to unlimited means or how to give you core files.  Please advise. I'm not Linux expert but i can follow directions well.

 
Link to comment
Share on other sites

  • 1 month later...

my server hasnt been restarted since you guys fixed it, yesterday it stopped again and when i try to restart again im getting dead but subsys locked message.

i havent touched my server since you fixed this issue.

Link to comment
Share on other sites

here is ABRT full crash report:

 

 

abrt_version:   2.0.8

cgroup:        

cmdline:        /usr/sbin/pcmonitord

executable:     /usr/sbin/pcmonitord

kernel:         2.6.32-431.el6.x86_64

last_occurrence: 1391911682

pid:            7422

pwd:            /var/pcmonitor

time:           Sat 08 Feb 2014 09:08:02 PM EST

uid:            0

username:       root

 

sosreport.tar.xz: Binary file, 3147316 bytes

 

environ:

:HOSTNAME=XXXX

:SELINUX_ROLE_REQUESTED=

:TERM=xterm

:SHELL=/bin/bash

:HISTSIZE=1000

:'SSH_CLIENT=XXXX

:SELINUX_USE_CURRENT_RANGE=

:SSH_TTY=/dev/pts/0

:USER=root

:LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lz=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.axa=00;36:*.oga=00;36:*.spx=00;36:*.xspf=00;36:

:MAIL=/var/spool/mail/root

:PATH=/sbin:/usr/sbin:/bin:/usr/bin

:PWD=/root

:JAVA_HOME=/usr/local/jdk

:EDITOR=pico

:LANG=en_US.UTF-8

:SELINUX_LEVEL_REQUESTED=

:HISTCONTROL=ignoredups

:SHLVL=3

:HOME=/root

:'LS_OPTIONS=--color=tty -F -a -b -T 0'

:LOGNAME=root

:VISUAL=pico

:CVS_RSH=ssh

:CLASSPATH=.:/usr/local/jdk/lib/classes.zip

:'SSH_CONNECTION=XXXX

:'LESSOPEN=|/usr/bin/lesspipe.sh %s'

:G_BROKEN_FILENAMES=1

:_=/usr/sbin/pcmonitord

 

limits:

:Limit                     Soft Limit           Hard Limit           Units    

:Max cpu time              unlimited            unlimited            seconds  

:Max file size             unlimited            unlimited            bytes    

:Max data size             unlimited            unlimited            bytes    

:Max stack size            8388608              8388608              bytes    

:Max core file size        0                    1024000000           bytes    

:Max resident set          unlimited            unlimited            bytes    

:Max processes             14335                14335                processes

:Max open files            4096                 4096                 files    

:Max locked memory         65536                65536                bytes    

:Max address space         unlimited            unlimited            bytes    

:Max file locks            unlimited            unlimited            locks    

:Max pending signals       30485                30485                signals  

:Max msgqueue size         819200               819200               bytes    

:Max nice priority         0                    0                    

:Max realtime priority     0                    0                   

:Max realtime timeout      unlimited            unlimited            us       

 

maps:

:00400000-0058d000 r-xp 00000000 fc:05 525654                             /usr/sbin/pcmonitord

:0078c000-00790000 rw-p 0018c000 fc:05 525654                             /usr/sbin/pcmonitord

:0098f000-00995000 rw-p 0018f000 fc:05 525654                             /usr/sbin/pcmonitord

:01628000-01649000 rw-p 00000000 00:00 0

:01649000-01772000 rw-p 00000000 00:00 0

:3975000000-39751b5000 r-xp 00000000 fc:05 537300                         /usr/lib64/libcrypto.so.1.0.1e

:39751b5000-39753b5000 ---p 001b5000 fc:05 537300                         /usr/lib64/libcrypto.so.1.0.1e

:39753b5000-39753d0000 r--p 001b5000 fc:05 537300                         /usr/lib64/libcrypto.so.1.0.1e

:39753d0000-39753dc000 rw-p 001d0000 fc:05 537300                         /usr/lib64/libcrypto.so.1.0.1e

:39753dc000-39753e0000 rw-p 00000000 00:00 0

:3975400000-3975461000 r-xp 00000000 fc:05 528413                         /usr/lib64/libssl.so.1.0.1e

:3975461000-3975660000 ---p 00061000 fc:05 528413                         /usr/lib64/libssl.so.1.0.1e

:3975660000-3975664000 r--p 00060000 fc:05 528413                         /usr/lib64/libssl.so.1.0.1e

:3975664000-397566b000 rw-p 00064000 fc:05 528413                         /usr/lib64/libssl.so.1.0.1e

:3b62600000-3b62620000 r-xp 00000000 fc:05 1703959                        /lib64/ld-2.12.so

:3b6281f000-3b62820000 r--p 0001f000 fc:05 1703959                        /lib64/ld-2.12.so

:3b62820000-3b62821000 rw-p 00020000 fc:05 1703959                        /lib64/ld-2.12.so

:3b62821000-3b62822000 rw-p 00000000 00:00 0

:3b62a00000-3b62a15000 r-xp 00000000 fc:05 1704006                        /lib64/libz.so.1.2.3

:3b62a15000-3b62c14000 ---p 00015000 fc:05 1704006                        /lib64/libz.so.1.2.3

:3b62c14000-3b62c15000 r--p 00014000 fc:05 1704006                        /lib64/libz.so.1.2.3

:3b62c15000-3b62c16000 rw-p 00015000 fc:05 1704006                        /lib64/libz.so.1.2.3

:3b62e00000-3b62f8b000 r-xp 00000000 fc:05 1703973                        /lib64/libc-2.12.so

:3b62f8b000-3b6318a000 ---p 0018b000 fc:05 1703973                        /lib64/libc-2.12.so

:3b6318a000-3b6318e000 r--p 0018a000 fc:05 1703973                        /lib64/libc-2.12.so

:3b6318e000-3b6318f000 rw-p 0018e000 fc:05 1703973                        /lib64/libc-2.12.so

:3b6318f000-3b63194000 rw-p 00000000 00:00 0

:3b63200000-3b63217000 r-xp 00000000 fc:05 1703975                        /lib64/libpthread-2.12.so

:3b63217000-3b63417000 ---p 00017000 fc:05 1703975                        /lib64/libpthread-2.12.so

:3b63417000-3b63418000 r--p 00017000 fc:05 1703975                        /lib64/libpthread-2.12.so

:3b63418000-3b63419000 rw-p 00018000 fc:05 1703975                        /lib64/libpthread-2.12.so

:3b63419000-3b6341d000 rw-p 00000000 00:00 0

:3b63600000-3b63602000 r-xp 00000000 fc:05 1703977                        /lib64/libdl-2.12.so

:3b63602000-3b63802000 ---p 00002000 fc:05 1703977                        /lib64/libdl-2.12.so

:3b63802000-3b63803000 r--p 00002000 fc:05 1703977                        /lib64/libdl-2.12.so

:3b63803000-3b63804000 rw-p 00003000 fc:05 1703977                        /lib64/libdl-2.12.so

:3b63a00000-3b63a83000 r-xp 00000000 fc:05 1703981                        /lib64/libm-2.12.so

:3b63a83000-3b63c82000 ---p 00083000 fc:05 1703981                        /lib64/libm-2.12.so

:3b63c82000-3b63c83000 r--p 00082000 fc:05 1703981                        /lib64/libm-2.12.so

:3b63c83000-3b63c84000 rw-p 00083000 fc:05 1703981                        /lib64/libm-2.12.so

:3b63e00000-3b63e07000 r-xp 00000000 fc:05 1703994                        /lib64/librt-2.12.so

:3b63e07000-3b64006000 ---p 00007000 fc:05 1703994                        /lib64/librt-2.12.so

:3b64006000-3b64007000 r--p 00006000 fc:05 1703994                        /lib64/librt-2.12.so

:3b64007000-3b64008000 rw-p 00007000 fc:05 1703994                        /lib64/librt-2.12.so

:3b64600000-3b6461d000 r-xp 00000000 fc:05 1704068                        /lib64/libselinux.so.1

:3b6461d000-3b6481c000 ---p 0001d000 fc:05 1704068                        /lib64/libselinux.so.1

:3b6481c000-3b6481d000 r--p 0001c000 fc:05 1704068                        /lib64/libselinux.so.1

:3b6481d000-3b6481e000 rw-p 0001d000 fc:05 1704068                        /lib64/libselinux.so.1

:3b6481e000-3b6481f000 rw-p 00000000 00:00 0

:3b64a00000-3b64a16000 r-xp 00000000 fc:05 1704067                        /lib64/libresolv-2.12.so

:3b64a16000-3b64c16000 ---p 00016000 fc:05 1704067                        /lib64/libresolv-2.12.so

:3b64c16000-3b64c17000 r--p 00016000 fc:05 1704067                        /lib64/libresolv-2.12.so

:3b64c17000-3b64c18000 rw-p 00017000 fc:05 1704067                        /lib64/libresolv-2.12.so

:3b64c18000-3b64c1a000 rw-p 00000000 00:00 0

:3b65a00000-3b65a16000 r-xp 00000000 fc:05 1703986                        /lib64/libgcc_s-4.4.7-20120601.so.1

:3b65a16000-3b65c15000 ---p 00016000 fc:05 1703986                        /lib64/libgcc_s-4.4.7-20120601.so.1

:3b65c15000-3b65c16000 rw-p 00015000 fc:05 1703986                        /lib64/libgcc_s-4.4.7-20120601.so.1

:3b66200000-3b66203000 r-xp 00000000 fc:05 1704865                        /lib64/libcom_err.so.2.1

:3b66203000-3b66402000 ---p 00003000 fc:05 1704865                        /lib64/libcom_err.so.2.1

:3b66402000-3b66403000 r--p 00002000 fc:05 1704865                        /lib64/libcom_err.so.2.1

:3b66403000-3b66404000 rw-p 00003000 fc:05 1704865                        /lib64/libcom_err.so.2.1

:3b66e00000-3b66e41000 r-xp 00000000 fc:05 1710249                        /lib64/libgssapi_krb5.so.2.2

:3b66e41000-3b67041000 ---p 00041000 fc:05 1710249                        /lib64/libgssapi_krb5.so.2.2

:3b67041000-3b67042000 r--p 00041000 fc:05 1710249                        /lib64/libgssapi_krb5.so.2.2

:3b67042000-3b67044000 rw-p 00042000 fc:05 1710249                        /lib64/libgssapi_krb5.so.2.2

:3b67a00000-3b67a0a000 r-xp 00000000 fc:05 1704383                        /lib64/libkrb5support.so.0.1

:3b67a0a000-3b67c09000 ---p 0000a000 fc:05 1704383                        /lib64/libkrb5support.so.0.1

:3b67c09000-3b67c0a000 r--p 00009000 fc:05 1704383                        /lib64/libkrb5support.so.0.1

:3b67c0a000-3b67c0b000 rw-p 0000a000 fc:05 1704383                        /lib64/libkrb5support.so.0.1

:3b67e00000-3b67e29000 r-xp 00000000 fc:05 1704857                        /lib64/libk5crypto.so.3.1

:3b67e29000-3b68029000 ---p 00029000 fc:05 1704857                        /lib64/libk5crypto.so.3.1

:3b68029000-3b6802a000 r--p 00029000 fc:05 1704857                        /lib64/libk5crypto.so.3.1

:3b6802a000-3b6802b000 rw-p 0002a000 fc:05 1704857                        /lib64/libk5crypto.so.3.1

:3b6802b000-3b6802c000 rw-p 00000000 00:00 0

:3b68200000-3b68202000 r-xp 00000000 fc:05 1704154                        /lib64/libkeyutils.so.1.3

:3b68202000-3b68401000 ---p 00002000 fc:05 1704154                        /lib64/libkeyutils.so.1.3

:3b68401000-3b68402000 r--p 00001000 fc:05 1704154                        /lib64/libkeyutils.so.1.3

:3b68402000-3b68403000 rw-p 00002000 fc:05 1704154                        /lib64/libkeyutils.so.1.3

:3b68e00000-3b68edb000 r-xp 00000000 fc:05 1710220                        /lib64/libkrb5.so.3.3

:3b68edb000-3b690da000 ---p 000db000 fc:05 1710220                        /lib64/libkrb5.so.3.3

:3b690da000-3b690e4000 r--p 000da000 fc:05 1710220                        /lib64/libkrb5.so.3.3

:3b690e4000-3b690e6000 rw-p 000e4000 fc:05 1710220                        /lib64/libkrb5.so.3.3

:3b69200000-3b692e8000 r-xp 00000000 fc:05 550642                         /usr/lib64/libstdc++.so.6.0.13

:3b692e8000-3b694e8000 ---p 000e8000 fc:05 550642                         /usr/lib64/libstdc++.so.6.0.13

:3b694e8000-3b694ef000 r--p 000e8000 fc:05 550642                         /usr/lib64/libstdc++.so.6.0.13

:3b694ef000-3b694f1000 rw-p 000ef000 fc:05 550642                         /usr/lib64/libstdc++.so.6.0.13

:3b694f1000-3b69506000 rw-p 00000000 00:00 0

:7fb2dc000000-7fb2dc021000 rw-p 00000000 00:00 0

:7fb2dc021000-7fb2e0000000 ---p 00000000 00:00 0

:7fb2e4000000-7fb2e4021000 rw-p 00000000 00:00 0

:7fb2e4021000-7fb2e8000000 ---p 00000000 00:00 0

:7fb2e8000000-7fb2e812a000 rw-p 00000000 00:00 0

:7fb2e812a000-7fb2ec000000 ---p 00000000 00:00 0

:7fb2ec000000-7fb2ec14b000 rw-p 00000000 00:00 0

:7fb2ec14b000-7fb2f0000000 ---p 00000000 00:00 0

:7fb2f186d000-7fb2f186e000 ---p 00000000 00:00 0

:7fb2f186e000-7fb2f206e000 rw-p 00000000 00:00 0

:7fb2f206e000-7fb2f206f000 ---p 00000000 00:00 0

:7fb2f206f000-7fb2f286f000 rw-p 00000000 00:00 0

:7fb2f286f000-7fb2f2870000 ---p 00000000 00:00 0

:7fb2f2870000-7fb2f3070000 rw-p 00000000 00:00 0

:7fb2f3070000-7fb2f3075000 r-xp 00000000 fc:05 1703963                    /lib64/libnss_dns-2.12.so

:7fb2f3075000-7fb2f3274000 ---p 00005000 fc:05 1703963                    /lib64/libnss_dns-2.12.so

:7fb2f3274000-7fb2f3275000 r--p 00004000 fc:05 1703963                    /lib64/libnss_dns-2.12.so

:7fb2f3275000-7fb2f3276000 rw-p 00005000 fc:05 1703963                    /lib64/libnss_dns-2.12.so

:7fb2f3276000-7fb2f3282000 r-xp 00000000 fc:05 1703965                    /lib64/libnss_files-2.12.so

:7fb2f3282000-7fb2f3482000 ---p 0000c000 fc:05 1703965                    /lib64/libnss_files-2.12.so

:7fb2f3482000-7fb2f3483000 r--p 0000c000 fc:05 1703965                    /lib64/libnss_files-2.12.so

:7fb2f3483000-7fb2f3484000 rw-p 0000d000 fc:05 1703965                    /lib64/libnss_files-2.12.so

:7fb2f34ac000-7fb2f34ad000 ---p 00000000 00:00 0

:7fb2f34ad000-7fb2f3cad000 rw-p 00000000 00:00 0

:7fb2f3cad000-7fb2f3cb7000 rw-p 00000000 00:00 0

:7fb2f3cc2000-7fb2f3cc3000 rw-p 00000000 00:00 0

:7fffffe5c000-7fffffe71000 rw-p 00000000 00:00 0                          [stack]

:7fffffeca000-7fffffecb000 r-xp 00000000 00:00 0                          [vdso]

:ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]

 

open_fds:

:0:/var/pcmonitor/pcmonitor.id

:pos:      0

:flags:    0100000

Link to comment
Share on other sites

  • Staff

i tried installing new one but it says its already installed.  do i have to uninstall old one first? if so, what command?

 

You can remove existing one: rpm -e pcmonitor and install new one: rpm -ihv pcmonitor_x64.rpm

or you can force reinstall: rpm -ihv pcmonitor_x64.rpm --force

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...