dead but subsys locked

sly · December 29, 2013

I have CentOS VPS server. I decided to update pcmitor agent by installing it on top of existing , fully functional installation.

[root@ ~]# wget http://www.pulseway.com/download/pcmonitor_x64.rpm
[root@ ~]# rpm -ihv pcmonitor_x64.rpm
[root@ ~]# /etc/init.d/pcmonitor start

Service wont start and i get this instead when i do status: pcmonitord dead but subsys locked

here is what i got from /var/logs/messages

Dec 28 19:36:12 control pcmonitor: Got exception signal: 11
Dec 28 19:36:12 control kernel: pcmonitord[3144]: segfault at 0 ip 0000003b62e80eb0 sp 00007ff6c39ccf38 error 4 in libc-2.12.so[3b62e00000+18b000]
Dec 28 19:36:12 control abrtd: Directory 'ccpp-2013-12-28-19:36:12-3133' creation detected
Dec 28 19:36:12 control abrt[3145]: Saved core dump of pid 3133 (/usr/sbin/pcmonitord) to /var/spool/abrt/ccpp-2013-12-28-19:36:12-3133 (11710464 bytes)
Dec 28 19:36:12 control abrtd: Package 'pcmonitor' isn't signed with proper key

I cant figure it out how to fix it.

I completely removed pcmonitor by doing : rpm -e pcmonitor-1.1.0-1.x86_64

Also did this: rm -f -R /var/lock/subsys/pcmonitord

After that i rebooted my server completely and installed pc monitor again and still im getting : pcmonitord dead but subsys locked

Please help, i dont know what to do at this point.

Mark · December 29, 2013

Hi,

Can you, please send core dump file /var/spool/abrt/ccpp-2013-12-28-19:36:12-3133 to support@pulseway.com.

Thanks!

Mark

sly · December 29, 2013

Hi,
Can you, please send core dump file /var/spool/abrt/ccpp-2013-12-28-19:36:12-3133 to support@pulseway.com.
Thanks!
Mark

Cant because its deleting it on its own after creating it:

Dec 29 11:14:55 control pcmonitor: Got exception signal: 11

Dec 29 11:14:55 control kernel: pcmonitord[29437]: segfault at 0 ip 0000003b62e80eb0 sp 00007f14490f3f38 error 4 in libc-2.12.so[3b62e00000+18b000]

Dec 29 11:14:55 control abrtd: Directory 'ccpp-2013-12-29-11:14:55-29426' creation detected

Dec 29 11:14:55 control abrt[29438]: Saved core dump of pid 29426 (/usr/sbin/pcmonitord) to /var/spool/abrt/ccpp-2013-12-29-11:14:55-29426 (11714560 bytes)

Dec 29 11:14:55 control abrtd: Package 'pcmonitor' isn't signed with proper key

Dec 29 11:14:55 control abrtd: 'post-create' on '/var/spool/abrt/ccpp-2013-12-29-11:14:55-29426' exited with 1

Dec 29 11:14:55 control abrtd: Deleting problem directory '/var/spool/abrt/ccpp-2013-12-29-11:14:55-29426'

Above log is from this morning after i installed it yet again. It was fully uninstaled before reinstalling. I emailed you above log also

Calin · December 30, 2013

Hi,

Can you post the result of the command uname -a.

Also, please make sure that uname -c is set to unlimited , and send us the core file created in /var/pcmonitor. If that still doesn't work stop the abrtd daemon and try again

Mark · December 30, 2013

Hi,

This is not a 'package sign' issue. It's a genuine crash on your system. But to investigate we need more details, like coredump file created after crash.

Sign error must be because your have OpenGPGCheck = yes on /etc/abrt/abrt.conf. Try to set this to OpenGPGCheck = no and restart abrt service.

What's the version of CentOS? What hypervisor are you using?

Regards,

Mark

sly · December 30, 2013

Hi,

Can you post the result of the command uname -a.

Also, please make sure that uname -c is set to unlimited , and send us the core file created in /var/pcmonitor. If that still doesn't work stop the abrtd daemon and try again

uname -a

2.6.32-431.el6.x86_64 #1 SMP Fri Nov 22 03:15:09 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux

sly · December 30, 2013

I stopped abrt but still getting pcmonitord dead but subsys locked message when i try to start it. i'm not getting signature error when abrt is not running, im only getting this:

Dec 30 17:17:33 control pcmonitor: Got exception signal: 11
Dec 30 17:17:33 control kernel: pcmonitord[19384]: segfault at 0 ip 0000003b62e80eb0 sp 00007f6352252f38 error 4 in libc-2.12.so[3b62e00000+18b000]

I dont know what unname -c is set to unlimited means or how to give you core files. Please advise. I'm not Linux expert but i can follow directions well.

sly · December 31, 2013

I have to say support is excellent here. I'll be life customer as long as product stays affordable like it is now.

sly · February 7, 2014

my server hasnt been restarted since you guys fixed it, yesterday it stopped again and when i try to restart again im getting dead but subsys locked message.

i havent touched my server since you fixed this issue.

Mark · February 8, 2014

Hi,

Please get the latest version from website.

Regards,

Marl

sly · February 9, 2014

Hi,

Please get the latest version from website.

Regards,

Marl

i tried installing new one but it says its already installed. do i have to uninstall old one first? if so, what command?

sly · February 9, 2014

here is ABRT full crash report:

abrt_version: 2.0.8

cgroup:

cmdline: /usr/sbin/pcmonitord

executable: /usr/sbin/pcmonitord

kernel: 2.6.32-431.el6.x86_64

last_occurrence: 1391911682

pid: 7422

pwd: /var/pcmonitor

time: Sat 08 Feb 2014 09:08:02 PM EST

uid: 0

username: root

sosreport.tar.xz: Binary file, 3147316 bytes

environ:

:HOSTNAME=XXXX

:SELINUX_ROLE_REQUESTED=

:TERM=xterm

:SHELL=/bin/bash

:HISTSIZE=1000

:'SSH_CLIENT=XXXX

:SELINUX_USE_CURRENT_RANGE=

:SSH_TTY=/dev/pts/0

:USER=root

:LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lz=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.axa=00;36:*.oga=00;36:*.spx=00;36:*.xspf=00;36:

:MAIL=/var/spool/mail/root

:PATH=/sbin:/usr/sbin:/bin:/usr/bin

:PWD=/root

:JAVA_HOME=/usr/local/jdk

:EDITOR=pico

:LANG=en_US.UTF-8

:SELINUX_LEVEL_REQUESTED=

:HISTCONTROL=ignoredups

:SHLVL=3

:HOME=/root

:'LS_OPTIONS=--color=tty -F -a -b -T 0'

:LOGNAME=root

:VISUAL=pico

:CVS_RSH=ssh

:CLASSPATH=.:/usr/local/jdk/lib/classes.zip

:'SSH_CONNECTION=XXXX

:'LESSOPEN=|/usr/bin/lesspipe.sh %s'

:G_BROKEN_FILENAMES=1

:_=/usr/sbin/pcmonitord

limits:

:Limit Soft Limit Hard Limit Units

:Max cpu time unlimited unlimited seconds

:Max file size unlimited unlimited bytes

:Max data size unlimited unlimited bytes

:Max stack size 8388608 8388608 bytes

:Max core file size 0 1024000000 bytes

:Max resident set unlimited unlimited bytes

:Max processes 14335 14335 processes

:Max open files 4096 4096 files

:Max locked memory 65536 65536 bytes

:Max address space unlimited unlimited bytes

:Max file locks unlimited unlimited locks

:Max pending signals 30485 30485 signals

:Max msgqueue size 819200 819200 bytes

:Max nice priority 0 0

:Max realtime priority 0 0

:Max realtime timeout unlimited unlimited us

maps:

:00400000-0058d000 r-xp 00000000 fc:05 525654 /usr/sbin/pcmonitord

:0078c000-00790000 rw-p 0018c000 fc:05 525654 /usr/sbin/pcmonitord

:0098f000-00995000 rw-p 0018f000 fc:05 525654 /usr/sbin/pcmonitord

:01628000-01649000 rw-p 00000000 00:00 0

:01649000-01772000 rw-p 00000000 00:00 0

:3975000000-39751b5000 r-xp 00000000 fc:05 537300 /usr/lib64/libcrypto.so.1.0.1e

:39751b5000-39753b5000 ---p 001b5000 fc:05 537300 /usr/lib64/libcrypto.so.1.0.1e

:39753b5000-39753d0000 r--p 001b5000 fc:05 537300 /usr/lib64/libcrypto.so.1.0.1e

:39753d0000-39753dc000 rw-p 001d0000 fc:05 537300 /usr/lib64/libcrypto.so.1.0.1e

:39753dc000-39753e0000 rw-p 00000000 00:00 0

:3975400000-3975461000 r-xp 00000000 fc:05 528413 /usr/lib64/libssl.so.1.0.1e

:3975461000-3975660000 ---p 00061000 fc:05 528413 /usr/lib64/libssl.so.1.0.1e

:3975660000-3975664000 r--p 00060000 fc:05 528413 /usr/lib64/libssl.so.1.0.1e

:3975664000-397566b000 rw-p 00064000 fc:05 528413 /usr/lib64/libssl.so.1.0.1e

:3b62600000-3b62620000 r-xp 00000000 fc:05 1703959 /lib64/ld-2.12.so

:3b6281f000-3b62820000 r--p 0001f000 fc:05 1703959 /lib64/ld-2.12.so

:3b62820000-3b62821000 rw-p 00020000 fc:05 1703959 /lib64/ld-2.12.so

:3b62821000-3b62822000 rw-p 00000000 00:00 0

:3b62a00000-3b62a15000 r-xp 00000000 fc:05 1704006 /lib64/libz.so.1.2.3

:3b62a15000-3b62c14000 ---p 00015000 fc:05 1704006 /lib64/libz.so.1.2.3

:3b62c14000-3b62c15000 r--p 00014000 fc:05 1704006 /lib64/libz.so.1.2.3

:3b62c15000-3b62c16000 rw-p 00015000 fc:05 1704006 /lib64/libz.so.1.2.3

:3b62e00000-3b62f8b000 r-xp 00000000 fc:05 1703973 /lib64/libc-2.12.so

:3b62f8b000-3b6318a000 ---p 0018b000 fc:05 1703973 /lib64/libc-2.12.so

:3b6318a000-3b6318e000 r--p 0018a000 fc:05 1703973 /lib64/libc-2.12.so

:3b6318e000-3b6318f000 rw-p 0018e000 fc:05 1703973 /lib64/libc-2.12.so

:3b6318f000-3b63194000 rw-p 00000000 00:00 0

:3b63200000-3b63217000 r-xp 00000000 fc:05 1703975 /lib64/libpthread-2.12.so

:3b63217000-3b63417000 ---p 00017000 fc:05 1703975 /lib64/libpthread-2.12.so

:3b63417000-3b63418000 r--p 00017000 fc:05 1703975 /lib64/libpthread-2.12.so

:3b63418000-3b63419000 rw-p 00018000 fc:05 1703975 /lib64/libpthread-2.12.so

:3b63419000-3b6341d000 rw-p 00000000 00:00 0

:3b63600000-3b63602000 r-xp 00000000 fc:05 1703977 /lib64/libdl-2.12.so

:3b63602000-3b63802000 ---p 00002000 fc:05 1703977 /lib64/libdl-2.12.so

:3b63802000-3b63803000 r--p 00002000 fc:05 1703977 /lib64/libdl-2.12.so

:3b63803000-3b63804000 rw-p 00003000 fc:05 1703977 /lib64/libdl-2.12.so

:3b63a00000-3b63a83000 r-xp 00000000 fc:05 1703981 /lib64/libm-2.12.so

:3b63a83000-3b63c82000 ---p 00083000 fc:05 1703981 /lib64/libm-2.12.so

:3b63c82000-3b63c83000 r--p 00082000 fc:05 1703981 /lib64/libm-2.12.so

:3b63c83000-3b63c84000 rw-p 00083000 fc:05 1703981 /lib64/libm-2.12.so

:3b63e00000-3b63e07000 r-xp 00000000 fc:05 1703994 /lib64/librt-2.12.so

:3b63e07000-3b64006000 ---p 00007000 fc:05 1703994 /lib64/librt-2.12.so

:3b64006000-3b64007000 r--p 00006000 fc:05 1703994 /lib64/librt-2.12.so

:3b64007000-3b64008000 rw-p 00007000 fc:05 1703994 /lib64/librt-2.12.so

:3b64600000-3b6461d000 r-xp 00000000 fc:05 1704068 /lib64/libselinux.so.1

:3b6461d000-3b6481c000 ---p 0001d000 fc:05 1704068 /lib64/libselinux.so.1

:3b6481c000-3b6481d000 r--p 0001c000 fc:05 1704068 /lib64/libselinux.so.1

:3b6481d000-3b6481e000 rw-p 0001d000 fc:05 1704068 /lib64/libselinux.so.1

:3b6481e000-3b6481f000 rw-p 00000000 00:00 0

:3b64a00000-3b64a16000 r-xp 00000000 fc:05 1704067 /lib64/libresolv-2.12.so

:3b64a16000-3b64c16000 ---p 00016000 fc:05 1704067 /lib64/libresolv-2.12.so

:3b64c16000-3b64c17000 r--p 00016000 fc:05 1704067 /lib64/libresolv-2.12.so

:3b64c17000-3b64c18000 rw-p 00017000 fc:05 1704067 /lib64/libresolv-2.12.so

:3b64c18000-3b64c1a000 rw-p 00000000 00:00 0

:3b65a00000-3b65a16000 r-xp 00000000 fc:05 1703986 /lib64/libgcc_s-4.4.7-20120601.so.1

:3b65a16000-3b65c15000 ---p 00016000 fc:05 1703986 /lib64/libgcc_s-4.4.7-20120601.so.1

:3b65c15000-3b65c16000 rw-p 00015000 fc:05 1703986 /lib64/libgcc_s-4.4.7-20120601.so.1

:3b66200000-3b66203000 r-xp 00000000 fc:05 1704865 /lib64/libcom_err.so.2.1

:3b66203000-3b66402000 ---p 00003000 fc:05 1704865 /lib64/libcom_err.so.2.1

:3b66402000-3b66403000 r--p 00002000 fc:05 1704865 /lib64/libcom_err.so.2.1

:3b66403000-3b66404000 rw-p 00003000 fc:05 1704865 /lib64/libcom_err.so.2.1

:3b66e00000-3b66e41000 r-xp 00000000 fc:05 1710249 /lib64/libgssapi_krb5.so.2.2

:3b66e41000-3b67041000 ---p 00041000 fc:05 1710249 /lib64/libgssapi_krb5.so.2.2

:3b67041000-3b67042000 r--p 00041000 fc:05 1710249 /lib64/libgssapi_krb5.so.2.2

:3b67042000-3b67044000 rw-p 00042000 fc:05 1710249 /lib64/libgssapi_krb5.so.2.2

:3b67a00000-3b67a0a000 r-xp 00000000 fc:05 1704383 /lib64/libkrb5support.so.0.1

:3b67a0a000-3b67c09000 ---p 0000a000 fc:05 1704383 /lib64/libkrb5support.so.0.1

:3b67c09000-3b67c0a000 r--p 00009000 fc:05 1704383 /lib64/libkrb5support.so.0.1

:3b67c0a000-3b67c0b000 rw-p 0000a000 fc:05 1704383 /lib64/libkrb5support.so.0.1

:3b67e00000-3b67e29000 r-xp 00000000 fc:05 1704857 /lib64/libk5crypto.so.3.1

:3b67e29000-3b68029000 ---p 00029000 fc:05 1704857 /lib64/libk5crypto.so.3.1

:3b68029000-3b6802a000 r--p 00029000 fc:05 1704857 /lib64/libk5crypto.so.3.1

:3b6802a000-3b6802b000 rw-p 0002a000 fc:05 1704857 /lib64/libk5crypto.so.3.1

:3b6802b000-3b6802c000 rw-p 00000000 00:00 0

:3b68200000-3b68202000 r-xp 00000000 fc:05 1704154 /lib64/libkeyutils.so.1.3

:3b68202000-3b68401000 ---p 00002000 fc:05 1704154 /lib64/libkeyutils.so.1.3

:3b68401000-3b68402000 r--p 00001000 fc:05 1704154 /lib64/libkeyutils.so.1.3

:3b68402000-3b68403000 rw-p 00002000 fc:05 1704154 /lib64/libkeyutils.so.1.3

:3b68e00000-3b68edb000 r-xp 00000000 fc:05 1710220 /lib64/libkrb5.so.3.3

:3b68edb000-3b690da000 ---p 000db000 fc:05 1710220 /lib64/libkrb5.so.3.3

:3b690da000-3b690e4000 r--p 000da000 fc:05 1710220 /lib64/libkrb5.so.3.3

:3b690e4000-3b690e6000 rw-p 000e4000 fc:05 1710220 /lib64/libkrb5.so.3.3

:3b69200000-3b692e8000 r-xp 00000000 fc:05 550642 /usr/lib64/libstdc++.so.6.0.13

:3b692e8000-3b694e8000 ---p 000e8000 fc:05 550642 /usr/lib64/libstdc++.so.6.0.13

:3b694e8000-3b694ef000 r--p 000e8000 fc:05 550642 /usr/lib64/libstdc++.so.6.0.13

:3b694ef000-3b694f1000 rw-p 000ef000 fc:05 550642 /usr/lib64/libstdc++.so.6.0.13

:3b694f1000-3b69506000 rw-p 00000000 00:00 0

:7fb2dc000000-7fb2dc021000 rw-p 00000000 00:00 0

:7fb2dc021000-7fb2e0000000 ---p 00000000 00:00 0

:7fb2e4000000-7fb2e4021000 rw-p 00000000 00:00 0

:7fb2e4021000-7fb2e8000000 ---p 00000000 00:00 0

:7fb2e8000000-7fb2e812a000 rw-p 00000000 00:00 0

:7fb2e812a000-7fb2ec000000 ---p 00000000 00:00 0

:7fb2ec000000-7fb2ec14b000 rw-p 00000000 00:00 0

:7fb2ec14b000-7fb2f0000000 ---p 00000000 00:00 0

:7fb2f186d000-7fb2f186e000 ---p 00000000 00:00 0

:7fb2f186e000-7fb2f206e000 rw-p 00000000 00:00 0

:7fb2f206e000-7fb2f206f000 ---p 00000000 00:00 0

:7fb2f206f000-7fb2f286f000 rw-p 00000000 00:00 0

:7fb2f286f000-7fb2f2870000 ---p 00000000 00:00 0

:7fb2f2870000-7fb2f3070000 rw-p 00000000 00:00 0

:7fb2f3070000-7fb2f3075000 r-xp 00000000 fc:05 1703963 /lib64/libnss_dns-2.12.so

:7fb2f3075000-7fb2f3274000 ---p 00005000 fc:05 1703963 /lib64/libnss_dns-2.12.so

:7fb2f3274000-7fb2f3275000 r--p 00004000 fc:05 1703963 /lib64/libnss_dns-2.12.so

:7fb2f3275000-7fb2f3276000 rw-p 00005000 fc:05 1703963 /lib64/libnss_dns-2.12.so

:7fb2f3276000-7fb2f3282000 r-xp 00000000 fc:05 1703965 /lib64/libnss_files-2.12.so

:7fb2f3282000-7fb2f3482000 ---p 0000c000 fc:05 1703965 /lib64/libnss_files-2.12.so

:7fb2f3482000-7fb2f3483000 r--p 0000c000 fc:05 1703965 /lib64/libnss_files-2.12.so

:7fb2f3483000-7fb2f3484000 rw-p 0000d000 fc:05 1703965 /lib64/libnss_files-2.12.so

:7fb2f34ac000-7fb2f34ad000 ---p 00000000 00:00 0

:7fb2f34ad000-7fb2f3cad000 rw-p 00000000 00:00 0

:7fb2f3cad000-7fb2f3cb7000 rw-p 00000000 00:00 0

:7fb2f3cc2000-7fb2f3cc3000 rw-p 00000000 00:00 0

:7fffffe5c000-7fffffe71000 rw-p 00000000 00:00 0 [stack]

:7fffffeca000-7fffffecb000 r-xp 00000000 00:00 0 [vdso]

:ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]

open_fds:

:0:/var/pcmonitor/pcmonitor.id

:pos: 0

:flags: 0100000

Mark · February 9, 2014

i tried installing new one but it says its already installed. do i have to uninstall old one first? if so, what command?

You can remove existing one: rpm -e pcmonitor and install new one: rpm -ihv pcmonitor_x64.rpm

or you can force reinstall: rpm -ihv pcmonitor_x64.rpm --force

sly · February 9, 2014

done both, uninstall and reinstall, tested same and tried forced reinstall, acts normal during both but still

dead but subsys locked

Mark · February 9, 2014

Hi,

PM me your connection details and I'll login to have a look.

Mark

Mark · February 10, 2014

Done! You have PM.

Sign In

dead but subsys locked

Recommended Posts

sly

Mark

sly

Calin

Mark

sly

sly

sly

sly

Mark

sly

sly

Mark

sly

Mark

Mark

Create an account or sign in to comment

Create an account

Sign in

Browse

Activity