0005937: HP-UX 100% CPU usage caused by CoordinatorThread and ThreadScheduleWorker

Viewing Issue Advanced Details [ Jump to Notes ]

[ View Simple ] [ Issue History ] [ Print ]

Category

Severity

Reproducibility

Date Submitted

Last Update

0005937

[Resin]

minor

always

08-18-15 22:30

04-25-17 14:25

Reporter

nam

View Status

public

Assigned To

ferg

Priority

normal

Resolution

unable to reproduce

Platform

Status

closed

Projection

none

OS Version

ETA

none

Fixed in Version

Product Version

Product Build

Summary

0005937: HP-UX 100% CPU usage caused by CoordinatorThread and ThreadScheduleWorker

Description

So HP-UX has hp_prstat to drill down into thread CPU usage. CoordinatorThread and ThreadScheduleWorker are going crazy in a clustered environment. CPU rises 5-10 min after startup. It gets 3x-4x worst when all the other nodes are killed.

Resin Professional 4.0.44
HP-UX 11.31 ia64
Itanium_JDK_6.0.26

# ./hp_prstat 24941
lwpid pid pri status UsrTime SysTime
----- --- --- ---- ------ ------
1323653 24941 154 1 10 0
1323657 24941 137 1 0 0
1323658 24941 137 1 68 0
1323659 24941 137 1 67 0
1323660 24941 137 1 70 0
1323661 24941 137 1 71 0
1323662 24941 137 1 68 0
1323663 24941 137 1 67 0
1323664 24941 137 1 68 0
1323665 24941 137 1 70 0
1323667 24941 154 1 83 6
1323668 24941 137 1 0 0
1323669 24941 137 1 1 0
1323670 24941 137 1 0 0
1323692 24941 137 1 9 0
1323693 24941 137 1 9 0
1323694 24941 154 1 13 4
1323695 24941 137 1 0 0
1323696 24941 137 1 0 0
1323697 24941 154 1 0 0
1323718 24941 154 1 0 0
1323719 24941 154 1 10132 4910
1323721 24941 154 1 0 0
1323724 24941 154 1 0 0
1323725 24941 137 1 0 0
1323731 24941 154 1 0 0
1323735 24941 154 1 0 0
1323736 24941 154 1 0 0
1323741 24941 241 2 14320 6830
1323766 24941 154 1 0 0
1323797 24941 137 1 0 0
1323798 24941 137 1 0 0
1323799 24941 137 1 0 0
1323816 24941 137 1 0 0
1323971 24941 168 1 1 0
1323972 24941 168 1 1 0
1323973 24941 168 1 1 0
1323974 24941 168 1 0 0
1323975 24941 154 1 0 0
1323976 24941 137 1 0 0
1323977 24941 168 1 24 39
1323978 24941 137 1 0 0
1323979 24941 168 1 1 0
1323980 24941 137 1 0 0
1323981 24941 137 1 0 0
1323982 24941 137 1 0 0
1323983 24941 137 1 0 0
1323984 24941 137 1 0 0
1324542 24941 168 1 1 0
1355939 24941 137 1 175 90
1356575 24941 137 1 181 87
1357677 24941 154 2 161 77
1359023 24941 137 1 117 53
1359305 24941 154 1 31 13
1359386 24941 137 4 28 12
1359460 24941 154 1 26 11
1359461 24941 241 2 104 47
1359462 24941 154 1 67 28
1359775 24941 137 1 76 42
1359828 24941 137 1 105 48
1359845 24941 154 1 29 13
1359881 24941 137 1 52 25
1359882 24941 137 1 86 39
1360150 24941 137 1 42 19
1360258 24941 154 1 16 7
1360504 24941 154 1 13 5
1360538 24941 137 1 54 24
1360539 24941 154 1 19 9
1360701 24941 137 1 62 33
1360847 24941 241 2 34 14
1360848 24941 137 1 26 12
1360849 24941 137 1 13 6
1360852 24941 137 1 14 6
1360853 24941 137 1 16 8
1360855 24941 154 1 3 1
1360856 24941 137 1 2 0
1360858 24941 137 1 11 5
1360859 24941 154 1 9 4
1360861 24941 154 1 2 0
1360862 24941 137 1 2 1
1360863 24941 154 1 1 1
1360865 24941 137 1 24 11
1360866 24941 137 1 13 6

"CoordinatorThread[]-3" daemon prio=5 tid=0x60000000001fdc00 nid=22 lwp_id=1323719 runnable [0x9fffffff0c300000]
   java.lang.Thread.State: TIMED_WAITING (parking)
    at sun.misc.Unsafe.park(Native Method)
    at java.util.concurrent.locks.LockSupport.parkUntil(LockSupport.java:383)
    at com.caucho.env.thread2.AbstractTaskWorker2.run(AbstractTaskWorker2.java:263)
    at com.caucho.env.thread2.ResinThread2.runTasks(ResinThread2.java:173)
    at com.caucho.env.thread2.ResinThread2.run(ResinThread2.java:118)

"ThreadScheduleWorker[]-2" daemon prio=5 tid=0x60000000029ca400 nid=40 lwp_id=1323741 runnable [0x9fffffff09f00000]
   java.lang.Thread.State: RUNNABLE
    at sun.misc.Unsafe.park(Native Method)
    at java.util.concurrent.locks.LockSupport.parkUntil(LockSupport.java:383)
    at com.caucho.env.thread2.AbstractTaskWorker2.run(AbstractTaskWorker2.java:263)
    at java.lang.Thread.run(Thread.java:722)

Steps To Reproduce

Additional Information

Attached Files

Relationships

There are no notes attached to this issue.

Issue History
Date Modified	Username	Field	Change
08-18-15 22:30	nam	New Issue
04-25-17 14:25	ferg	Assigned To	=> ferg
04-25-17 14:25	ferg	Status	new => closed
04-25-17 14:25	ferg	Resolution	open => unable to reproduce

Mantis 1.0.0rc3[^]

27 total queries executed.
25 unique queries executed.