0003848: resin in a deadlock on com.caucho.loader.EnvironmentClassLoader

Viewing Issue Advanced Details [ Jump to Notes ]

[ View Simple ] [ Issue History ] [ Print ]

Category

Severity

Reproducibility

Date Submitted

Last Update

0003848

[Resin]

crash

always

01-14-10 06:07

03-30-10 16:53

Reporter

zenant

View Status

public

Assigned To

ferg

Priority

normal

Resolution

fixed

Platform

Status

closed

Projection

none

OS Version

ETA

none

Fixed in Version

4.0.6

Product Version

3.1.7

Product Build

Summary

0003848: resin in a deadlock on com.caucho.loader.EnvironmentClassLoader

Description

On production site we just had all hmux thread deadlocked on one instance of com.caucho.loader.EnvironmentClassLoader.
This is a part of thread dump. Please let me know if you need more deatils from the dump.

Level Name Group CPU Time [ms] State Waiting On Owned By Owned Monitors Priority Start Time Thread Id
1 http-127.0.0.1:80-2 main 5300 blocked com.caucho.loader.ClassEntry@1346486529 747138112 5 5 2010-01-13 21:04:13 1745510705
1 ReportWorkerThread[1801a2g0000icamie79g000000]: slow fast unknown main 6630 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 - 4 2010-01-13 22:11:59 382503307
1 PS Agent Scheduler Consumer[0] main 5160 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 - 5 2010-01-13 21:34:26 1397517209
1 PS Agent Runner: 0 main 185320 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 2 5 2010-01-13 21:08:53 511635087
1 PS Agent Monitor main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 - 5 2010-01-13 21:34:26 1324811909
1 http-127.0.0.1:80-26 main 4170 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 4 5 2010-01-13 21:04:13 747138112
1 hmux-10.0.21.10:6802-87 main 20 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 08:02:10 107780931
1 hmux-10.0.21.10:6802-77 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 06:34:51 1089374285
1 hmux-10.0.21.10:6802-68 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 07:42:28 1217386988
1 hmux-10.0.21.10:6802-65 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 06:58:57 541515094
1 hmux-10.0.21.10:6802-61 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 2 5 2010-01-14 02:56:58 1461526742
1 hmux-10.0.21.10:6802-59 main 10 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 05:32:28 2069132692
1 hmux-10.0.21.10:6802-171 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 08:07:14 370178277
1 hmux-10.0.21.10:6802-168 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 07:52:30 1638304546
1 hmux-10.0.21.10:6802-167 main 270 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 05:57:27 1415921416
1 hmux-10.0.21.10:6802-165 main 10 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 06:54:56 2097229470
1 hmux-10.0.21.10:6802-164 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 06:48:54 1014958559
1 hmux-10.0.21.10:6802-162 main 70 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 06:35:52 1739246706
1 hmux-10.0.21.10:6802-158 main 80 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 06:40:53 1981366117
1 hmux-10.0.21.10:6802-157 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 05:57:27 861362450
1 hmux-10.0.21.10:6802-156 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 07:52:30 1575246794
1 hmux-10.0.21.10:6802-154 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 07:42:28 680887895
1 hmux-10.0.21.10:6802-152 main 700 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 05:32:28 1322756033
1 hmux-10.0.21.10:6802-151 main 9540 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-13 21:04:28 147610680
1 hmux-10.0.21.10:6802-148 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 06:28:29 74641099
1 hmux-10.0.21.10:6802-147 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 06:13:47 319384505
1 hmux-10.0.21.10:6802-146 main 10 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 06:35:52 370033260
1 hmux-10.0.21.10:6802-145 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 06:46:54 971957053
1 hmux-10.0.21.10:6802-142 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 07:59:19 1299221522
1 hmux-10.0.21.10:6802-141 main 220 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 05:26:03 1794037666
1 hmux-10.0.21.10:6802-140 main 30 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 06:28:30 1385571362
1 hmux-10.0.21.10:6802-139 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 07:42:28 604068026
1 hmux-10.0.21.10:6802-136 main 50 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 06:18:48 1607429586
1 hmux-10.0.21.10:6802-134 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 07:24:05 1688861483
1 hmux-10.0.21.10:6802-125 main 160 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 05:32:28 1900273841
1 hmux-10.0.21.10:6802-124 main 20 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 07:54:20 1575329794
1 hmux-10.0.21.10:6802-122 main 10 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 07:00:57 508437962
1 hmux-10.0.21.10:6802-117 main 10 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 07:23:25 109988836
1 hmux-10.0.21.10:6802-111 main 0 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-14 06:28:29 1270308904
1 hmux-10.0.21.10:6802-108 main 250 blocked com.caucho.loader.EnvironmentClassLoader@660662434 1745510705 1 5 2010-01-13 22:55:04 395217923

Steps To Reproduce

Additional Information

Attached Files

Relationships

Notes
(0004384) ferg 01-14-10 08:43	Thanks for the bug report. That thread dump looks like a bug that we've fixed in 4.0.x. I believe we've also fixed it in 3.1.9, but I'd need to double-check that code.

Issue History
Date Modified	Username	Field	Change
01-14-10 06:07	zenant	New Issue
01-14-10 08:43	ferg	Note Added: 0004384
03-30-10 16:53	ferg	Assigned To	=> ferg
03-30-10 16:53	ferg	Status	new => closed
03-30-10 16:53	ferg	Resolution	open => fixed
03-30-10 16:53	ferg	Fixed in Version	=> 4.0.6

Mantis 1.0.0rc3[^]

29 total queries executed.
26 unique queries executed.