0004765: ThreadPool full, same as 0004683

(0005508)
apleshi
09-16-11 03:06

we have three servers running resin as web service, I send request from http_load and then all three servers run out of thread the same time.

(0005510)
ferg
09-16-11 14:20

Take a look at your adentry.java line 62.

From the thread dump, there are a large number of threads writing data to something like System.out or System.err.

(0005513)
apleshi
09-18-11 18:57

yes, there is System.out writing something to file, and at that time we run out of harddisk, is this the reason?

(0005538)
ferg
10-04-11 15:56

Yes, that's very possible.

In a production system, System.out should be very limited. Normally, you would want to use java.util.logging for that kind of information and use the "fine" level, so it's not normally getting logged.

I'll check the logging routines to see if they should handle out-of-disk issues better, but this doesn't directly look like a Resin bug.

(0005539)
ferg
10-04-11 16:07

I'm changing the flushing to reduce contention, which should help this case a bit, but the main change should be to reduce the System.out logging and use a finer java.util.logging level instead.

Issue History
Date Modified	Username	Field	Change
09-16-11 02:52	apleshi	New Issue
09-16-11 02:52	apleshi	File Added: jvm-default.log
09-16-11 03:06	apleshi	Note Added: 0005508
09-16-11 14:20	ferg	Note Added: 0005510
09-18-11 18:57	apleshi	Note Added: 0005513
09-23-11 01:11	amukas	Issue Monitored: amukas
10-04-11 15:56	ferg	Note Added: 0005538
10-04-11 16:07	ferg	Note Added: 0005539
10-04-11 16:07	ferg	Assigned To	=> ferg
10-04-11 16:07	ferg	Status	new => closed
10-04-11 16:07	ferg	Resolution	open => fixed
10-04-11 16:07	ferg	Fixed in Version	=> 4.0.24

Notes
(0005508) apleshi 09-16-11 03:06	we have three servers running resin as web service, I send request from http_load and then all three servers run out of thread the same time.

(0005510) ferg 09-16-11 14:20	Take a look at your adentry.java line 62. From the thread dump, there are a large number of threads writing data to something like System.out or System.err.

(0005513) apleshi 09-18-11 18:57	yes, there is System.out writing something to file, and at that time we run out of harddisk, is this the reason?

(0005538) ferg 10-04-11 15:56	Yes, that's very possible. In a production system, System.out should be very limited. Normally, you would want to use java.util.logging for that kind of information and use the "fine" level, so it's not normally getting logged. I'll check the logging routines to see if they should handle out-of-disk issues better, but this doesn't directly look like a Resin bug.

(0005539) ferg 10-04-11 16:07	I'm changing the flushing to reduce contention, which should help this case a bit, but the main change should be to reduce the System.out logging and use a finer java.util.logging level instead.

Relationships