Mantis - Resin
Viewing Issue Advanced Details
5994 crash always 04-13-16 06:28 11-04-16 13:50
nam  
ferg  
high  
closed  
fixed  
none    
none 4.0.49  
0005994: EXCEPTION_ACCESS_VIOLATION under high load on windows x64, jdk7 x86
(rep by N. Overschelde)

related to: http://bugs.caucho.com/view.php?id=5630 [^]

OS: Windows Server 2008 R2 , 64 bit Build 7601 Service Pack 1
Java: 1.7.0_80-b15

We are using the 32 bit version of java/resin with the most recent jdk7_80. We've also tried jdk7_05 and jdk7_79.

The server is Windows Server 2008 R2 Enterprise, Service pack 1.

The issue is that the HotSpot VM crashes continually during our busiest times of the day and creates a large dump file. This does not occur with resin pro4.0.23. It only started occurring when we upgraded to resin pro4.0.44. I then tried 4.0.48, and the logs attached are from using resin pro4.0.48. If we revert back to resin pro4.0.23, and change nothing else, the VM crashes do not occur. So, there appears to be some change between 4.0.23 and 4.0.44 that we are not accounting for. Our application continues to run fine on .23.
#
# A fatal error has been detected by the Java Runtime Environment:
#
# EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x8b04c480, pid=11952, tid=9608
#
# JRE version: Java(TM) SE Runtime Environment (7.0_80-b15) (build 1.7.0_80-b15)
# Java VM: Java HotSpot(TM) Client VM (24.80-b11 mixed mode windows-x86 )
# Problematic frame:
# C 0x8b04c480
#
#
# If you would like to submit a bug report, please visit:
# http://bugreport.java.com/bugreport/crash.jsp [^]
#

--------------- T H R E A D ---------------

Current thread (0x0b914400): JavaThread "resin-port-8101-150788" daemon [_thread_in_native_trans, id=9608, stack(0x09720000,0x09770000)]

siginfo: ExceptionCode=0xc0000005, ExceptionInformation=0x00000008 0x8b04c480

Registers:
EAX=0x00000000, EBX=0x00000000, ECX=0x88233726, EDX=0x00000000
ESP=0x0976f79c, EBP=0x0976f7a8, ESI=0x2602f128, EDI=0x0b914400
EIP=0x8b04c480, EFLAGS=0x00010246

Top of Stack: (sp=0x0976f79c)
0x0976f79c: 0b914400 00006134 00000001 0976f958
0x0976f7ac: 01bfeac0 050b09e0 00000000 03f9ea28
0x0976f7bc: 00000000 0b914400 8155c0ca 0b914400
0x0976f7cc: 0976f800 6e971713 0b914400 8155cf26
0x0976f7dc: 0b914400 21a00840 2602f0b8 2602f128
0x0976f7ec: 9d765211 2602f128 6ec0787e 0976f958
0x0976f7fc: 01c1ca00 050b09e0 00000000 0001d4c0
0x0976f80c: 00000000 25ed8bc8 1ae207c0 0976f848

Instructions: (pc=0x8b04c480)
0x8b04c460:
[error occurred during error reporting (printing registers, top of stack, instructions near pc), id 0xc0000005]

Register to memory mapping:

EAX=0x00000000 is an unknown value
EBX=0x00000000 is an unknown value
ECX=0x88233726 is an unknown value
EDX=0x00000000 is an unknown value
ESP=0x0976f79c is pointing into the stack for thread: 0x0b914400
EBP=0x0976f7a8 is pointing into the stack for thread: 0x0b914400
ESI=0x2602f128 is an oop
java.lang.Object
 - klass: 'java/lang/Object'
EDI=0x0b914400 is a thread


Stack: [0x09720000,0x09770000], sp=0x0976f79c, free space=317k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C 0x8b04c480
J 5416 C1 com.caucho.vfs.JniSocketImpl.accept(Lcom/caucho/vfs/JniServerSocketImpl;JJ)Z (93 bytes) @ 0x01bfeac0 [0x01bfe910+0x1b0]
J 5467 C1 com.caucho.vfs.JniServerSocketImpl.accept(Lcom/caucho/vfs/QSocket;)Z (38 bytes) @ 0x01c1ca00 [0x01c1c960+0xa0]
J 5439 C1 com.caucho.network.listen.TcpPort.accept(Lcom/caucho/vfs/QSocket;)Z (146 bytes) @ 0x01c0951c [0x01c09470+0xac]
J 5430 C1 com.caucho.network.listen.TcpSocketLink.accept()Z (29 bytes) @ 0x01c05fac [0x01c05f50+0x5c]
j com.caucho.network.listen.TcpSocketLink.handleAcceptTaskImpl()Lcom/caucho/network/listen/RequestState;+56
j com.caucho.network.listen.ConnectionTask.runThread()V+54
j com.caucho.network.listen.ConnectionTask.run()V+19
j com.caucho.network.listen.SocketLinkThreadLauncher.handleTasks(Z)V+108
j com.caucho.network.listen.TcpSocketAcceptThread.run()V+61
J 4351 C1 com.caucho.env.thread2.ResinThread2.runTasks()V (232 bytes) @ 0x019c4d5c [0x019c4790+0x5cc]
j com.caucho.env.thread2.ResinThread2.run()V+15
v ~StubRoutines::call_stub
V [jvm.dll+0x1429aa]
V [jvm.dll+0x20743e]
V [jvm.dll+0x142b75]
V [jvm.dll+0x142bd7]
V [jvm.dll+0xed5cf]
V [jvm.dll+0x163c4c]
V [jvm.dll+0x1646a7]
V [jvm.dll+0x1a92f9]
C [msvcr100.dll+0x5c556]
C [msvcr100.dll+0x5c600]
C [kernel32.dll+0x1337a]
C [ntdll.dll+0x39882]
C [ntdll.dll+0x39855]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
J 5417 com.caucho.vfs.JniSocketImpl.nativeAccept(JJ)Z (0 bytes) @ 0x01bfe6ab [0x01bfe650+0x5b]
J 5416 C1 com.caucho.vfs.JniSocketImpl.accept(Lcom/caucho/vfs/JniServerSocketImpl;JJ)Z (93 bytes) @ 0x01bfeac0 [0x01bfe910+0x1b0]
J 5467 C1 com.caucho.vfs.JniServerSocketImpl.accept(Lcom/caucho/vfs/QSocket;)Z (38 bytes) @ 0x01c1ca00 [0x01c1c960+0xa0]
J 5439 C1 com.caucho.network.listen.TcpPort.accept(Lcom/caucho/vfs/QSocket;)Z (146 bytes) @ 0x01c0951c [0x01c09470+0xac]
J 5430 C1 com.caucho.network.listen.TcpSocketLink.accept()Z (29 bytes) @ 0x01c05fac [0x01c05f50+0x5c]
j com.caucho.network.listen.TcpSocketLink.handleAcceptTaskImpl()Lcom/caucho/network/listen/RequestState;+56
j com.caucho.network.listen.ConnectionTask.runThread()V+54
j com.caucho.network.listen.ConnectionTask.run()V+19
j com.caucho.network.listen.SocketLinkThreadLauncher.handleTasks(Z)V+108
j com.caucho.network.listen.TcpSocketAcceptThread.run()V+61
J 4351 C1 com.caucho.env.thread2.ResinThread2.runTasks()V (232 bytes) @ 0x019c4d5c [0x019c4790+0x5cc]
j com.caucho.env.thread2.ResinThread2.run()V+15
v ~StubRoutines::call_stub

--------------- P R O C E S S ---------------

Java Threads: ( => current thread )
  0x0ba50400 JavaThread "resin-356978" daemon [_thread_blocked, id=3152, stack(0x04ea0000,0x04ef0000)]
  0x0ba4f000 JavaThread "resin-port-8101-launcher" daemon [_thread_blocked, id=4752, stack(0x0b430000,0x0b480000)]
  0x0ba06c00 JavaThread "resin-354501" daemon [_thread_blocked, id=4992, stack(0x0de40000,0x0de90000)]
  0x0bcb1c00 JavaThread "DependencyCheckWorker[]-12" daemon [_thread_blocked, id=4576, stack(0x0cd50000,0x0cda0000)]
  0x0bcb1400 JavaThread "resin-339105" daemon [_thread_blocked, id=6680, stack(0x05610000,0x05660000)]
  0x0b7c1800 JavaThread "resin-339104" daemon [_thread_blocked, id=1972, stack(0x0a790000,0x0a7e0000)]
  0x0ba05800 JavaThread "resin-333181" daemon [_thread_blocked, id=11736, stack(0x05190000,0x051e0000)]
  0x0b913800 JavaThread "resin-330718" daemon [_thread_blocked, id=3980, stack(0x0da10000,0x0da60000)]
  0x0b912c00 JavaThread "resin-330716" daemon [_thread_blocked, id=4880, stack(0x0b140000,0x0b190000)]
  0x0ba50000 JavaThread "DependencyCheckWorker[]-16" daemon [_thread_blocked, id=2448, stack(0x0cae0000,0x0cb30000)]
  0x0bae3000 JavaThread "resin-port-127.0.0.1:6800-launcher" daemon [_thread_blocked, id=10308, stack(0x0d560000,0x0d5b0000)]
  0x0be62c00 JavaThread "resin-326510" daemon [_thread_blocked, id=9480, stack(0x04630000,0x04680000)]
  0x0b71ec00 JavaThread "resin-324634" daemon [_thread_blocked, id=2380, stack(0x03890000,0x038e0000)]
  0x0b71e800 JavaThread "resin-324633" daemon [_thread_blocked, id=344, stack(0x0c4e0000,0x0c530000)]
  0x0be62000 JavaThread "resin-315402" daemon [_thread_blocked, id=12048, stack(0x0db70000,0x0dbc0000)]
  0x0bae5000 JavaThread "resin-315401" daemon [_thread_blocked, id=12980, stack(0x0d500000,0x0d550000)]
  0x0b7c4400 JavaThread "resin-301238" daemon [_thread_blocked, id=6640, stack(0x0cd00000,0x0cd50000)]
  0x0b7c4000 JavaThread "resin-299694" daemon [_thread_blocked, id=1700, stack(0x09900000,0x09950000)]
  0x0ba05000 JavaThread "resin-299060" daemon [_thread_blocked, id=6048, stack(0x04970000,0x049c0000)]
  0x0b71e000 JavaThread "resin-296339" daemon [_thread_blocked, id=5340, stack(0x0cc00000,0x0cc50000)]
  0x0bb35400 JavaThread "resin-288956" daemon [_thread_blocked, id=2636, stack(0x0db00000,0x0db50000)]
  0x0b7c4c00 JavaThread "resin-284778" daemon [_thread_blocked, id=6584, stack(0x046d0000,0x04720000)]
  0x0b7c0c00 JavaThread "DependencyCheckWorker[]-13" daemon [_thread_blocked, id=7724, stack(0x0cdc0000,0x0ce10000)]
  0x0b7c5800 JavaThread "resin-218880" daemon [_thread_blocked, id=12280, stack(0x0d700000,0x0d750000)]
  0x0b7c1000 JavaThread "resin-201314" daemon [_thread_blocked, id=11476, stack(0x0cba0000,0x0cbf0000)]
  0x06173400 JavaThread "DependencyCheckWorker[]-26" daemon [_thread_blocked, id=2356, stack(0x08290000,0x082e0000)]
=>0x0b914400 JavaThread "resin-port-8101-150788" daemon [_thread_in_native_trans, id=9608, stack(0x09720000,0x09770000)]
  0x0ba4f800 JavaThread "resin-90643" daemon [_thread_blocked, id=3932, stack(0x09bb0000,0x09c00000)]
  0x0bae0400 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-0000002" daemon [_thread_blocked, id=3596, stack(0x0b390000,0x0b3e0000)]
  0x0bae3800 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-0000001" daemon [_thread_blocked, id=11980, stack(0x0cee0000,0x0cf30000)]
  0x0bae5800 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-0" daemon [_thread_blocked, id=3872, stack(0x0ce90000,0x0cee0000)]
  0x0bae4c00 JavaThread "Timer-2" daemon [_thread_blocked, id=568, stack(0x0c940000,0x0c990000)]
  0x06293c00 JavaThread "resin-port-8101-2572" daemon [_thread_in_native, id=1856, stack(0x0ca10000,0x0ca60000)]
  0x06295000 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-0000002" daemon [_thread_blocked, id=4776, stack(0x0c7b0000,0x0c800000)]
  0x06295400 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-0000001" daemon [_thread_blocked, id=12144, stack(0x0c880000,0x0c8d0000)]
  0x06295c00 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-0" daemon [_thread_blocked, id=3804, stack(0x0c6d0000,0x0c720000)]
  0x06296400 JavaThread "Timer-1" daemon [_thread_blocked, id=1508, stack(0x0c750000,0x0c7a0000)]
  0x06291c00 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-0000002" daemon [_thread_blocked, id=1744, stack(0x0c530000,0x0c580000)]
  0x06291800 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-0000001" daemon [_thread_blocked, id=7940, stack(0x0c590000,0x0c5e0000)]
  0x06291000 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-0" daemon [_thread_blocked, id=11876, stack(0x0c600000,0x0c650000)]
  0x06290c00 JavaThread "Timer-0" daemon [_thread_blocked, id=6468, stack(0x0c490000,0x0c4e0000)]
  0x0628ec00 JavaThread "HealthSystemHealthCheckWorker[]-21" daemon [_thread_blocked, id=4160, stack(0x0b200000,0x0b250000)]
  0x06176c00 JavaThread "resin-port-8101-57" daemon [_thread_in_native, id=12580, stack(0x0b260000,0x0b2b0000)]
  0x06176000 JavaThread "resin-port-8101-55" daemon [_thread_in_native, id=10008, stack(0x0b0b0000,0x0b100000)]
  0x06172c00 JavaThread "resin-port-8101-47" daemon [_thread_in_native, id=10524, stack(0x04a40000,0x04a90000)]
  0x06172800 JavaThread "resin-port-8101-46" daemon [_thread_in_native, id=10188, stack(0x09a40000,0x09a90000)]
  0x06171c00 JavaThread "resin-port-8101-44" daemon [_thread_in_native, id=7228, stack(0x097c0000,0x09810000)]
  0x06171400 JavaThread "resin-port-8101-43" daemon [_thread_in_native, id=8504, stack(0x09830000,0x09880000)]
  0x06170c00 JavaThread "resin-port-8101-42" daemon [_thread_in_native, id=9976, stack(0x09770000,0x097c0000)]
  0x06170800 JavaThread "resin-port-8101-41" daemon [_thread_in_native, id=1416, stack(0x08420000,0x08470000)]
  0x06170000 JavaThread "resin-main-link" daemon [_thread_in_native, id=1988, stack(0x084b0000,0x08500000)]
  0x0616fc00 JavaThread "resin-shutdown" daemon [_thread_blocked, id=11536, stack(0x08150000,0x081a0000)]
  0x0616f400 JavaThread "resin-fail-safe-memory-free" daemon [_thread_blocked, id=7464, stack(0x08360000,0x083b0000)]
  0x03a7f400 JavaThread "resin-fail-safe-halt" daemon [_thread_blocked, id=4792, stack(0x08220000,0x08270000)]
  0x03a7cc00 JavaThread "resin-port-8101-31" daemon [_thread_in_native, id=6072, stack(0x05660000,0x056b0000)]
  0x03a7bc00 JavaThread "resin-port-8101-28" daemon [_thread_in_native, id=10848, stack(0x05440000,0x05490000)]
  0x03a7b400 JavaThread "ThreadScheduleWorker[]-2" daemon [_thread_blocked, id=10324, stack(0x05490000,0x054e0000)]
  0x03a78400 JavaThread "resin-20" daemon [_thread_blocked, id=10924, stack(0x04c50000,0x04ca0000)]
  0x03a77400 JavaThread "resin-port-8101-18" daemon [_thread_in_native, id=9716, stack(0x04cc0000,0x04d10000)]
  0x03a73800 JavaThread "resin-port-127.0.0.1:6800-16" daemon [_thread_in_native, id=11024, stack(0x04ad0000,0x04b20000)]
  0x03a62000 JavaThread "resin-port-127.0.0.1:6800-14" daemon [_thread_in_native, id=5196, stack(0x047b0000,0x04800000)]
  0x03a61000 JavaThread "resin-port-127.0.0.1:6800-12" daemon [_thread_in_native, id=6472, stack(0x04810000,0x04860000)]
  0x03a5c800 JavaThread "resin-port-8101-11" daemon [_thread_in_native, id=8828, stack(0x04720000,0x04770000)]
  0x03a5c000 JavaThread "resin-port-127.0.0.1:6800-10" daemon [_thread_in_native, id=10320, stack(0x04550000,0x045a0000)]
  0x0340a000 JavaThread "CoordinatorThread[]-3" daemon [_thread_blocked, id=2424, stack(0x010c0000,0x01110000)]
  0x03409800 JavaThread "ThreadLauncher2[ThreadPool[system]]-1" daemon [_thread_blocked, id=8708, stack(0x036f0000,0x03740000)]
  0x0329e800 JavaThread "Service Thread" daemon [_thread_blocked, id=2200, stack(0x03630000,0x03680000)]
  0x0329b400 JavaThread "C1 CompilerThread0" daemon [_thread_blocked, id=11076, stack(0x00820000,0x00870000)]
  0x0327e800 JavaThread "Attach Listener" daemon [_thread_blocked, id=3504, stack(0x00b10000,0x00b60000)]
  0x0321a400 JavaThread "Finalizer" daemon [_thread_blocked, id=13304, stack(0x03750000,0x037a0000)]
  0x03218c00 JavaThread "Reference Handler" daemon [_thread_blocked, id=7440, stack(0x036a0000,0x036f0000)]
  0x0033e800 JavaThread "main" [_thread_blocked, id=12508, stack(0x00340000,0x00390000)]

Other Threads:
  0x03216400 VMThread [stack: 0x03440000,0x03490000] [id=3368]
  0x032bbc00 WatcherThread [stack: 0x037c0000,0x03810000] [id=12436]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap
 def new generation total 100992K, used 2835K [0x10200000, 0x16f90000, 0x1aca0000)
  eden space 89792K, 2% used [0x10200000, 0x10439208, 0x159b0000)
  from space 11200K, 4% used [0x159b0000, 0x15a3bbb0, 0x164a0000)
  to space 11200K, 0% used [0x164a0000, 0x164a0000, 0x16f90000)
 tenured generation total 224368K, used 195359K [0x1aca0000, 0x287bc000, 0x30200000)
   the space 224368K, 87% used [0x1aca0000, 0x26b67ce8, 0x26b67e00, 0x287bc000)
 compacting perm gen total 33536K, used 33521K [0x30200000, 0x322c0000, 0x34200000)
   the space 33536K, 99% used [0x30200000, 0x322bc618, 0x322bc800, 0x322c0000)
No shared spaces configured.

Card table byte_map: [0x00f90000,0x010c0000] byte_map_base: 0x00f0f000

Polling page: 0x00170000

Code Cache [0x01160000, 0x01ca0000, 0x03160000)
 total_blobs=5865 nmethods=5580 adapters=218 free_code_cache=21257Kb largest_free_block=21763904

Compilation events (10 events):
Event: 14464.162 Thread 0x0329b400 5633 com.caucho.loader.DynamicClassLoader::getResource (198 bytes)
Event: 14464.164 Thread 0x0329b400 nmethod 5633 0x01c9ba48 code [0x01c9bc60, 0x01c9c470]
Event: 14556.733 Thread 0x0329b400 5634 java.util.Calendar::<init> (19 bytes)
Event: 14556.733 Thread 0x0329b400 nmethod 5634 0x01c9cec8 code [0x01c9cfe0, 0x01c9d0b4]
Event: 15602.688 Thread 0x0329b400 5635 com.caucho.quercus.lib.json.JsonDecoder::decodeObjectToObject (203 bytes)
Event: 15602.689 Thread 0x0329b400 nmethod 5635 0x01c9d148 code [0x01c9d330, 0x01c9d750]
Event: 15671.228 Thread 0x0329b400 5636 com.caucho.env.deploy.ExpandDeployController::isControllerModified (8 bytes)
Event: 15671.228 Thread 0x0329b400 nmethod 5636 0x01c9dd08 code [0x01c9de10, 0x01c9debc]
Event: 16365.266 Thread 0x0329b400 5637

GC Heap History (10 events):
Event: 16365.010 GC heap before
{Heap before GC invocations=312 (full 10):
 def new generation total 100992K, used 90401K [0x10200000, 0x16f90000, 0x1aca0000)
  eden space 89792K, 100% used [0x10200000, 0x159b0000, 0x159b0000)
  from space 11200K, 5% used [0x164a0000, 0x16538468, 0x16f90000)
  to space 11200K, 0% used [0x159b0000, 0x159b0000, 0x164a0000)
 tenured generation total 224368K, used 195358K [0x1aca0000, 0x287bc000, 0x30200000)
   the space 224368K, 87% used [0x1aca0000, 0x26b67a50, 0x26b67c00, 0x287bc000)
 compacting perm gen total 33536K, used 33521K [0x30200000, 0x322c0000, 0x34200000)
   the space 33536K, 99% used [0x30200000, 0x322bc618, 0x322bc800, 0x322c0000)
No shared spaces configured.
Event: 16365.015 GC heap after
Heap after GC invocations=313 (full 10):
 def new generation total 100992K, used 676K [0x10200000, 0x16f90000, 0x1aca0000)
  eden space 89792K, 0% used [0x10200000, 0x10200000, 0x159b0000)
  from space 11200K, 6% used [0x159b0000, 0x15a59050, 0x164a0000)
  to space 11200K, 0% used [0x164a0000, 0x164a0000, 0x16f90000)
 tenured generation total 224368K, used 195358K [0x1aca0000, 0x287bc000, 0x30200000)
   the space 224368K, 87% used [0x1aca0000, 0x26b67b58, 0x26b67c00, 0x287bc000)
 compacting perm gen total 33536K, used 33521K [0x30200000, 0x322c0000, 0x34200000)
   the space 33536K, 99% used [0x30200000, 0x322bc618, 0x322bc800, 0x322c0000)
No shared spaces configured.
}
Event: 16368.173 GC heap before
{Heap before GC invocations=313 (full 10):
 def new generation total 100992K, used 90468K [0x10200000, 0x16f90000, 0x1aca0000)
  eden space 89792K, 100% used [0x10200000, 0x159b0000, 0x159b0000)
  from space 11200K, 6% used [0x159b0000, 0x15a59050, 0x164a0000)
  to space 11200K, 0% used [0x164a0000, 0x164a0000, 0x16f90000)
 tenured generation total 224368K, used 195358K [0x1aca0000, 0x287bc000, 0x30200000)
   the space 224368K, 87% used [0x1aca0000, 0x26b67b58, 0x26b67c00, 0x287bc000)
 compacting perm gen total 33536K, used 33521K [0x30200000, 0x322c0000, 0x34200000)
   the space 33536K, 99% used [0x30200000, 0x322bc618, 0x322bc800, 0x322c0000)
No shared spaces configured.
Event: 16368.178 GC heap after
Heap after GC invocations=314 (full 10):
 def new generation total 100992K, used 592K [0x10200000, 0x16f90000, 0x1aca0000)
  eden space 89792K, 0% used [0x10200000, 0x10200000, 0x159b0000)
  from space 11200K, 5% used [0x164a0000, 0x165341a8, 0x16f90000)
  to space 11200K, 0% used [0x159b0000, 0x159b0000, 0x164a0000)
 tenured generation total 224368K, used 195358K [0x1aca0000, 0x287bc000, 0x30200000)
   the space 224368K, 87% used [0x1aca0000, 0x26b67b58, 0x26b67c00, 0x287bc000)
 compacting perm gen total 33536K, used 33521K [0x30200000, 0x322c0000, 0x34200000)
   the space 33536K, 99% used [0x30200000, 0x322bc618, 0x322bc800, 0x322c0000)
No shared spaces configured.
}
Event: 16371.030 GC heap before
{Heap before GC invocations=314 (full 10):
 def new generation total 100992K, used 90384K [0x10200000, 0x16f90000, 0x1aca0000)
  eden space 89792K, 100% used [0x10200000, 0x159b0000, 0x159b0000)
  from space 11200K, 5% used [0x164a0000, 0x165341a8, 0x16f90000)
  to space 11200K, 0% used [0x159b0000, 0x159b0000, 0x164a0000)
 tenured generation total 224368K, used 195358K [0x1aca0000, 0x287bc000, 0x30200000)
   the space 224368K, 87% used [0x1aca0000, 0x26b67b58, 0x26b67c00, 0x287bc000)
 compacting perm gen total 33536K, used 33521K [0x30200000, 0x322c0000, 0x34200000)
   the space 33536K, 99% used [0x30200000, 0x322bc618, 0x322bc800, 0x322c0000)
No shared spaces configured.
Event: 16371.035 GC heap after
Heap after GC invocations=315 (full 10):
 def new generation total 100992K, used 631K [0x10200000, 0x16f90000, 0x1aca0000)
  eden space 89792K, 0% used [0x10200000, 0x10200000, 0x159b0000)
  from space 11200K, 5% used [0x159b0000, 0x15a4dcb8, 0x164a0000)
  to space 11200K, 0% used [0x164a0000, 0x164a0000, 0x16f90000)
 tenured generation total 224368K, used 195358K [0x1aca0000, 0x287bc000, 0x30200000)
   the space 224368K, 87% used [0x1aca0000, 0x26b67b58, 0x26b67c00, 0x287bc000)
 compacting perm gen total 33536K, used 33521K [0x30200000, 0x322c0000, 0x34200000)
   the space 33536K, 99% used [0x30200000, 0x322bc618, 0x322bc800, 0x322c0000)
No shared spaces configured.
}
Event: 16373.559 GC heap before
{Heap before GC invocations=315 (full 10):
 def new generation total 100992K, used 90423K [0x10200000, 0x16f90000, 0x1aca0000)
  eden space 89792K, 100% used [0x10200000, 0x159b0000, 0x159b0000)
  from space 11200K, 5% used [0x159b0000, 0x15a4dcb8, 0x164a0000)
  to space 11200K, 0% used [0x164a0000, 0x164a0000, 0x16f90000)
 tenured generation total 224368K, used 195358K [0x1aca0000, 0x287bc000, 0x30200000)
   the space 224368K, 87% used [0x1aca0000, 0x26b67b58, 0x26b67c00, 0x287bc000)
 compacting perm gen total 33536K, used 33521K [0x30200000, 0x322c0000, 0x34200000)
   the space 33536K, 99% used [0x30200000, 0x322bc618, 0x322bc800, 0x322c0000)
No shared spaces configured.
Event: 16373.564 GC heap after
Heap after GC invocations=316 (full 10):
 def new generation total 100992K, used 580K [0x10200000, 0x16f90000, 0x1aca0000)
  eden space 89792K, 0% used [0x10200000, 0x10200000, 0x159b0000)
  from space 11200K, 5% used [0x164a0000, 0x16531318, 0x16f90000)
  to space 11200K, 0% used [0x159b0000, 0x159b0000, 0x164a0000)
 tenured generation total 224368K, used 195358K [0x1aca0000, 0x287bc000, 0x30200000)
   the space 224368K, 87% used [0x1aca0000, 0x26b67b58, 0x26b67c00, 0x287bc000)
 compacting perm gen total 33536K, used 33521K [0x30200000, 0x322c0000, 0x34200000)
   the space 33536K, 99% used [0x30200000, 0x322bc618, 0x322bc800, 0x322c0000)
No shared spaces configured.
}
Event: 16376.320 GC heap before
{Heap before GC invocations=316 (full 10):
 def new generation total 100992K, used 90372K [0x10200000, 0x16f90000, 0x1aca0000)
  eden space 89792K, 100% used [0x10200000, 0x159b0000, 0x159b0000)
  from space 11200K, 5% used [0x164a0000, 0x16531318, 0x16f90000)
  to space 11200K, 0% used [0x159b0000, 0x159b0000, 0x164a0000)
 tenured generation total 224368K, used 195358K [0x1aca0000, 0x287bc000, 0x30200000)
   the space 224368K, 87% used [0x1aca0000, 0x26b67b58, 0x26b67c00, 0x287bc000)
 compacting perm gen total 33536K, used 33521K [0x30200000, 0x322c0000, 0x34200000)
   the space 33536K, 99% used [0x30200000, 0x322bc618, 0x322bc800, 0x322c0000)
No shared spaces configured.
Event: 16376.324 GC heap after
Heap after GC invocations=317 (full 10):
 def new generation total 100992K, used 558K [0x10200000, 0x16f90000, 0x1aca0000)
  eden space 89792K, 0% used [0x10200000, 0x10200000, 0x159b0000)
  from space 11200K, 4% used [0x159b0000, 0x15a3bbb0, 0x164a0000)
  to space 11200K, 0% used [0x164a0000, 0x164a0000, 0x16f90000)
 tenured generation total 224368K, used 195359K [0x1aca0000, 0x287bc000, 0x30200000)
   the space 224368K, 87% used [0x1aca0000, 0x26b67ce8, 0x26b67e00, 0x287bc000)
 compacting perm gen total 33536K, used 33521K [0x30200000, 0x322c0000, 0x34200000)
   the space 33536K, 99% used [0x30200000, 0x322bc618, 0x322bc800, 0x322c0000)
No shared spaces configured.
}

Deoptimization events (0 events):
No events

Internal exceptions (10 events):
Event: 16196.857 Thread 0x0bb35400 Threw 0x122f4b20 at C:\re\jdk7u80\2329\hotspot\src\share\vm\prims\jni.cpp:743
Event: 16205.110 Thread 0x0b912c00 Threw 0x14c138b0 at C:\re\jdk7u80\2329\hotspot\src\share\vm\prims\jni.cpp:743
Event: 16205.125 Thread 0x0bb34c00 Threw 0x13d88100 at C:\re\jdk7u80\2329\hotspot\src\share\vm\prims\jni.cpp:743
Event: 16257.963 Thread 0x0bcb1400 Threw 0x11399108 at C:\re\jdk7u80\2329\hotspot\src\share\vm\prims\jni.cpp:743
Event: 16319.084 Thread 0x0b7c4000 Threw 0x12e04ca8 at C:\re\jdk7u80\2329\hotspot\src\share\vm\prims\jni.cpp:743
Event: 16325.121 Thread 0x0bb34800 Threw 0x14153bb0 at C:\re\jdk7u80\2329\hotspot\src\share\vm\prims\jni.cpp:743
Event: 16325.136 Thread 0x0b913800 Threw 0x1047b400 at C:\re\jdk7u80\2329\hotspot\src\share\vm\prims\jni.cpp:743
Event: 16354.124 Thread 0x0bb34000 Threw 0x1020fc08 at C:\re\jdk7u80\2329\hotspot\src\share\vm\prims\jni.cpp:743
Event: 16372.405 Thread 0x03a7cc00 Implicit null exception at 0x01a52117 to 0x01a522aa
Event: 16372.405 Thread 0x03a7cc00 Threw 0x13134388 at C:\re\jdk7u80\2329\hotspot\src\share\vm\runtime\sharedRuntime.cpp:591

Events (10 events):
Event: 16376.324 Executing VM operation: GenCollectForAllocation done
Event: 16376.325 Thread 0x0be61800 Thread exited: 0x0be61800
Event: 16376.325 Thread 0x0bcb2400 Thread added: 0x0bcb2400
Event: 16376.325 Thread 0x0bcb3000 Thread added: 0x0bcb3000
Event: 16376.326 Thread 0x0bcb2400 Thread exited: 0x0bcb2400
Event: 16376.326 Thread 0x0bcb3000 Thread exited: 0x0bcb3000
Event: 16376.326 Thread 0x0bcb3000 Thread added: 0x0bcb3000
Event: 16376.326 Thread 0x0bcb2400 Thread added: 0x0bcb2400
Event: 16376.326 Thread 0x0bcb2400 Thread exited: 0x0bcb2400
Event: 16376.327 Thread 0x0bcb3000 Thread exited: 0x0bcb3000


Dynamic libraries:
0x77090000 - 0x77210000 C:\Windows\SysWOW64\ntdll.dll
0x75d30000 - 0x75e40000 C:\Windows\syswow64\kernel32.dll
0x75f50000 - 0x75f97000 C:\Windows\syswow64\KERNELBASE.dll
0x74e30000 - 0x74ed1000 C:\Windows\syswow64\ADVAPI32.dll
0x74d70000 - 0x74e1c000 C:\Windows\syswow64\msvcrt.dll
0x752c0000 - 0x752d9000 C:\Windows\SysWOW64\sechost.dll
0x75e60000 - 0x75f50000 C:\Windows\syswow64\RPCRT4.dll
0x749f0000 - 0x74a50000 C:\Windows\syswow64\SspiCli.dll
0x749e0000 - 0x749ec000 C:\Windows\syswow64\CRYPTBASE.dll
0x752f0000 - 0x753f0000 C:\Windows\syswow64\USER32.dll
0x74ce0000 - 0x74d70000 C:\Windows\syswow64\GDI32.dll
0x759e0000 - 0x759ea000 C:\Windows\syswow64\LPK.dll
0x75ad0000 - 0x75b6d000 C:\Windows\syswow64\USP10.dll
0x73d40000 - 0x73ede000 C:\Windows\WinSxS\x86_microsoft.windows.common-controls_6595b64144ccf1df_6.0.7601.18837_none_41e855142bd5705d\COMCTL32.dll
0x74c80000 - 0x74cd7000 C:\Windows\syswow64\SHLWAPI.dll
0x74a70000 - 0x74ad0000 C:\Windows\system32\IMM32.DLL
0x75680000 - 0x7574c000 C:\Windows\syswow64\MSCTF.dll
0x6ed00000 - 0x6edbf000 c:\Program Files (x86)\EDCO
0x742c0000 - 0x742c7000 C:\Windows\system32\WSOCK32.dll
0x74ee0000 - 0x74f15000 C:\Windows\syswow64\WS2_32.dll
0x75550000 - 0x75556000 C:\Windows\syswow64\NSI.dll
0x74280000 - 0x742b2000 C:\Windows\system32\WINMM.dll
0x74e20000 - 0x74e25000 C:\Windows\syswow64\PSAPI.DLL
0x745f0000 - 0x7462c000 C:\Windows\system32\MSWSOCK.dll
0x745e0000 - 0x745e6000 C:\Windows\System32\wship6.dll
0x74670000 - 0x74687000 C:\Windows\system32\CRYPTSP.dll
0x74630000 - 0x7466b000 C:\Windows\system32\rsaenh.dll
0x74a50000 - 0x74a67000 C:\Windows\syswow64\USERENV.dll
0x759f0000 - 0x759fb000 C:\Windows\syswow64\profapi.dll
0x74450000 - 0x7446c000 C:\Windows\system32\IPHLPAPI.DLL
0x74440000 - 0x74447000 C:\Windows\system32\WINNSI.DLL
0x73640000 - 0x7364d000 C:\Windows\system32\dhcpcsvc6.DLL
0x73620000 - 0x73632000 C:\Windows\system32\dhcpcsvc.DLL
0x74470000 - 0x74475000 C:\Windows\System32\wshtcpip.dll
0x74490000 - 0x744d4000 C:\Windows\system32\DNSAPI.dll
0x743f0000 - 0x743f6000 C:\Windows\system32\rasadhlp.dll
0x74400000 - 0x74438000 C:\Windows\System32\fwpuclnt.dll
0x744f0000 - 0x74500000 C:\Windows\system32\NLAapi.dll
0x744e0000 - 0x744f0000 C:\Windows\system32\napinsp.dll
0x74480000 - 0x74488000 C:\Windows\System32\winrnr.dll
0x70150000 - 0x7018c000 C:\Windows\system32\pdh.dll
0x6fbe0000 - 0x6fc01000 C:\Windows\system32\ntmarta.dll
0x75a80000 - 0x75ac5000 C:\Windows\syswow64\WLDAP32.dll
0x72340000 - 0x7234b000 C:\Windows\System32\perfproc.dll
0x722c0000 - 0x722c9000 C:\Windows\System32\perfos.dll
0x5eb80000 - 0x5ec6b000 C:\Windows\system32\DBGHELP.DLL

VM Arguments: ...
Launcher Type: SUN_STANDARD

Environment Variables: ...


--------------- S Y S T E M ---------------

OS: Windows Server 2008 R2 , 64 bit Build 7601 Service Pack 1

CPU:total 2 (2 cores per cpu, 1 threads per core) family 6 model 26 stepping 4, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, tsc, tscinvbit, tscinv

Memory: 4k page, physical 8388152k(2694944k free), swap 16774468k(10321108k free)

vm_info: Java HotSpot(TM) Client VM (24.80-b11) for windows-x86 JRE (1.7.0_80-b15), built on Apr 10 2015 13:33:35 by "java_re" with unknown MS VC++:1600

time: Mon Apr 11 15:36:24 2016
elapsed time: 16378 seconds

Notes
(0006720)
ferg   
11-04-16 13:50   
Socket JNI disabled on windows unless OpenSSL is required.