Mantis - Resin
Viewing Issue Advanced Details
5916 minor always 06-11-15 14:02 11-18-16 13:26
alex  
ferg  
normal  
closed 4.0.44  
fixed  
none    
none 4.0.50  
0005916: OPENSSL: SIGSEGV
Current thread (0x00007fee9005f800): JavaThread "resin-port-8443-66" daemon [_thread_in_native, id=18247, stack(0x00007fee81aeb000,0x00007fee81bec000)]

siginfo:si_signo=SIGSEGV: si_errno=0, si_code=2 (SEGV_ACCERR), si_addr=0x00007fee9c000178

Registers:
RAX=0x00007fee9c000128, RBX=0x00007fee9c021460, RCX=0x0000000000000001, RDX=0x0000000000000046
RSP=0x00007fee81be5c38, RBP=0x0000000000000002, RSI=0x0000000000000002, RDI=0x0000000000000046
R8 =0x00000000000001d5, R9 =0x0000000000004747, R10=0x0000000000000000, R11=0x0000000000000000
R12=0x0000000000000303, R13=0x000000009c0310b3, R14=0x00007fee9c022d70, R15=0x0000000000008400
RIP=0x00007fee9c000178, EFLAGS=0x0000000000010202, CSGSFS=0x0000000000000033, ERR=0x0000000000000015
  TRAPNO=0x000000000000000e

Top of Stack: (sp=0x00007fee81be5c38)
0x00007fee81be5c38: 00000039dce2b2b8 00007fee9c021460
0x00007fee81be5c48: 00007fee9c021720 0000000000000303
0x00007fee81be5c58: 00000039dce2c365 0000000000000003
0x00007fee81be5c68: 0000000000000000 0000000000000003
0x00007fee81be5c78: 0000000000008540 0000000000008000
0x00007fee81be5c88: 000000179c021460 00007fee9c021720
0x00007fee81be5c98: 00007fee81be5d20 0000000000000000
0x00007fee81be5ca8: 00007fee9c021460 000000000000000b
0x00007fee81be5cb8: 00007fee9c021840 0000000000000002
0x00007fee81be5cc8: 00007fee81be5ce0 000020000000010d
0x00007fee81be5cd8: 00007fee81be5e60 00007fee9c03eb20
0x00007fee81be5ce8: 0000003cf94dccc9 00007fee9c00f370
0x00007fee81be5cf8: 0000003cf94dc5bd 0100011401010316
0x00007fee81be5d08: 0000003cf9030310 0000000000006000
0x00007fee81be5d18: d2e11e95ed16aaaf 0000000000004000
0x00007fee81be5d28: 00007fee9c021460 0000000000000000
0x00007fee81be5d38: 0000000000002210 0000000000002210
0x00007fee81be5d48: 00007fee81be5e60 000000000000010d
0x00007fee81be5d58: 00000039dce30013 0000000000000000
0x00007fee81be5d68: d2e11e95ed16aaaf 00007fee9c021460
0x00007fee81be5d78: 00007fee9c021460 0000000000002000
0x00007fee81be5d88: 0000000000000000 00007fee81be5e60
0x00007fee81be5d98: 00007fee81be5e60 000000000000010d
0x00007fee81be5da8: 00000039dce27ec0 00007fee98dfd840
0x00007fee81be5db8: 00007fee98dfd840 00007fee81be5e40
0x00007fee81be5dc8: 0000000000000020 0000000000002000
0x00007fee81be5dd8: 00007feeacf6a401 0a3e766900000000
0x00007fee81be5de8: 0001d4c000000000 00007fee9c021460
0x00007fee81be5df8: 00007fee81beb6a8 0909090a00000000
0x00007fee81be5e08: 2f3c0a0a00000000 69643c0a3e766964
0x00007fee81be5e18: 0000000000000000 0000000000000000
0x00007fee81be5e28: 00007fee81be9f68 00007fee9005f9d8

Instructions: (pc=0x00007fee9c000178)
0x00007fee9c000158: 48 01 00 9c ee 7f 00 00 48 01 00 9c ee 7f 00 00
0x00007fee9c000168: 58 01 00 9c ee 7f 00 00 58 01 00 9c ee 7f 00 00
0x00007fee9c000178: 68 01 00 9c ee 7f 00 00 68 01 00 9c ee 7f 00 00
0x00007fee9c000188: 78 01 00 9c ee 7f 00 00 78 01 00 9c ee 7f 00 00

Register to memory mapping:

RAX=0x00007fee9c000128 is an unknown value
RBX=0x00007fee9c021460 is an unknown value
RCX=0x0000000000000001 is an unknown value
RDX=0x0000000000000046 is an unknown value
RSP=0x00007fee81be5c38 is pointing into the stack for thread: 0x00007fee9005f800
RBP=0x0000000000000002 is an unknown value
RSI=0x0000000000000002 is an unknown value
RDI=0x0000000000000046 is an unknown value
R8 =0x00000000000001d5 is an unknown value
R9 =0x0000000000004747 is an unknown value
R10=0x0000000000000000 is an unknown value
R11=0x0000000000000000 is an unknown value
R12=0x0000000000000303 is an unknown value
R13=0x000000009c0310b3 is an unknown value
R14=0x00007fee9c022d70 is an unknown value
R15=0x0000000000008400 is an unknown value


Stack: [0x00007fee81aeb000,0x00007fee81bec000], sp=0x00007fee81be5c38, free space=1003k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C 0x00007fee9c000178

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j com.caucho.vfs.JniSocketImpl.readNative(J[BIIJ)I+0
j com.caucho.vfs.JniSocketImpl.read([BIIJ)I+135
j com.caucho.vfs.JniStream.read([BII)I+54
J 1020 C2 com.caucho.vfs.ReadStream.readBuffer()Z (111 bytes) @ 0x00007feeb4c72fb8 [0x00007feeb4c72f60+0x58]
J 2490 C2 com.caucho.server.http.HttpRequest.readRequest(Lcom/caucho/vfs/ReadStream;)Z (994 bytes) @ 0x00007feeb50a1028 [0x00007feeb50a0fc0+0x68]
j com.caucho.server.http.HttpRequest.parseRequest()Z+7
j com.caucho.server.http.HttpRequest.handleRequest()Z+51
j com.caucho.network.listen.TcpSocketLink.dispatchRequest()V+98
j com.caucho.network.listen.TcpSocketLink.handleRequest()Lcom/caucho/network/listen/RequestState;+1
j com.caucho.network.listen.TcpSocketLink.handleRequestsImpl(Z)Lcom/caucho/network/listen/RequestState;+48
j com.caucho.network.listen.TcpSocketLink.handleRequests(Z)Lcom/caucho/network/listen/RequestState;+11
j com.caucho.network.listen.TcpSocketLink.handleAcceptTaskImpl()Lcom/caucho/network/listen/RequestState;+180
j com.caucho.network.listen.ConnectionTask.runThread()V+54
j com.caucho.network.listen.ConnectionTask.run()V+19
j com.caucho.network.listen.SocketLinkThreadLauncher.handleTasks(Z)V+108
j com.caucho.network.listen.TcpSocketAcceptThread.run()V+61
j com.caucho.env.thread2.ResinThread2.runTasks()V+158
j com.caucho.env.thread2.ResinThread2.run()V+15
v ~StubRoutines::call_stub


Notes
(0006718)
stoty   
09-02-16 06:25   
I have a similar crash about twice a week:

Centos 7
openssl-1.0.1e-51.el7_2.5.x86_64
java-1.8.0-openjdk-1.8.0.91-0.b14.el7_2.x86_64
resin 4.0.48

#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00007f70d1d419c0, pid=7502, tid=140122009892608
#
# JRE version: OpenJDK Runtime Environment (8.0_91-b14) (build 1.8.0_91-b14)
# Java VM: OpenJDK 64-Bit Server VM (25.91-b14 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C [libssl.so.10+0x299c0]
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
# http://bugreport.java.com/bugreport/crash.jsp [^]
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

--------------- T H R E A D ---------------

Current thread (0x00007f701c0e9800): JavaThread "resin-port-176.32.200.14:443-247" daemon [_thread_in_native, id=20894, stack(0x00007f70b28ff000,0x00007f70b2a00000)]

siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr: 0x00000000000001e8

Registers:
RAX=0x0000000000000000, RBX=0x00007f6ee85abc60, RCX=0xffffffffffffffff, RDX=0x0000000000000000
RSP=0x00007f70b29fa0d0, RBP=0x00007f70b29fa170, RSI=0x00000000fffffff0, RDI=0x0000000000000000
R8 =0x0000000000000003, R9 =0x0000000000002000, R10=0x00007f70e8578ed3, R11=0x0000000000000000
R12=0x0000000000002000, R13=0x0000000000000000, R14=0x0000000000002000, R15=0x00007f6f9c002f10
RIP=0x00007f70d1d419c0, EFLAGS=0x0000000000010213, CSGSFS=0x3c2e000000000033, ERR=0x0000000000000006
  TRAPNO=0x000000000000000e

Top of Stack: (sp=0x00007f70b29fa0d0)
0x00007f70b29fa0d0: 00007f70b29fa150 0000000000000021
0x00007f70b29fa0e0: 00007f70b29fa160 00007f70b29ff680
0x00007f70b29fa0f0: 00007f6ee85abc60 00007f70d1f92eb7
0x00007f70b29fa100: 09090909090a3e6e 0909090909090909
0x00007f70b29fa110: 0001d4c0000000e0 00007f70b29fa170
0x00007f70b29fa120: 206e6f6974706f3c 00000000000001c6
0x00007f70b29fa130: 0000000000000000 0000000000002000
0x00007f70b29fa140: 0000000000000000 00007f70b29fe1c8
0x00007f70b29fa150: 00007f701c0e99e0 00007f70b29fa170
0x00007f70b29fa160: 00007f70b29fe1a0 00007f70d8f90b3d
0x00007f70b29fa170: 63666e2f20544547 78787878782f6d72
0x00007f70b29fa180: 736567616d692f78 72656e6e6970732f
0x00007f70b29fa190: 545448206669672e 480a0d312e312f50
0x00007f70b29fa1a0: 6d7263203a74736f 656e6f6674656e2e
0x00007f70b29fa1b0: 2e6d6f63656c6574 726573550a0d7568
0x00007f70b29fa1c0: 203a746e6567412d 2f616c6c697a6f4d
0x00007f70b29fa1d0: 3131582820302e35 75746e756255203b
0x00007f70b29fa1e0: 2078756e694c203b 203b34365f363878
0x00007f70b29fa1f0: 29302e36343a7672 322f6f6b63654720
0x00007f70b29fa200: 2031303130303130 2f786f6665726946
0x00007f70b29fa210: 63410a0d302e3634 6d69203a74706563
0x00007f70b29fa220: 2c676e702f656761 3b2a2f6567616d69
0x00007f70b29fa230: 2f2a2c382e303d71 0d352e303d713b2a
0x00007f70b29fa240: 2d7470656363410a 65676175676e614c
0x00007f70b29fa250: 2c53552d6e65203a 352e303d713b6e65
0x00007f70b29fa260: 7470656363410a0d 6e69646f636e452d
0x00007f70b29fa270: 2c70697a67203a67 6574616c66656420
0x00007f70b29fa280: 65520a0d7262202c 68203a7265726566
0x00007f70b29fa290: 632f2f3a73707474 6f6674656e2e6d72
0x00007f70b29fa2a0: 6f63656c6574656e 63666e2f75682e6d
0x00007f70b29fa2b0: 656b6369742f6d72 6a2e746964655f74
0x00007f70b29fa2c0: 33333d64693f7073 430a0d3432303830

Instructions: (pc=0x00007f70d1d419c0)
0x00007f70d1d419a0: 48 89 ea 45 89 e8 44 89 e1 be 17 00 00 00 48 89
0x00007f70d1d419b0: df ff 50 68 83 f8 ff 48 8b 93 80 00 00 00 74 30
0x00007f70d1d419c0: c7 82 e8 01 00 00 00 00 00 00 48 83 c4 08 5b 5d
0x00007f70d1d419d0: 41 5c 41 5d c3 0f 1f 00 48 89 df e8 20 fe ff ff

Register to memory mapping:

RAX=0x0000000000000000 is an unknown value
RBX=0x00007f6ee85abc60 is an unknown value
RCX=0xffffffffffffffff is an unknown value
RDX=0x0000000000000000 is an unknown value
RSP=0x00007f70b29fa0d0 is pointing into the stack for thread: 0x00007f701c0e9800
RBP=0x00007f70b29fa170 is pointing into the stack for thread: 0x00007f701c0e9800
RSI=0x00000000fffffff0 is an unknown value
RDI=0x0000000000000000 is an unknown value
R8 =0x0000000000000003 is an unknown value
R9 =0x0000000000002000 is an unknown value
R10=0x00007f70e8578ed3 is at entry_point+83 in (nmethod*)0x00007f70e8578d10
R11=0x0000000000000000 is an unknown value
R12=0x0000000000002000 is an unknown value
R13=0x0000000000000000 is an unknown value
R14=0x0000000000002000 is an unknown value
R15=0x00007f6f9c002f10 is an unknown value


Stack: [0x00007f70b28ff000,0x00007f70b2a00000], sp=0x00007f70b29fa0d0, free space=1004k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C [libssl.so.10+0x299c0]
C 0x78787878782f6d72

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
J 18979 com.caucho.vfs.JniSocketImpl.readNative(J[BIIJ)I (0 bytes) @ 0x00007f70e8578ed3 [0x00007f70e8578e80+0x53]
J 34171 C2 com.caucho.vfs.ReadStream.fillWithTimeout(J)I (148 bytes) @ 0x00007f70e8d7a0a8 [0x00007f70e8d79f00+0x1a8]
J 34173 C2 com.caucho.network.listen.TcpSocketLink.processKeepalive()Lcom/caucho/network/listen/RequestState; (304 bytes) @ 0x00007f70eae8ee88 [0x00007f70eae8ec60+0x228]
J 25461 C1 com.caucho.network.listen.TcpSocketLink.handleRequestsImpl(Z)Lcom/caucho/network/listen/RequestState; (101 bytes) @ 0x00007f70e8715044 [0x00007f70e8714ae0+0x564]
J 25460 C1 com.caucho.network.listen.TcpSocketLink.handleRequests(Z)Lcom/caucho/network/listen/RequestState; (402 bytes) @ 0x00007f70e873f12c [0x00007f70e873f000+0x12c]
J 36029 C1 com.caucho.network.listen.TcpSocketLink.handleAcceptTaskImpl()Lcom/caucho/network/listen/RequestState; (321 bytes) @ 0x00007f70eb2d4264 [0x00007f70eb2d1a00+0x2864]
j com.caucho.network.listen.ConnectionTask.runThread()V+54
j com.caucho.network.listen.ConnectionTask.run()V+19
j com.caucho.network.listen.SocketLinkThreadLauncher.handleTasks(Z)V+108
j com.caucho.network.listen.TcpSocketAcceptThread.run()V+61
J 21432 C1 com.caucho.env.thread2.ResinThread2.runTasks()V (232 bytes) @ 0x00007f70e8cc2c14 [0x00007f70e8cc0720+0x24f4]
j com.caucho.env.thread2.ResinThread2.run()V+15
v ~StubRoutines::call_stub

(0006719)
stoty   
09-19-16 01:55   
I have re-checked my crash logs, and they are always generated when I shutdown the server.

So at least in my case, this looks identical to bug 5918
(0006725)
ferg   
11-18-16 13:26   
Add check in ssl_read for closed server socket.