0005912: can't serialize session with java.lang.IllegalStateException: block Block

5912

minor

always

05-27-15 00:55

06-03-15 09:30

Reporter:

wesleywu

Platform:

Assigned To:

ferg

OS:

Priority:

normal

OS Version:

Status:

closed

Product Version:

4.0.40

Product Build:

Resolution:

fixed

Projection:

none

ETA:

none

Fixed in Version:

4.0.45

Summary:

0005912: can't serialize session with java.lang.IllegalStateException: block Block

Description:

We're using resin 4.0.40 non-pro version.

After a few days running, resin throws logs in resin.log and refuse to accept further connections with 500 status code.

log snippet:

[15-05-27 09:44:28.308] {resin-port-8110-27} SessionImpl[aaaIsDW4c95En4hMHjs2u,]: can't serialize session
                       java.lang.IllegalStateException: block Block[Table[mnode:2,/usr/local/allbuy-server/resin-allbuy-web/resin-data/app-0/distcac
he/mnode.db],4c002,copy=false,load=true,dirty=true] is not an index code=0
                        at com.caucho.db.block.Block.validateIsIndex(Block.java:156)
                        at com.caucho.db.index.BTree.validateIndex(BTree.java:1734)
                        at com.caucho.db.index.BTree.lookup(BTree.java:199)
                        at com.caucho.db.index.BTree.lookup(BTree.java:214)
                        at com.caucho.db.index.BTree.lookup(BTree.java:170)
                        at com.caucho.db.sql.IndexExpr.evalIndex(IndexExpr.java:152)
                        at com.caucho.db.sql.IndexExpr.initRow(IndexExpr.java:104)
                        at com.caucho.db.sql.Query$TailInitRow.initBlockRow(Query.java:952)
                        at com.caucho.db.sql.Query.start(Query.java:727)
                        at com.caucho.db.sql.SelectQuery.execute(SelectQuery.java:209)
                        at com.caucho.db.sql.SelectQuery.execute(SelectQuery.java:171)
                        at com.caucho.db.jdbc.PreparedStatementImpl.execute(PreparedStatementImpl.java:357)
                        at com.caucho.db.jdbc.PreparedStatementImpl.executeQuery(PreparedStatementImpl.java:325)
                        at com.caucho.server.distcache.MnodeStore.load(MnodeStore.java:551)
                        at com.caucho.server.distcache.CacheDataBackingImpl.loadLocalEntryValue(CacheDataBackingImpl.java:146)
                        at com.caucho.server.distcache.DistCacheEntry.loadLocalMnodeValue(DistCacheEntry.java:1509)
                        at com.caucho.server.distcache.CacheEntryManager.createCacheEntry(CacheEntryManager.java:83)
                        at com.caucho.server.distcache.CacheStoreManager.getCacheEntry(CacheStoreManager.java:153)
                        at com.caucho.server.distcache.CacheImpl.getDistCacheEntry(CacheImpl.java:690)
                        at com.caucho.server.distcache.CacheImpl.put(CacheImpl.java:486)
                        at com.caucho.server.session.SessionImpl.save(SessionImpl.java:912)
                        at com.caucho.server.session.SessionImpl.saveAfterRequest(SessionImpl.java:873)
                        at com.caucho.server.session.SessionImpl.finishRequest(SessionImpl.java:645)
                        at com.caucho.server.http.AbstractCauchoRequest.finishRequest(AbstractCauchoRequest.java:1061)
                        at com.caucho.server.http.HttpServletRequestImpl.finishRequest(HttpServletRequestImpl.java:1715)
                        at com.caucho.server.http.AbstractHttpRequest.finishRequest(AbstractHttpRequest.java:1856)
                        at com.caucho.server.http.HttpRequest.finishRequest(HttpRequest.java:1495)
                        at com.caucho.server.http.HttpRequest.handleRequest(HttpRequest.java:870)
                        at com.caucho.network.listen.TcpSocketLink.dispatchRequest(TcpSocketLink.java:1346)
                        at com.caucho.network.listen.TcpSocketLink.handleRequest(TcpSocketLink.java:1302)
                        at com.caucho.network.listen.TcpSocketLink.handleRequestsImpl(TcpSocketLink.java:1286)
                        at com.caucho.network.listen.TcpSocketLink.handleRequests(TcpSocketLink.java:1194)
                        at com.caucho.network.listen.TcpSocketLink.handleAcceptTaskImpl(TcpSocketLink.java:993)
                        at com.caucho.network.listen.ConnectionTask.runThread(ConnectionTask.java:117)
                        at com.caucho.network.listen.ConnectionTask.run(ConnectionTask.java:93)
                        at com.caucho.network.listen.SocketLinkThreadLauncher.handleTasks(SocketLinkThreadLauncher.java:169)
                        at com.caucho.network.listen.TcpSocketAcceptThread.run(TcpSocketAcceptThread.java:61)
                        at com.caucho.env.thread2.ResinThread2.runTasks(ResinThread2.java:173)
                        at com.caucho.env.thread2.ResinThread2.run(ResinThread2.java:118)

[15-05-27 09:44:29.040] {resin-port-8110-23} java.lang.IllegalStateException: block Block[Table[mnode:2,/usr/local/allbuy-server/resin-allbuy-web/resin-data/app-0/distcache/mnode.db],d4002,copy=false,load=false,dirty=false] is not an index code=0
                        at com.caucho.db.block.Block.validateIsIndex(Block.java:156)
                        at com.caucho.db.index.BTree.validateIndex(BTree.java:1734)
                        at com.caucho.db.index.BTree.lookup(BTree.java:199)
                        at com.caucho.db.index.BTree.lookup(BTree.java:214)
                        at com.caucho.db.index.BTree.lookup(BTree.java:170)
                        at com.caucho.db.sql.IndexExpr.evalIndex(IndexExpr.java:152)
                        at com.caucho.db.sql.IndexExpr.initRow(IndexExpr.java:104)
                        at com.caucho.db.sql.Query$TailInitRow.initBlockRow(Query.java:952)
                        at com.caucho.db.sql.Query.start(Query.java:727)
                        at com.caucho.db.sql.SelectQuery.execute(SelectQuery.java:209)
                        at com.caucho.db.sql.SelectQuery.execute(SelectQuery.java:171)
                        at com.caucho.db.jdbc.PreparedStatementImpl.execute(PreparedStatementImpl.java:357)
                        at com.caucho.db.jdbc.PreparedStatementImpl.executeQuery(PreparedStatementImpl.java:325)
                        at com.caucho.server.distcache.MnodeStore.load(MnodeStore.java:551)
                        at com.caucho.server.distcache.CacheDataBackingImpl.loadLocalEntryValue(CacheDataBackingImpl.java:146)
                        at com.caucho.server.distcache.DistCacheEntry.loadLocalMnodeValue(DistCacheEntry.java:1509)
                        at com.caucho.server.distcache.DistCacheEntry.loadMnodeValue(DistCacheEntry.java:1038)
                        at com.caucho.server.distcache.DistCacheEntry.loadMnodeValue(DistCacheEntry.java:188)
                        at com.caucho.server.distcache.CacheImpl.getExtCacheEntry(CacheImpl.java:365)
                        at com.caucho.server.session.SessionManager.createSession(SessionManager.java:1414)
                        at com.caucho.server.http.AbstractCauchoRequest.createSession(AbstractCauchoRequest.java:701)
                        at com.caucho.server.http.AbstractCauchoRequest.getSession(AbstractCauchoRequest.java:643)
                        at com.caucho.server.http.AbstractCauchoRequest.getSession(AbstractCauchoRequest.java:620)
                        at com.allbuy.web.common.filter.InitContextFilter.initSession(InitContextFilter.java:393)
                        at com.allbuy.web.common.filter.InitContextFilter.doFilter(InitContextFilter.java:74)
                        at com.caucho.server.dispatch.FilterFilterChain.doFilter(FilterFilterChain.java:89)
                        at org.jwing.mvc.servlet.filters.encoding.EnhancedEncodingFilter.doFilter(EnhancedEncodingFilter.java:91)
                        at com.caucho.server.dispatch.FilterFilterChain.doFilter(FilterFilterChain.java:89)
                        at com.caucho.server.webapp.WebAppListenerFilterChain.doFilter(WebAppListenerFilterChain.java:114)
                        at com.caucho.server.webapp.WebAppFilterChain.doFilter(WebAppFilterChain.java:156)
                        at com.caucho.server.webapp.AccessLogFilterChain.doFilter(AccessLogFilterChain.java:95)
                        at com.caucho.server.dispatch.ServletInvocation.service(ServletInvocation.java:289)
                        at com.caucho.server.http.HttpRequest.handleRequest(HttpRequest.java:838)
                        at com.caucho.network.listen.TcpSocketLink.dispatchRequest(TcpSocketLink.java:1346)
                        at com.caucho.network.listen.TcpSocketLink.handleRequest(TcpSocketLink.java:1302)
                        at com.caucho.network.listen.TcpSocketLink.handleRequestsImpl(TcpSocketLink.java:1286)
                        at com.caucho.network.listen.TcpSocketLink.handleRequests(TcpSocketLink.java:1194)
                        at com.caucho.network.listen.TcpSocketLink.handleAcceptTaskImpl(TcpSocketLink.java:993)
                        at com.caucho.network.listen.ConnectionTask.runThread(ConnectionTask.java:117)
                        at com.caucho.network.listen.ConnectionTask.run(ConnectionTask.java:93)
                        at com.caucho.network.listen.SocketLinkThreadLauncher.handleTasks(SocketLinkThreadLauncher.java:169)
                        at com.caucho.network.listen.TcpSocketAcceptThread.run(TcpSocketAcceptThread.java:61)
                        at com.caucho.env.thread2.ResinThread2.runTasks(ResinThread2.java:173)
                        at com.caucho.env.thread2.ResinThread2.run(ResinThread2.java:118)

Steps To Reproduce:

Additional Information:

Relationships

Attached Files:

Mantis - Resin
Viewing Issue Advanced Details

ID:	Category:	Severity:	Reproducibility:	Date Submitted:	Last Update:
5912		minor	always	05-27-15 00:55	06-03-15 09:30

Reporter:	wesleywu	Platform:
Assigned To:	ferg	OS:
Priority:	normal	OS Version:
Status:	closed	Product Version:	4.0.40
Product Build:		Resolution:	fixed
Projection:	none
ETA:	none	Fixed in Version:	4.0.45

Summary:	0005912: can't serialize session with java.lang.IllegalStateException: block Block
Description:	We're using resin 4.0.40 non-pro version. After a few days running, resin throws logs in resin.log and refuse to accept further connections with 500 status code. log snippet: [15-05-27 09:44:28.308] {resin-port-8110-27} SessionImpl[aaaIsDW4c95En4hMHjs2u,]: can't serialize session java.lang.IllegalStateException: block Block[Table[mnode:2,/usr/local/allbuy-server/resin-allbuy-web/resin-data/app-0/distcac he/mnode.db],4c002,copy=false,load=true,dirty=true] is not an index code=0 at com.caucho.db.block.Block.validateIsIndex(Block.java:156) at com.caucho.db.index.BTree.validateIndex(BTree.java:1734) at com.caucho.db.index.BTree.lookup(BTree.java:199) at com.caucho.db.index.BTree.lookup(BTree.java:214) at com.caucho.db.index.BTree.lookup(BTree.java:170) at com.caucho.db.sql.IndexExpr.evalIndex(IndexExpr.java:152) at com.caucho.db.sql.IndexExpr.initRow(IndexExpr.java:104) at com.caucho.db.sql.Query$TailInitRow.initBlockRow(Query.java:952) at com.caucho.db.sql.Query.start(Query.java:727) at com.caucho.db.sql.SelectQuery.execute(SelectQuery.java:209) at com.caucho.db.sql.SelectQuery.execute(SelectQuery.java:171) at com.caucho.db.jdbc.PreparedStatementImpl.execute(PreparedStatementImpl.java:357) at com.caucho.db.jdbc.PreparedStatementImpl.executeQuery(PreparedStatementImpl.java:325) at com.caucho.server.distcache.MnodeStore.load(MnodeStore.java:551) at com.caucho.server.distcache.CacheDataBackingImpl.loadLocalEntryValue(CacheDataBackingImpl.java:146) at com.caucho.server.distcache.DistCacheEntry.loadLocalMnodeValue(DistCacheEntry.java:1509) at com.caucho.server.distcache.CacheEntryManager.createCacheEntry(CacheEntryManager.java:83) at com.caucho.server.distcache.CacheStoreManager.getCacheEntry(CacheStoreManager.java:153) at com.caucho.server.distcache.CacheImpl.getDistCacheEntry(CacheImpl.java:690) at com.caucho.server.distcache.CacheImpl.put(CacheImpl.java:486) at com.caucho.server.session.SessionImpl.save(SessionImpl.java:912) at com.caucho.server.session.SessionImpl.saveAfterRequest(SessionImpl.java:873) at com.caucho.server.session.SessionImpl.finishRequest(SessionImpl.java:645) at com.caucho.server.http.AbstractCauchoRequest.finishRequest(AbstractCauchoRequest.java:1061) at com.caucho.server.http.HttpServletRequestImpl.finishRequest(HttpServletRequestImpl.java:1715) at com.caucho.server.http.AbstractHttpRequest.finishRequest(AbstractHttpRequest.java:1856) at com.caucho.server.http.HttpRequest.finishRequest(HttpRequest.java:1495) at com.caucho.server.http.HttpRequest.handleRequest(HttpRequest.java:870) at com.caucho.network.listen.TcpSocketLink.dispatchRequest(TcpSocketLink.java:1346) at com.caucho.network.listen.TcpSocketLink.handleRequest(TcpSocketLink.java:1302) at com.caucho.network.listen.TcpSocketLink.handleRequestsImpl(TcpSocketLink.java:1286) at com.caucho.network.listen.TcpSocketLink.handleRequests(TcpSocketLink.java:1194) at com.caucho.network.listen.TcpSocketLink.handleAcceptTaskImpl(TcpSocketLink.java:993) at com.caucho.network.listen.ConnectionTask.runThread(ConnectionTask.java:117) at com.caucho.network.listen.ConnectionTask.run(ConnectionTask.java:93) at com.caucho.network.listen.SocketLinkThreadLauncher.handleTasks(SocketLinkThreadLauncher.java:169) at com.caucho.network.listen.TcpSocketAcceptThread.run(TcpSocketAcceptThread.java:61) at com.caucho.env.thread2.ResinThread2.runTasks(ResinThread2.java:173) at com.caucho.env.thread2.ResinThread2.run(ResinThread2.java:118) [15-05-27 09:44:29.040] {resin-port-8110-23} java.lang.IllegalStateException: block Block[Table[mnode:2,/usr/local/allbuy-server/resin-allbuy-web/resin-data/app-0/distcache/mnode.db],d4002,copy=false,load=false,dirty=false] is not an index code=0 at com.caucho.db.block.Block.validateIsIndex(Block.java:156) at com.caucho.db.index.BTree.validateIndex(BTree.java:1734) at com.caucho.db.index.BTree.lookup(BTree.java:199) at com.caucho.db.index.BTree.lookup(BTree.java:214) at com.caucho.db.index.BTree.lookup(BTree.java:170) at com.caucho.db.sql.IndexExpr.evalIndex(IndexExpr.java:152) at com.caucho.db.sql.IndexExpr.initRow(IndexExpr.java:104) at com.caucho.db.sql.Query$TailInitRow.initBlockRow(Query.java:952) at com.caucho.db.sql.Query.start(Query.java:727) at com.caucho.db.sql.SelectQuery.execute(SelectQuery.java:209) at com.caucho.db.sql.SelectQuery.execute(SelectQuery.java:171) at com.caucho.db.jdbc.PreparedStatementImpl.execute(PreparedStatementImpl.java:357) at com.caucho.db.jdbc.PreparedStatementImpl.executeQuery(PreparedStatementImpl.java:325) at com.caucho.server.distcache.MnodeStore.load(MnodeStore.java:551) at com.caucho.server.distcache.CacheDataBackingImpl.loadLocalEntryValue(CacheDataBackingImpl.java:146) at com.caucho.server.distcache.DistCacheEntry.loadLocalMnodeValue(DistCacheEntry.java:1509) at com.caucho.server.distcache.DistCacheEntry.loadMnodeValue(DistCacheEntry.java:1038) at com.caucho.server.distcache.DistCacheEntry.loadMnodeValue(DistCacheEntry.java:188) at com.caucho.server.distcache.CacheImpl.getExtCacheEntry(CacheImpl.java:365) at com.caucho.server.session.SessionManager.createSession(SessionManager.java:1414) at com.caucho.server.http.AbstractCauchoRequest.createSession(AbstractCauchoRequest.java:701) at com.caucho.server.http.AbstractCauchoRequest.getSession(AbstractCauchoRequest.java:643) at com.caucho.server.http.AbstractCauchoRequest.getSession(AbstractCauchoRequest.java:620) at com.allbuy.web.common.filter.InitContextFilter.initSession(InitContextFilter.java:393) at com.allbuy.web.common.filter.InitContextFilter.doFilter(InitContextFilter.java:74) at com.caucho.server.dispatch.FilterFilterChain.doFilter(FilterFilterChain.java:89) at org.jwing.mvc.servlet.filters.encoding.EnhancedEncodingFilter.doFilter(EnhancedEncodingFilter.java:91) at com.caucho.server.dispatch.FilterFilterChain.doFilter(FilterFilterChain.java:89) at com.caucho.server.webapp.WebAppListenerFilterChain.doFilter(WebAppListenerFilterChain.java:114) at com.caucho.server.webapp.WebAppFilterChain.doFilter(WebAppFilterChain.java:156) at com.caucho.server.webapp.AccessLogFilterChain.doFilter(AccessLogFilterChain.java:95) at com.caucho.server.dispatch.ServletInvocation.service(ServletInvocation.java:289) at com.caucho.server.http.HttpRequest.handleRequest(HttpRequest.java:838) at com.caucho.network.listen.TcpSocketLink.dispatchRequest(TcpSocketLink.java:1346) at com.caucho.network.listen.TcpSocketLink.handleRequest(TcpSocketLink.java:1302) at com.caucho.network.listen.TcpSocketLink.handleRequestsImpl(TcpSocketLink.java:1286) at com.caucho.network.listen.TcpSocketLink.handleRequests(TcpSocketLink.java:1194) at com.caucho.network.listen.TcpSocketLink.handleAcceptTaskImpl(TcpSocketLink.java:993) at com.caucho.network.listen.ConnectionTask.runThread(ConnectionTask.java:117) at com.caucho.network.listen.ConnectionTask.run(ConnectionTask.java:93) at com.caucho.network.listen.SocketLinkThreadLauncher.handleTasks(SocketLinkThreadLauncher.java:169) at com.caucho.network.listen.TcpSocketAcceptThread.run(TcpSocketAcceptThread.java:61) at com.caucho.env.thread2.ResinThread2.runTasks(ResinThread2.java:173) at com.caucho.env.thread2.ResinThread2.run(ResinThread2.java:118)
Steps To Reproduce:
Additional Information:
Relationships
Attached Files: