问题描述

各位大神帮忙看看JVM Crash问题，crash.log如下：

#

A fatal error has been detected by the Java Runtime Environment:

#

SIGSEGV (0xb) at pc=0x00007f322f0663d0, pid=30574, tid=139853477934848

#

JRE version: Java(TM) SE Runtime Environment (7.0_45-b18) (build 1.7.0_45-b18)

Java VM: Java HotSpot(TM) 64-Bit Server VM (24.45-b08 mixed mode linux-amd64 compressed oops)

Problematic frame:

V [libjvm.so+0x8323d0] ParRootScanWithoutBarrierClosure::do_oop(unsigned int*)+0x140

#

Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again

#

If you would like to submit a bug report, please visit:

http://bugreport.sun.com/bugreport/crash.jsp

#

--------------- T H R E A D ---------------

Current thread (0x00007f3228038000): GCTaskThread [stack: 0x00007f322ccf7000,0x00007f322cdf8000] [id=30593]

siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR), si_addr=0x0000000000000010

Registers:
RAX=0x00007f322f661e58, RBX=0x0000000000000008, RCX=0x0000000000000003, RDX=0x0000000000000000
RSP=0x00007f322cdf61b0, RBP=0x00007f322cdf61e0, RSI=0x00007f318bab8778, RDI=0x00007f3190936e30
R8 =0x0000000000000001, R9 =0x00000000000017c4, R10=0x0000000000000003, R11=0x00007f322ee29020
R12=0x00007f318bab8778, R13=0x00007f3190936e30, R14=0x0000000000000002, R15=0x00007f322f6466a0
RIP=0x00007f322f0663d0, EFLAGS=0x0000000000010202, CSGSFS=0x0000000000000033, ERR=0x0000000000000004
TRAPNO=0x000000000000000e

Top of Stack: (sp=0x00007f322cdf61b0)
0x00007f322cdf61b0: 0000000000000010 00000000000017c4
0x00007f322cdf61c0: 00007f31e40c6a10 00000000000017c4
0x00007f322cdf61d0: 0000000000000002 00000000ffffffff
0x00007f322cdf61e0: 00007f322cdf6280 00007f322f03c477
0x00007f322cdf61f0: 00007f322f66ba20 00007f322f03a780
0x00007f322cdf6200: 00007f3190936e30 00007f322cdf6370
0x00007f322cdf6210: 00007f322cdf6340 00007f322cdf6220
0x00007f322cdf6220: 00007f319026c140 ffff7f320000000c
0x00007f322cdf6230: 00007f3225f95120 00007f3225f94150
0x00007f322cdf6240: 17c47f3225f9ef88 000000032ec6ffff
0x00007f322cdf6250: 00007f3225f95110 00007f322cdf6340
0x00007f322cdf6260: 0000000000000001 00007f322cdf6370
0x00007f322cdf6270: 00007f322cdf6a00 00007f3190936e30
0x00007f322cdf6280: 00007f322cdf62f0 00007f322ed4f529
0x00007f322cdf6290: 00007f322cdf62d0 00007f322ed5061a
0x00007f322cdf62a0: 00007f3225f7aaec 00007f322cdf6310
0x00007f322cdf62b0: 00007f322cdf6370 00007f3228038000
0x00007f322cdf62c0: 00007f3190936e30 00007f322cdf6340
0x00007f322cdf62d0: 00007f322cdf6370 00007f3228038000
0x00007f322cdf62e0: 00007f3190936e30 00007f31ec227800
0x00007f322cdf62f0: 00007f322cdf6960 00007f322f17bcea
0x00007f322cdf6300: 00007f322cdf6310 00007f322cdf6a00
0x00007f322cdf6310: 00007f318bab8760 00007f3225f7aaec
0x00007f322cdf6320: 00007f3225f79c10 0000000000000000
0x00007f322cdf6330: 0000000000000001 00007f318bab8760
0x00007f322cdf6340: 00007f318bab8760 00007f3225f7aaec
0x00007f322cdf6350: 00007f3225f79c10 0000000000000000
0x00007f322cdf6360: 0000000000000001 00007f318bab8760
0x00007f322cdf6370: 00007f322cdf63f0 0000000000000003
0x00007f322cdf6380: 00007f322808ab58 00007f322808ad48
0x00007f322cdf6390: 00007f322cdf63d0 00007f3228041f40
0x00007f322cdf63a0: 00007f3190936870 00000000000000c8

Instructions: (pc=0x00007f322f0663d0)
0x00007f322f0663b0: 48 8b 5d d8 4c 8b 65 e0 4c 8b 6d e8 4c 8b 75 f0
0x00007f322f0663c0: 4c 8b 7d f8 c9 c3 66 2e 0f 1f 84 00 00 00 00 00
0x00007f322f0663d0: 8b 43 08 48 d3 e0 48 01 c2 e9 17 ff ff ff 66 90
0x00007f322f0663e0: 4d 89 f0 48 89 da e8 65 db ff ff e9 5a ff ff ff

Register to memory mapping:

RAX=0x00007f322f661e58: in /home/q/java/jdk1.7.0_45/jre/lib/amd64/server/libjvm.so at 0x00007f322e834000
RBX=0x0000000000000008 is an unknown value
RCX=0x0000000000000003 is an unknown value
RDX=0x0000000000000000 is an unknown value
RSP=0x00007f322cdf61b0 is an unknown value
RBP=0x00007f322cdf61e0 is an unknown value
RSI=0x00007f318bab8778 is pointing into the stack for thread: 0x00007f31ec227800
RDI=0x00007f3190936e30 is an unknown value
R8 =0x0000000000000001 is an unknown value
R9 =0x00000000000017c4 is an unknown value
R10=0x0000000000000003 is an unknown value
R11=0x00007f322ee29020: in /home/q/java/jdk1.7.0_45/jre/lib/amd64/server/libjvm.so at 0x00007f322e834000
R12=0x00007f318bab8778 is pointing into the stack for thread: 0x00007f31ec227800
R13=0x00007f3190936e30 is an unknown value
R14=0x0000000000000002 is an unknown value
R15=0x00007f322f6466a0: in /home/q/java/jdk1.7.0_45/jre/lib/amd64/server/libjvm.so at 0x00007f322e834000

Stack: [0x00007f322ccf7000,0x00007f322cdf8000], sp=0x00007f322cdf61b0, free space=1020k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x8323d0] ParRootScanWithoutBarrierClosure::do_oop(unsigned int*)+0x140
V [libjvm.so+0x808477] OopMapSet::all_do(frame const*, RegisterMap const*, OopClosure*, void (*)(oopDesc**, oopDesc**), OopClosure*)+0x337
V [libjvm.so+0x51b529] frame::oops_do_internal(OopClosure*, CodeBlobClosure*, RegisterMap*, bool)+0x99
V [libjvm.so+0x947cea] JavaThread::oops_do(OopClosure*, CodeBlobClosure*)+0x15a
V [libjvm.so+0x948eb2] Threads::possibly_parallel_oops_do(OopClosure*, CodeBlobClosure*)+0x112
V [libjvm.so+0x8a5702] SharedHeap::process_strong_roots(bool, bool, SharedHeap::ScanningOption, OopClosure*, CodeBlobClosure*, OopsInGenClosure*)+0xa2
V [libjvm.so+0x561cb4] GenCollectedHeap::gen_process_strong_roots(int, bool, bool, bool, SharedHeap::ScanningOption, OopsInGenClosure*, bool, OopsInGenClosure*)+0x74
V [libjvm.so+0x82e7cf] ParNewGenTask::work(unsigned int)+0xef
V [libjvm.so+0x9a876f] GangWorker::loop()+0xcf
V [libjvm.so+0x815288] java_start(Thread*)+0x108

JavaThread 0x00007f31ec227800 (nid = 31650) was being processed
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
v ~RuntimeStub::_new_array_Java
......
0x00007f3228299800 WatcherThread [stack: 0x00007f31b0a26000,0x00007f31b0b27000] [id=30611]

=>0x00007f3228038000 (exited) GCTaskThread [stack: 0x00007f322ccf7000,0x00007f322cdf8000] [id=30593]

VM state:at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x00007f3228006ed0] Threads_lock - owner thread: 0x00007f3228260000
[0x00007f3228007450] Heap_lock - owner thread: 0x00007f31ec227800

Heap
par new generation total 943744K, used 847989K [0x00000005ed400000, 0x000000062d400000, 0x000000062d400000)
eden space 838912K, 100% used [0x00000005ed400000, 0x0000000620740000, 0x0000000620740000)
from space 104832K, 8% used [0x0000000626da0000, 0x000000062767d6f0, 0x000000062d400000)
to space 104832K, 9% used [0x0000000620740000, 0x00000006210ca860, 0x0000000626da0000)
concurrent mark-sweep generation total 7340032K, used 4428693K [0x000000062d400000, 0x00000007ed400000, 0x00000007ed400000)
concurrent-mark-sweep perm gen total 307200K, used 58922K [0x00000007ed400000, 0x0000000800000000, 0x0000000800000000)

Card table byte_map: [0x00007f31d6f69000,0x00007f31d8000000] byte_map_base: 0x00007f31d3fff000

Polling page: 0x00007f322f8bd000

Code Cache [0x00007f3225000000, 0x00007f3225fe0000, 0x00007f3228000000)
total_blobs=4414 nmethods=3877 adapters=488 free_code_cache=33138Kb largest_free_block=33713472

Compilation events (10 events):
Event: 6371.499 Thread 0x00007f3228289000 4444 com.qunar.search.update.LmSpreadUpdater::isSpread (39 bytes)
Event: 6371.502 Thread 0x00007f3228289000 nmethod 4444 0x00007f3225f85b50 code [0x00007f3225f85cc0, 0x00007f3225f85ea8]
Event: 6447.683 Thread 0x00007f322828b800 4445 com.qunar.search.buckets.LrBucket::sortByKeywordPoiScene (534 bytes)
Event: 6448.705 Thread 0x00007f322828b800 nmethod 4445 0x00007f3225f94150 code [0x00007f3225f95140, 0x00007f3225f9ef90]
Event: 6628.074 Thread 0x00007f3228289000 4446 com.qunar.search.proc.QuerySuggestionProcessor::convert (74 bytes)
Event: 6628.131 Thread 0x00007f3228289000 nmethod 4446 0x00007f3225f8b890 code [0x00007f3225f8bd20, 0x00007f3225f8e150]
Event: 6656.642 Thread 0x00007f322828b800 4447 com.qunar.search.proc.MobileHotelToHotelProcessor::sortLrC2NotSameCityEmptySearch (449 bytes)
Event: 6657.031 Thread 0x00007f322828b800 nmethod 4447 0x00007f3225fbda10 code [0x00007f3225fbe820, 0x00007f3225fc8fa8]
Event: 6677.286 Thread 0x00007f3228289000 4448 com.qunar.search.filter.MobileFilterFactory::getCooInfoParser (73 bytes)
Event: 6677.302 Thread 0x00007f3228289000 nmethod 4448 0x00007f3225f846d0 code [0x00007f3225f848c0, 0x00007f3225f85110]

解决方案

这个问题后续打出来过core dump文件，用GDB工具分析过，全是JVM内部的代码，目前没有解决问题的方案。特提出此问题，找大神请教！