求帮忙分析下Tomcat崩溃日志

Question

#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (malloc) failed to allocate 572522496 bytes for committing reserved memory.
# Possible reasons:
#   The system is out of physical RAM or swap space
#   In 32 bit mode, the process size limit was hit
# Possible solutions:
#   Reduce memory load on the system
#   Increase physical memory or swap space
#   Check if swap backing store is full
#   Use 64 bit Java on a 64 bit OS
#   Decrease Java heap size (-Xmx/-Xms)
#   Decrease number of Java threads
#   Decrease Java thread stack sizes (-Xss)
#   Set larger code cache with -XX:ReservedCodeCacheSize=
# This output file may be truncated or incomplete.
#
#  Out of Memory Error (os_linux.cpp:2756), pid=25208, tid=140304851973888
#
# JRE version: Java(TM) SE Runtime Environment (7.0_80-b15) (build 1.7.0_80-b15)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (24.80-b11 mixed mode linux-amd64 compressed oops)
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#

---------------  T H R E A D  ---------------

Current thread (0x00007f9b4c06a000):  VMThread [stack: 0x00007f9b44ccb000,0x00007f9b44dcc000] [id=25214]

Stack: [0x00007f9b44ccb000,0x00007f9b44dcc000],  sp=0x00007f9b44dca1a0,  free space=1020k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V  [libjvm.so+0x9a320a]  VMError::report_and_die()+0x2ea
V  [libjvm.so+0x498d3b]  report_vm_out_of_memory(char const*, int, unsigned long, char const*)+0x9b
V  [libjvm.so+0x82191e]  os::Linux::commit_memory_impl(char*, unsigned long, bool)+0xfe
V  [libjvm.so+0x821e69]  os::pd_commit_memory(char*, unsigned long, unsigned long, bool)+0x29
V  [libjvm.so+0x81bb6a]  os::commit_memory(char*, unsigned long, unsigned long, bool)+0x2a
V  [libjvm.so+0x88d623]  PSVirtualSpace::expand_by(unsigned long)+0x53
V  [libjvm.so+0x87ca80]  PSOldGen::expand(unsigned long)+0x170
V  [libjvm.so+0x87cc8b]  PSOldGen::resize(unsigned long)+0x1cb
V  [libjvm.so+0x885951]  PSParallelCompact::invoke_no_policy(bool)+0x9b1
V  [libjvm.so+0x88b8cd]  PSScavenge::invoke()+0x1ad
V  [libjvm.so+0x843f40]  ParallelScavengeHeap::failed_mem_allocate(unsigned long)+0x70
V  [libjvm.so+0x9a4a97]  VM_ParallelGCFailedAllocation::doit()+0x97
V  [libjvm.so+0x9abf35]  VM_Operation::evaluate()+0x55
V  [libjvm.so+0x9aa2fa]  VMThread::evaluate_operation(VM_Operation*)+0xba
V  [libjvm.so+0x9aa67e]  VMThread::loop()+0x1ce
V  [libjvm.so+0x9aaaf0]  VMThread::run()+0x70
V  [libjvm.so+0x8238c8]  java_start(Thread*)+0x108

VM_Operation (0x00007f9b360f5340): ParallelGCFailedAllocation, mode: safepoint, requested by thread 0x00007f9af2e2b800


---------------  P R O C E S S  ---------------

Java Threads: ( => current thread )
  0x00007f9ab8053800 JavaThread "pool-2-thread-10937" [_thread_blocked, id=20834, stack(0x00007f9aa5b9c000,0x00007f9aa5c9d000)]
  0x00007f9ab809d000 JavaThread "pool-2-thread-10936" [_thread_blocked, id=20833, stack(0x00007f9aa6bac000,0x00007f9aa6cad000)]
  0x00007f9b4c7c4800 JavaThread "pool-8-thread-5804" [_thread_blocked, id=19335, stack(0x00007f9aa81ee000,0x00007f9aa82ef000)]
  0x00007f9b4c3e0000 JavaThread "pool-8-thread-5803" [_thread_blocked, id=18507, stack(0x00007f9b342a0000,0x00007f9b343a1000)]
  0x00007f9b4c2c4000 JavaThread "MQTT Ping: GID_EDO_NOTICE@@@admin" [_thread_blocked, id=28435, stack(0x00007f9aa9a06000,0x00007f9aa9b07000)]
  0x00007f9b4c485800 JavaThread "MQTT Call: GID_EDO_NOTICE@@@admin" [_thread_blocked, id=28434, stack(0x00007f9b081c0000,0x00007f9b082c1000)]
  0x00007f9b4c428800 JavaThread "MQTT Snd: GID_EDO_NOTICE@@@admin" [_thread_blocked, id=28433, stack(0x00007f9aaa915000,0x00007f9aaaa16000)]
  0x00007f9b4c81f800 JavaThread "MQTT Rec: GID_EDO_NOTICE@@@admin" [_thread_in_native, id=28432, stack(0x00007f9aa5798000,0x00007f9aa5899000)]
  0x00007f9ad0101000 JavaThread "http-bio-8080-exec-34" daemon [_thread_blocked, id=20845, stack(0x00007f9aa72b3000,0x00007f9aa73b4000)]
  0x00007f9ad00ff800 JavaThread "http-bio-8080-exec-33" daemon [_thread_blocked, id=20844, stack(0x00007f9aab01c000,0x00007f9aab11d000)]
  0x00007f9ad00fc000 JavaThread "http-bio-8080-exec-30" daemon [_thread_blocked, id=20838, stack(0x00007f9aa9703000,0x00007f9aa9804000)]
  0x00007f9ad00fb000 JavaThread "http-bio-8080-exec-29" daemon [_thread_blocked, id=20837, stack(0x00007f9aa92ff000,0x00007f9aa9400000)]
  0x00007f9ad0110800 JavaThread "http-bio-8080-exec-28" daemon [_thread_blocked, id=20836, stack(0x00007f9aa8cf9000,0x00007f9aa8dfa000)]
  0x00007f9ad010f800 JavaThread "http-bio-8080-exec-27" daemon [_thread_blocked, id=20832, stack(0x00007f9aaa814000,0x00007f9aaa915000)]
  0x00007f9ad010e000 JavaThread "http-bio-8080-exec-26" daemon [_thread_blocked, id=20826, stack(0x00007f9aa87f4000,0x00007f9aa88f5000)]
  0x00007f9ad010d800 JavaThread "http-bio-8080-exec-25" daemon [_thread_blocked, id=20825, stack(0x00007f9aa85f2000,0x00007f9aa86f3000)]
  0x00007f9ad0077800 JavaThread "http-bio-8080-exec-24" daemon [_thread_blocked, id=20822, stack(0x00007f9aaa00c000,0x00007f9aaa10d000)]
  0x00007f9ad00f0000 JavaThread "http-bio-8080-exec-23" daemon [_thread_blocked, id=20821, stack(0x00007f9aa8ffc000,0x00007f9aa90fd000)]
  0x00007f9ad0075800 JavaThread "http-bio-8080-exec-22" daemon [_thread_blocked, id=20820, stack(0x00007f9aaa10d000,0x00007f9aaa20e000)]
  0x00007f9af423f800 JavaThread "Java2D Disposer" daemon [_thread_blocked, id=28691, stack(0x00007f9aab7f8000,0x00007f9aab8f9000)]
  0x00007f9af1c93800 JavaThread "taskExecutor-5" [_thread_blocked, id=28196, stack(0x00007f9aa9d09000,0x00007f9aa9e0a000)]
  0x00007f9af2cef000 JavaThread "taskExecutor-4" [_thread_blocked, id=28195, stack(0x00007f9aa89f6000,0x00007f9aa8af7000)]
  0x00007f9af2cee800 JavaThread "taskExecutor-3" [_thread_blocked, id=28194, stack(0x00007f9aaac18000,0x00007f9aaad19000)]
  0x00007f9af3870000 JavaThread "taskExecutor-2" [_thread_blocked, id=26218, stack(0x00007f9aa9501000,0x00007f9aa9602000)]
  0x00007f9af10db000 JavaThread "taskExecutor-1" [_thread_blocked, id=26216, stack(0x00007f9aaaf1b000,0x00007f9aab01c000)]
  0x00007f9b4c4b1000 JavaThread "idle_connection_reaper" daemon [_thread_blocked, id=25553, stack(0x00007f9b3759a000,0x00007f9b3769b000)]
  0x00007f9af40df800 JavaThread "HSF-AddressProfiler" daemon [_thread_blocked, id=25354, stack(0x00007f9b37499000,0x00007f9b3759a000)]
  0x00007f9ae82ff800 JavaThread "HSF-Worker-2-thread-8" daemon [_thread_blocked, id=25334, stack(0x00007f9aab8f9000,0x00007f9aab9fa000)]
  0x00007f9ad80ab800 JavaThread "HSF-Worker-2-thread-7" daemon [_thread_blocked, id=25333, stack(0x00007f9aab9fa000,0x00007f9aabafb000)]
  0x00007f9ac003b800 JavaThread "HSF-Worker-2-thread-6" daemon [_thread_blocked, id=25332, stack(0x00007f9aabafb000,0x00007f9aabbfc000)]
  0x00007f9aec03c000 JavaThread "HSF-Worker-2-thread-1" daemon [_thread_blocked, id=25331, stack(0x00007f9aabbfc000,0x00007f9aabcfd000)]
  0x00007f9ab4054800 JavaThread "HSF-Worker-2-thread-3" daemon [_thread_blocked, id=25330, stack(0x00007f9aabcfd000,0x00007f9aabdfe000)]
  0x00007f9af8098800 JavaThread "HSF-Worker-2-thread-4" daemon [_thread_blocked, id=25329, stack(0x00007f9aabdfe000,0x00007f9aabeff000)]
  0x00007f9ac00d9000 JavaThread "HSF-Worker-2-thread-5" daemon [_thread_blocked, id=25328, stack(0x00007f9aabeff000,0x00007f9aac000000)]
  0x00007f9abc136800 JavaThread "HSF-Worker-2-thread-2" daemon [_thread_blocked, id=25327, stack(0x00007f9b08061000,0x00007f9b08162000)]
  0x00007f9ad0073800 JavaThread "http-bio-8080-exec-21" daemon [_thread_blocked, id=25324, stack(0x00007f9b084c3000,0x00007f9b085c4000)]
  0x00007f9ad0071000 JavaThread "http-bio-8080-exec-20" daemon [_thread_blocked, id=25323, stack(0x00007f9b085c4000,0x00007f9b086c5000)]
  0x00007f9ad006f000 JavaThread "http-bio-8080-exec-19" daemon [_thread_blocked, id=25322, stack(0x00007f9b086c5000,0x00007f9b087c6000)]
  0x00007f9ad006a800 JavaThread "http-bio-8080-exec-17" daemon [_thread_blocked, id=25320, stack(0x00007f9b088c7000,0x00007f9b089c8000)]
  0x00007f9ad0068800 JavaThread "http-bio-8080-exec-16" daemon [_thread_blocked, id=25319, stack(0x00007f9b089c8000,0x00007f9b08ac9000)]
  0x00007f9ad0066800 JavaThread "http-bio-8080-exec-15" daemon [_thread_blocked, id=25317, stack(0x00007f9b08ac9000,0x00007f9b08bca000)]
  0x00007f9ad0064800 JavaThread "http-bio-8080-exec-14" daemon [_thread_blocked, id=25316, stack(0x00007f9b08bca000,0x00007f9b08ccb000)]
  0x00007f9ad0062800 JavaThread "http-bio-8080-exec-13" daemon [_thread_blocked, id=25315, stack(0x00007f9b08ccb000,0x00007f9b08dcc000)]
  0x00007f9ad000a800 JavaThread "http-bio-8080-exec-12" daemon [_thread_blocked, id=25314, stack(0x00007f9b08dcc000,0x00007f9b08ecd000)]
  0x00007f9ad0008800 JavaThread "http-bio-8080-exec-11" daemon [_thread_blocked, id=25313, stack(0x00007f9b08ecd000,0x00007f9b08fce000)]
  0x00007f9b4c0d9000 JavaThread "http-bio-8080-AsyncTimeout" daemon [_thread_blocked, id=25312, stack(0x00007f9b08fce000,0x00007f9b090cf000)]
  0x00007f9b4c0d7800 JavaThread "http-bio-8080-Acceptor-0" daemon [_thread_blocked, id=25311, stack(0x00007f9b090cf000,0x00007f9b091d0000)]
  0x00007f9b4c0d4800 JavaThread "http-bio-8080-exec-10" daemon [_thread_blocked, id=25310, stack(0x00007f9b091d0000,0x00007f9b092d1000)]
  0x00007f9b4c43e800 JavaThread "http-bio-8080-exec-7" daemon [_thread_blocked, id=25307, stack(0x00007f9b094d3000,0x00007f9b095d4000)]
  0x00007f9b4c43c800 JavaThread "http-bio-8080-exec-6" daemon [_thread_blocked, id=25306, stack(0x00007f9b095d4000,0x00007f9b096d5000)]
  0x00007f9b4c43a800 JavaThread "http-bio-8080-exec-5" daemon [_thread_blocked, id=25305, stack(0x00007f9b096d5000,0x00007f9b097d6000)]
  0x00007f9b4c168800 JavaThread "http-bio-8080-exec-4" daemon [_thread_blocked, id=25304, stack(0x00007f9b37095000,0x00007f9b37196000)]
  0x00007f9b4c166800 JavaThread "http-bio-8080-exec-3" daemon [_thread_blocked, id=25303, stack(0x00007f9b37196000,0x00007f9b37297000)]
  0x00007f9b4c165000 JavaThread "http-bio-8080-exec-2" daemon [_thread_blocked, id=25302, stack(0x00007f9b37297000,0x00007f9b37398000)]
  0x00007f9b4c163000 JavaThread "http-bio-8080-exec-1" daemon [_thread_blocked, id=25301, stack(0x00007f9b37398000,0x00007f9b37499000)]
  0x00007f9b4c162800 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=25300, stack(0x00007f9b097d6000,0x00007f9b098d7000)]
  0x00007f9af1ae3000 JavaThread "pool-7-thread-1" [_thread_blocked, id=25298, stack(0x00007f9b098d7000,0x00007f9b099d8000)]
  0x00007f9af1ae0000 JavaThread "redisMessageListenerContainer-1" [_thread_blocked, id=25297, stack(0x00007f9b354eb000,0x00007f9b355ec000)]
  0x00007f9af1589800 JavaThread "commons-pool-EvictionTimer" daemon [_thread_blocked, id=25296, stack(0x00007f9b099d8000,0x00007f9b09ad9000)]
  0x00007f9b006a9000 JavaThread "ConfigClientNotifier" daemon [_thread_blocked, id=25291, stack(0x00007f9b3409e000,0x00007f9b3419f000)]
  0x00007f9b1c023800 JavaThread "SocketConnectorIoProcessor-0.0" daemon [_thread_blocked, id=25289, stack(0x00007f9b3419f000,0x00007f9b342a0000)]
  0x00007f9b00221000 JavaThread "PooledByteBufferExpirer-0" daemon [_thread_blocked, id=25287, stack(0x00007f9b343a1000,0x00007f9b344a2000)]
  0x00007f9b00180000 JavaThread "com.taobao.remoting.TimerThread" daemon [_thread_blocked, id=25286, stack(0x00007f9b344a2000,0x00007f9b345a3000)]
  0x00007f9ae804c000 JavaThread "HSF-RuntimeInfo-Publisher-7-thread-1" daemon [_thread_blocked, id=25285, stack(0x00007f9b345a3000,0x00007f9b346a4000)]
  0x00007f9af0676800 JavaThread "com.taobao.config.client.timer" daemon [_thread_blocked, id=25284, stack(0x00007f9b346a4000,0x00007f9b347a5000)]
  0x00007f9af3291000 JavaThread "ConfigClientWorker-Thread" daemon [_thread_blocked, id=25283, stack(0x00007f9b347a5000,0x00007f9b348a6000)]
  0x00007f9af3985800 JavaThread "pool-4-thread-1" [_thread_blocked, id=25282, stack(0x00007f9b348a6000,0x00007f9b349a7000)]
  0x00007f9af3982800 JavaThread "com.taobao.config.client.timer" daemon [_thread_blocked, id=25281, stack(0x00007f9b349a7000,0x00007f9b34aa8000)]
  0x00007f9ae81e1800 JavaThread "HSF-Remoting-Timer-3-thread-1" daemon [_thread_blocked, id=25280, stack(0x00007f9b34aa8000,0x00007f9b34ba9000)]
  0x00007f9af0f67800 JavaThread "HSF-AddressPool-Default-1-thread-1" daemon [_thread_blocked, id=25277, stack(0x00007f9b34be2000,0x00007f9b34ce3000)]
  0x00007f9ad0006000 JavaThread "NacosConfigListener-ThreadPool-4" daemon [_thread_blocked, id=25276, stack(0x00007f9b34ce3000,0x00007f9b34de4000)]
  0x00007f9ad4001000 JavaThread "NacosConfigListener-ThreadPool-3" daemon [_thread_blocked, id=25275, stack(0x00007f9b34de4000,0x00007f9b34ee5000)]
  0x00007f9ad0004800 JavaThread "com.alibaba.nacos.client.Worker.longPullingfixed-10.201.199.104:8848-product" daemon [_thread_in_native, id=25274, stack(0x00007f9b34ee5000,0x00007f9b34fe6000)]
  0x00007f9ad0002800 JavaThread "NacosConfigListener-ThreadPool-2" daemon [_thread_blocked, id=25273, stack(0x00007f9b34fe6000,0x00007f9b350e7000)]
  0x00007f9ad0001800 JavaThread "NacosConfigListener-ThreadPool-1" daemon [_thread_blocked, id=25272, stack(0x00007f9b350e7000,0x00007f9b351e8000)]
  0x00007f9ac4001800 JavaThread "com.alibaba.nacos.client.Worker.longPullingfixed-10.201.199.104:8848-product" daemon [_thread_blocked, id=25271, stack(0x00007f9b351e8000,0x00007f9b352e9000)]
  0x00007f9af38c4000 JavaThread "com.alibaba.nacos.client.Worker.fixed-10.201.199.104:8848-product" daemon [_thread_blocked, id=25270, stack(0x00007f9b352e9000,0x00007f9b353ea000)]
  0x00007f9af2a5a800 JavaThread "Timer-1" daemon [_thread_blocked, id=25269, stack(0x00007f9b353ea000,0x00007f9b354eb000)]
  0x00007f9acc00c800 JavaThread "EagleEye-StatLogController-writer-thread-1" daemon [_thread_blocked, id=25252, stack(0x00007f9b35af1000,0x00007f9b35bf2000)]
  0x00000000044e4800 JavaThread "com.taobao.diamond.client.Worker.default" daemon [_thread_in_native, id=25251, stack(0x00007f9b355ec000,0x00007f9b356ed000)]
  0x0000000003dfb000 JavaThread "com.taobao.diamond.client.Timer" daemon [_thread_blocked, id=25250, stack(0x00007f9b356ed000,0x00007f9b357ee000)]
  0x0000000003c1f800 JavaThread "Thread-7" daemon [_thread_blocked, id=25249, stack(0x00007f9b357ee000,0x00007f9b358ef000)]
  0x0000000003c1d800 JavaThread "server-timer1" daemon [_thread_blocked, id=25248, stack(0x00007f9b358ef000,0x00007f9b359f0000)]
  0x0000000003bd3800 JavaThread "server-timer" daemon [_thread_blocked, id=25247, stack(0x00007f9b359f0000,0x00007f9b35af1000)]
  0x00007f9af2d45000 JavaThread "Pandora pandora-qos-reporter Pool [Thread-1]" daemon [_thread_blocked, id=25245, stack(0x00007f9b35bf2000,0x00007f9b35cf3000)]
  0x00007f9af2bc5000 JavaThread "qos-boss-1-1" daemon [_thread_blocked, id=25244, stack(0x00007f9b35cf3000,0x00007f9b35df4000)]
  0x00007f9ad800d000 JavaThread "EagleEye-AsyncAppender-Thread-TraceLog-atp" daemon [_thread_blocked, id=25242, stack(0x00007f9b35df4000,0x00007f9b35ef5000)]
  0x00007f9af2e2c000 JavaThread "metrics-LogDescriptionManager-thread-1" daemon [_thread_blocked, id=25241, stack(0x00007f9b35ef5000,0x00007f9b35ff6000)]
  0x00007f9af2e2b800 JavaThread "metrics-bin-reporter-2-thread-1" daemon [_thread_blocked, id=25240, stack(0x00007f9b35ff6000,0x00007f9b360f7000)]
  0x00007f9ae8a63800 JavaThread "metrics-BinAppender-thread-1" daemon [_thread_blocked, id=25239, stack(0x00007f9b360f7000,0x00007f9b361f8000)]
  0x00007f9ae8554800 JavaThread "metrics-file-reporter-1-thread-1" daemon [_thread_blocked, id=25236, stack(0x00007f9b361f8000,0x00007f9b362f9000)]
  0x00007f9ae84d8800 JavaThread "metrics-RollingFileAppender-thread-1" daemon [_thread_blocked, id=25235, stack(0x00007f9b362f9000,0x00007f9b363fa000)]
  0x00007f9ae80ee800 JavaThread "EagleEye-ScheduleTaskController-worker-thread-1" daemon [_thread_blocked, id=25234, stack(0x00007f9b363fa000,0x00007f9b364fb000)]
  0x00007f9ae80e1800 JavaThread "EagleEye-StatLogController-roller-thread-1" daemon [_thread_blocked, id=25233, stack(0x00007f9b364fb000,0x00007f9b365fc000)]
  0x00007f9ae80a6800 JavaThread "EagleEye-LogDaemon-Thread" daemon [_thread_blocked, id=25232, stack(0x00007f9b365fc000,0x00007f9b366fd000)]
  0x00007f9af3f8d800 JavaThread "EagleEye-AsyncAppender-Thread-BizLog" daemon [_thread_blocked, id=25231, stack(0x00007f9b366fd000,0x00007f9b367fe000)]
  0x00007f9af3e1d800 JavaThread "EagleEye-AsyncAppender-Thread-RpcLog" daemon [_thread_blocked, id=25230, stack(0x00007f9b367fe000,0x00007f9b368ff000)]
  0x00007f9af3cab800 JavaThread "EagleEye-AsyncAppender-Thread-SelfLog" daemon [_thread_blocked, id=25229, stack(0x00007f9b368ff000,0x00007f9b36a00000)]
  0x00007f9af173f800 JavaThread "Timer-0" daemon [_thread_blocked, id=25228, stack(0x00007f9b36a00000,0x00007f9b36b01000)]
  0x00007f9b4c556800 JavaThread "GC Daemon" daemon [_thread_blocked, id=25222, stack(0x00007f9b4403a000,0x00007f9b4413b000)]
  0x00007f9b4c099800 JavaThread "Service Thread" daemon [_thread_blocked, id=25220, stack(0x00007f9b446c5000,0x00007f9b447c6000)]
  0x00007f9b4c097000 JavaThread "C2 CompilerThread1" daemon [_thread_blocked, id=25219, stack(0x00007f9b447c6000,0x00007f9b448c7000)]
  0x00007f9b4c094000 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=25218, stack(0x00007f9b448c7000,0x00007f9b449c8000)]
  0x00007f9b4c091800 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=25217, stack(0x00007f9b449c8000,0x00007f9b44ac9000)]
  0x00007f9b4c070800 JavaThread "Finalizer" daemon [_thread_blocked, id=25216, stack(0x00007f9b44ac9000,0x00007f9b44bca000)]
  0x00007f9b4c06e800 JavaThread "Reference Handler" daemon [_thread_blocked, id=25215, stack(0x00007f9b44bca000,0x00007f9b44ccb000)]
  0x00007f9b4c00a000 JavaThread "main" [_thread_in_native, id=25209, stack(0x00007f9b5280b000,0x00007f9b5290c000)]

Other Threads:
=>0x00007f9b4c06a000 VMThread [stack: 0x00007f9b44ccb000,0x00007f9b44dcc000] [id=25214]
  0x00007f9b4c0a4800 WatcherThread [stack: 0x00007f9b445c4000,0x00007f9b446c5000] [id=25221]

VM state:at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread:  ([mutex/lock_event])
[0x00007f9b4c0073d0] ExpandHeap_lock - owner thread: 0x00007f9b4c06a000
[0x00007f9b4c007a50] Threads_lock - owner thread: 0x00007f9b4c06a000
[0x00007f9b4c007f50] Heap_lock - owner thread: 0x00007f9af2e2b800

Heap
 PSYoungGen      total 1122816K, used 0K [0x0000000780000000, 0x00000007eef00000, 0x0000000800000000)
  eden space 423936K, 0% used [0x0000000780000000,0x0000000780000000,0x0000000799e00000)
  from space 698880K, 0% used [0x0000000799e00000,0x0000000799e00000,0x00000007c4880000)
  to   space 690176K, 0% used [0x00000007c4d00000,0x00000007c4d00000,0x00000007eef00000)
 ParOldGen       total 3225088K, used 3184634K [0x0000000680000000, 0x0000000744d80000, 0x0000000780000000)
  object space 3225088K, 98% used [0x0000000680000000,0x00000007425fea80,0x0000000744d80000)
 PSPermGen       total 2097152K, used 111831K [0x0000000600000000, 0x0000000680000000, 0x0000000680000000)
  object space 2097152K, 5% used [0x0000000600000000,0x0000000606d35ff8,0x0000000680000000)

Card table byte_map: [0x00007f9b47fff000,0x00007f9b49000000] byte_map_base: 0x00007f9b44fff000

Polling page: 0x00007f9b52917000

Code Cache  [0x00007f9b49000000, 0x00007f9b4a2e0000, 0x00007f9b4c000000)
 total_blobs=5813 nmethods=5091 adapters=673 free_code_cache=30158Kb largest_free_block=30581696

Compilation events (10 events):
Event: 1204524.007 Thread 0x00007f9b4c094000 6182             com.taobao.eagleeye.json.IdentityHashMap::get (52 bytes)
Event: 1204524.007 Thread 0x00007f9b4c097000 6181   !         com.taobao.eagleeye.json.JSONSerializer::getObjectWriter (872 bytes)
Event: 1204524.009 Thread 0x00007f9b4c094000 nmethod 6182 0x00007f9b49cc2750 code [0x00007f9b49cc28a0, 0x00007f9b49cc29e8]
Event: 1204524.009 Thread 0x00007f9b4c094000 6183             com.taobao.eagleeye.json.SerializeWriter::writeFieldName (80 bytes)
Event: 1204524.011 Thread 0x00007f9b4c094000 nmethod 6183 0x00007f9b4a280010 code [0x00007f9b4a280160, 0x00007f9b4a280288]
Event: 1204524.040 Thread 0x00007f9b4c097000 nmethod 6181 0x00007f9b4a01e110 code [0x00007f9b4a01e600, 0x00007f9b4a0201d8]
Event: 1204590.715 Thread 0x00007f9b4c094000 6184             java.util.TreeMap::rotateRight (96 bytes)
Event: 1204590.715 Thread 0x00007f9b4c097000 6185             com.taobao.eagleeye.json.BigDecimalCodec::write (88 bytes)
Event: 1204590.717 Thread 0x00007f9b4c094000 nmethod 6184 0x00007f9b49f7af90 code [0x00007f9b49f7b0e0, 0x00007f9b49f7b238]
Event: 1204590.718 Thread 0x00007f9b4c097000 nmethod 6185 0x00007f9b4a05ddd0 code [0x00007f9b4a05df40, 0x00007f9b4a05e138]

GC Heap History (10 events):
Event: 1204590.670 GC heap after
Heap after GC invocations=36180 (full 121):
 PSYoungGen      total 1093632K, used 0K [0x0000000780000000, 0x00000007ef400000, 0x0000000800000000)
  eden space 394752K, 0% used [0x0000000780000000,0x0000000780000000,0x0000000798180000)
  from space 698880K, 0% used [0x0000000798180000,0x0000000798180000,0x00000007c2c00000)
  to   space 698880K, 0% used [0x00000007c4980000,0x00000007c4980000,0x00000007ef400000)
 ParOldGen       total 3225088K, used 2652104K [0x0000000680000000, 0x0000000744d80000, 0x0000000780000000)
  object space 3225088K, 82% used [0x0000000680000000,0x0000000721df21d8,0x0000000744d80000)
 PSPermGen       total 2097152K, used 111831K [0x0000000600000000, 0x0000000680000000, 0x0000000680000000)
  object space 2097152K, 5% used [0x0000000600000000,0x0000000606d35e60,0x0000000680000000)
}
Event: 1204596.643 GC heap before
{Heap before GC invocations=36181 (full 121):
 PSYoungGen      total 1093632K, used 394752K [0x0000000780000000, 0x00000007ef400000, 0x0000000800000000)
  eden space 394752K, 100% used [0x0000000780000000,0x0000000798180000,0x0000000798180000)
  from space 698880K, 0% used [0x0000000798180000,0x0000000798180000,0x00000007c2c00000)
  to   space 698880K, 0% used [0x00000007c4980000,0x00000007c4980000,0x00000007ef400000)
 ParOldGen       total 3225088K, used 2652104K [0x0000000680000000, 0x0000000744d80000, 0x0000000780000000)
  object space 3225088K, 82% used [0x0000000680000000,0x0000000721df21d8,0x0000000744d80000)
 PSPermGen       total 2097152K, used 111831K [0x0000000600000000, 0x0000000680000000, 0x0000000680000000)
  object space 2097152K, 5% used [0x0000000600000000,0x0000000606d35f38,0x0000000680000000)
Event: 1204596.732 GC heap after
Heap after GC invocations=36181 (full 121):
 PSYoungGen      total 1095168K, used 123671K [0x0000000780000000, 0x00000007ee600000, 0x0000000800000000)
  eden space 410624K, 0% used [0x0000000780000000,0x0000000780000000,0x0000000799100000)
  from space 684544K, 18% used [0x00000007c4980000,0x00000007cc245f30,0x00000007ee600000)
  to   space 698880K, 0% used [0x0000000799100000,0x0000000799100000,0x00000007c3b80000)
 ParOldGen       total 3225088K, used 2652104K [0x0000000680000000, 0x0000000744d80000, 0x0000000780000000)
  object space 3225088K, 82% used [0x0000000680000000,0x0000000721df21d8,0x0000000744d80000)
 PSPermGen       total 2097152K, used 111831K [0x0000000600000000, 0x0000000680000000, 0x0000000680000000)
  object space 2097152K, 5% used [0x0000000600000000,0x0000000606d35f38,0x0000000680000000)
}
Event: 1204602.842 GC heap before
{Heap before GC invocations=36182 (full 121):
 PSYoungGen      total 1095168K, used 534295K [0x0000000780000000, 0x00000007ee600000, 0x0000000800000000)
  eden space 410624K, 100% used [0x0000000780000000,0x0000000799100000,0x0000000799100000)
  from space 684544K, 18% used [0x00000007c4980000,0x00000007cc245f30,0x00000007ee600000)
  to   space 698880K, 0% used [0x0000000799100000,0x0000000799100000,0x00000007c3b80000)
 ParOldGen       total 3225088K, used 2652104K [0x0000000680000000, 0x0000000744d80000, 0x0000000780000000)
  object space 3225088K, 82% used [0x0000000680000000,0x0000000721df21d8,0x0000000744d80000)
 PSPermGen       total 2097152K, used 111831K [0x0000000600000000, 0x0000000680000000, 0x0000000680000000)
  object space 2097152K, 5% used [0x0000000600000000,0x0000000606d35f38,0x0000000680000000)
Event: 1204603.067 GC heap after
Heap after GC invocations=36182 (full 121):
 PSYoungGen      total 1109504K, used 116361K [0x0000000780000000, 0x00000007ef480000, 0x0000000800000000)
  eden space 410624K, 0% used [0x0000000780000000,0x0000000780000000,0x0000000799100000)
  from space 698880K, 16% used [0x0000000799100000,0x00000007a02a2558,0x00000007c3b80000)
  to   space 698880K, 0% used [0x00000007c4a00000,0x00000007c4a00000,0x00000007ef480000)
 ParOldGen       total 3225088K, used 2761705K [0x0000000680000000, 0x0000000744d80000, 0x0000000780000000)
  object space 3225088K, 85% used [0x0000000680000000,0x00000007288fa6c8,0x0000000744d80000)
 PSPermGen       total 2097152K, used 111831K [0x0000000600000000, 0x0000000680000000, 0x0000000680000000)
  object space 2097152K, 5% used [0x0000000600000000,0x0000000606d35f38,0x0000000680000000)
}
Event: 1204611.632 GC heap before
{Heap before GC invocations=36183 (full 121):
 PSYoungGen      total 1109504K, used 526985K [0x0000000780000000, 0x00000007ef480000, 0x0000000800000000)
  eden space 410624K, 100% used [0x0000000780000000,0x0000000799100000,0x0000000799100000)
  from space 698880K, 16% used [0x0000000799100000,0x00000007a02a2558,0x00000007c3b80000)
  to   space 698880K, 0% used [0x00000007c4a00000,0x00000007c4a00000,0x00000007ef480000)
 ParOldGen       total 3225088K, used 2761705K [0x0000000680000000, 0x0000000744d80000, 0x0000000780000000)
  object space 3225088K, 85% used [0x0000000680000000,0x00000007288fa6c8,0x0000000744d80000)
 PSPermGen       total 2097152K, used 111831K [0x0000000600000000, 0x0000000680000000, 0x0000000680000000)
  object space 2097152K, 5% used [0x0000000600000000,0x0000000606d35f38,0x0000000680000000)
Event: 1204611.935 GC heap after
Heap after GC invocations=36183 (full 121):
 PSYoungGen      total 1121280K, used 159460K [0x0000000780000000, 0x00000007ef300000, 0x0000000800000000)
  eden space 423936K, 0% used [0x0000000780000000,0x0000000780000000,0x0000000799e00000)
  from space 697344K, 22% used [0x00000007c4a00000,0x00000007ce5b9330,0x00000007ef300000)
  to   space 698880K, 0% used [0x0000000799e00000,0x0000000799e00000,0x00000007c4880000)
 ParOldGen       total 3225088K, used 2873393K [0x0000000680000000, 0x0000000744d80000, 0x0000000780000000)
  object space 3225088K, 89% used [0x0000000680000000,0x000000072f60c6c8,0x0000000744d80000)
 PSPermGen       total 2097152K, used 111831K [0x0000000600000000, 0x0000000680000000, 0x0000000680000000)
  object space 2097152K, 5% used [0x0000000600000000,0x0000000606d35f38,0x0000000680000000)
}
Event: 1204620.761 GC heap before
{Heap before GC invocations=36184 (full 121):
 PSYoungGen      total 1121280K, used 583396K [0x0000000780000000, 0x00000007ef300000, 0x0000000800000000)
  eden space 423936K, 100% used [0x0000000780000000,0x0000000799e00000,0x0000000799e00000)
  from space 697344K, 22% used [0x00000007c4a00000,0x00000007ce5b9330,0x00000007ef300000)
  to   space 698880K, 0% used [0x0000000799e00000,0x0000000799e00000,0x00000007c4880000)
 ParOldGen       total 3225088K, used 2873393K [0x0000000680000000, 0x0000000744d80000, 0x0000000780000000)
  object space 3225088K, 89% used [0x0000000680000000,0x000000072f60c6c8,0x0000000744d80000)
 PSPermGen       total 2097152K, used 111831K [0x0000000600000000, 0x0000000680000000, 0x0000000680000000)
  object space 2097152K, 5% used [0x0000000600000000,0x0000000606d35ff8,0x0000000680000000)
Event: 1204621.151 GC heap after
Heap after GC invocations=36184 (full 121):
 PSYoungGen      total 1122816K, used 169794K [0x0000000780000000, 0x00000007eef00000, 0x0000000800000000)
  eden space 423936K, 0% used [0x0000000780000000,0x0000000780000000,0x0000000799e00000)
  from space 698880K, 24% used [0x0000000799e00000,0x00000007a43d0868,0x00000007c4880000)
  to   space 690176K, 0% used [0x00000007c4d00000,0x00000007c4d00000,0x00000007eef00000)
 ParOldGen       total 3225088K, used 3027001K [0x0000000680000000, 0x0000000744d80000, 0x0000000780000000)
  object space 3225088K, 93% used [0x0000000680000000,0x0000000738c0e520,0x0000000744d80000)
 PSPermGen       total 2097152K, used 111831K [0x0000000600000000, 0x0000000680000000, 0x0000000680000000)
  object space 2097152K, 5% used [0x0000000600000000,0x0000000606d35ff8,0x0000000680000000)
}
Event: 1204621.151 GC heap before
{Heap before GC invocations=36185 (full 122):
 PSYoungGen      total 1122816K, used 169794K [0x0000000780000000, 0x00000007eef00000, 0x0000000800000000)
  eden space 423936K, 0% used [0x0000000780000000,0x0000000780000000,0x0000000799e00000)
  from space 698880K, 24% used [0x0000000799e00000,0x00000007a43d0868,0x00000007c4880000)
  to   space 690176K, 0% used [0x00000007c4d00000,0x00000007c4d00000,0x00000007eef00000)
 ParOldGen       total 3225088K, used 3027001K [0x0000000680000000, 0x0000000744d80000, 0x0000000780000000)
  object space 3225088K, 93% used [0x0000000680000000,0x0000000738c0e520,0x0000000744d80000)
 PSPermGen       total 2097152K, used 111831K [0x0000000600000000, 0x0000000680000000, 0x0000000680000000)
  object space 2097152K, 5% used [0x0000000600000000,0x0000000606d35ff8,0x0000000680000000)

Deoptimization events (10 events):
Event: 1204401.184 Thread 0x00007f9ad010d800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007f9b49746a14 method=cn.hutool.core.convert.ConverterRegistry.getDefaultConverter(Ljava/lang/reflect/Type;)Lcn/hutool/core/convert/Converter; @ 22
Event: 1204401.471 Thread 0x00007f9ad010d800 Uncommon trap: reason=unreached action=reinterpret pc=0x00007f9b4a227214 method=com.qdport.controller.edo.EdoDynamicController.exportPayOrderData(Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;L
Event: 1204401.679 Thread 0x00007f9ad010d800 Uncommon trap: reason=null_check action=make_not_entrant pc=0x00007f9b4a119570 method=com.alibaba.fastjson.parser.ParserConfig.get(Ljava/lang/reflect/Type;)Lcom/alibaba/fastjson/parser/deserializer/ObjectDeserializer; @ 18
Event: 1204401.679 Thread 0x00007f9ad010d800 Uncommon trap: reason=null_check action=make_not_entrant pc=0x00007f9b4a11a0d0 method=com.alibaba.fastjson.parser.ParserConfig.get(Ljava/lang/reflect/Type;)Lcom/alibaba/fastjson/parser/deserializer/ObjectDeserializer; @ 18
Event: 1204402.306 Thread 0x00007f9ad010d800 Uncommon trap: reason=unstable_if action=reinterpret pc=0x00007f9b4a2acd48 method=com.qdport.controller.edo.EdoDynamicController.exportPayOrderData(Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;Ljava/lang/String
Event: 1204482.174 Thread 0x00007f9ac4001800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007f9b4975a408 method=com.alibaba.nacos.client.config.impl.ClientWorker$LongPullingRunnable.run()V @ 130
Event: 1204482.222 Thread 0x00007f9ad0002800 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x00007f9b49ef0d6c method=org.springframework.context.event.AbstractApplicationEventMulticaster.getApplicationListeners(Lorg/springframework/context/ApplicationEvent;Lorg/springframework/core/Resol
Event: 1204523.968 Thread 0x00007f9af40df800 Uncommon trap: reason=unstable_if action=reinterpret pc=0x00007f9b49e96204 method=com.taobao.hsf.address.AddressProfiler.run()V @ 24
Event: 1204523.969 Thread 0x00007f9af40df800 Uncommon trap: reason=unstable_if action=reinterpret pc=0x00007f9b4a118ef8 method=java.text.FieldPosition.matchesField(Ljava/text/Format$Field;I)Z @ 21
Event: 1204581.597 Thread 0x00007f9ad0068800 Uncommon trap: reason=unstable_if action=reinterpret pc=0x00007f9b49d12f7c method=cn.hutool.core.convert.AbstractConverter.convertToStr(Ljava/lang/Object;)Ljava/lang/String; @ 11

Internal exceptions (10 events):
Event: 1204618.577 Thread 0x00007f9b4c166800 Threw 0x000000079141a848 at /HUDSON/workspace/7u-2-build-linux-amd64/jdk7u80/2329/hotspot/src/share/vm/prims/jvm.cpp:1319
Event: 1204619.542 Thread 0x00007f9b4c43a800 Threw 0x0000000792fa6bf8 at /HUDSON/workspace/7u-2-build-linux-amd64/jdk7u80/2329/hotspot/src/share/vm/prims/jvm.cpp:1319
Event: 1204619.542 Thread 0x00007f9b4c43a800 Threw 0x0000000792faeb00 at /HUDSON/workspace/7u-2-build-linux-amd64/jdk7u80/2329/hotspot/src/share/vm/prims/jvm.cpp:1319
Event: 1204619.610 Thread 0x00007f9ad010f800 Threw 0x0000000793b29018 at /HUDSON/workspace/7u-2-build-linux-amd64/jdk7u80/2329/hotspot/src/share/vm/prims/jvm.cpp:1319
Event: 1204619.611 Thread 0x00007f9ad010f800 Threw 0x0000000793b30a50 at /HUDSON/workspace/7u-2-build-linux-amd64/jdk7u80/2329/hotspot/src/share/vm/prims/jvm.cpp:1319
Event: 1204620.562 Thread 0x00007f9ad0008800 Threw 0x0000000797ff58c8 at /HUDSON/workspace/7u-2-build-linux-amd64/jdk7u80/2329/hotspot/src/share/vm/prims/jvm.cpp:1319
Event: 1204620.562 Thread 0x00007f9ad0008800 Threw 0x0000000797ffd6d0 at /HUDSON/workspace/7u-2-build-linux-amd64/jdk7u80/2329/hotspot/src/share/vm/prims/jvm.cpp:1319
Event: 1204620.743 Thread 0x00007f9af2e2b800 Threw 0x0000000798ee0120 at /HUDSON/workspace/7u-2-build-linux-amd64/jdk7u80/2329/hotspot/src/share/vm/prims/jni.cpp:717
Event: 1204620.743 Thread 0x00007f9af2e2b800 Threw 0x0000000798ee6c38 at /HUDSON/workspace/7u-2-build-linux-amd64/jdk7u80/2329/hotspot/src/share/vm/prims/jni.cpp:717
Event: 1204620.743 Thread 0x00007f9af2e2b800 Threw 0x0000000798eeb330 at /HUDSON/workspace/7u-2-build-linux-amd64/jdk7u80/2329/hotspot/src/share/vm/prims/jni.cpp:717

Events (10 events):
Event: 1204619.610 loading class 0x00007f9ab400eee0 done
Event: 1204619.731 Thread 0x00007f9abc15f000 Thread added: 0x00007f9abc15f000
Event: 1204619.731 Thread 0x00007f9abc15f000 Thread exited: 0x00007f9abc15f000
Event: 1204620.562 loading class 0x00007f9ab40101e0
Event: 1204620.562 loading class 0x00007f9ab40101e0 done
Event: 1204620.562 loading class 0x00007f9ab400eee0
Event: 1204620.562 loading class 0x00007f9ab400eee0 done
Event: 1204620.678 Executing VM operation: RevokeBias
Event: 1204620.679 Executing VM operation: RevokeBias done
Event: 1204620.761 Executing VM operation: ParallelGCFailedAllocation

Answer 1

调低一下jvm启动的大小，Java heap size (-Xmx/-Xms)