exchange 读csv写sst nebula_codec错误

问答 问题
1

nebula exchange 1.1.0
nebula graph 1.2.0
spark 2.4.7
jdk 1.8.0_191

20/12/16 19:10:53 ERROR NebulaCodec: no nebula_codec in java.library.path
java.lang.UnsatisfiedLinkError: no nebula_codec in java.library.path
	at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
	at java.lang.Runtime.loadLibrary0(Runtime.java:870)
	at java.lang.System.loadLibrary(System.java:1122)
	at com.vesoft.nebula.NebulaCodec.<clinit>(NebulaCodec.java:23)
	at com.vesoft.nebula.tools.importer.processor.VerticesProcessor$$anonfun$process$1$$anonfun$apply$1.apply(VerticesProcessor.scala:181)
	at com.vesoft.nebula.tools.importer.processor.VerticesProcessor$$anonfun$process$1$$anonfun$apply$1.apply(VerticesProcessor.scala:177)
	at scala.collection.Iterator$$anon$11.next(Iterator.scala:410)
	at scala.collection.Iterator$$anon$11.next(Iterator.scala:410)
	at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage2.sort_addToSorter_0$(Unknown Source)
	at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage2.processNext(Unknown Source)
	at org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43)
	at org.apache.spark.sql.execution.WholeStageCodegenExec$$anonfun$13$$anon$1.hasNext(WholeStageCodegenExec.scala:636)
	at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:409)
	at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:409)
	at scala.collection.Iterator$class.foreach(Iterator.scala:891)
	at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
	at com.vesoft.nebula.tools.importer.processor.VerticesProcessor$$anonfun$process$2.apply(VerticesProcessor.scala:201)
	at com.vesoft.nebula.tools.importer.processor.VerticesProcessor$$anonfun$process$2.apply(VerticesProcessor.scala:194)
	at org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$28.apply(RDD.scala:980)
	at org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$28.apply(RDD.scala:980)
	at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2101)
	at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2101)
	at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
	at org.apache.spark.scheduler.Task.run(Task.scala:123)
	at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408)
	at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)
	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
20/12/16 19:10:54 INFO NebulaSSTWriter: Loading RocksDB successfully
2

编译nebula—>src—>jni
依赖glog

git clone https://github.com/google/glog.git
cd glog
mkdir build
cmake ..
make
sudo make install

依赖gtest

sudo apt-get install libgtest-dev
cd /usr/src/gtest
sudo cmake .
sudo make
sudo cp libgtest*.a /usr/local/lib

依赖 gflags

git clone https://github.com/gflags/gflags
cd gflags
cmake .
make -j 24
sudo make install

编译 jni

编译最后一步

[ 77%] Built target nebula_codec_obj
[100%] Built target nebula_codec
Warning: JAVA_HOME environment variable is not set.
[WARNING] 
[WARNING] Some problems were encountered while building the effective settings
[WARNING] expected START_TAG or END_TAG not TEXT (position: TEXT seen ...</mirror>\n     -->\n    <mirror>\n\u3000\u3000\u3000\u3000<i... @160:7)  @ /usr/share/maven/conf/settings.xml, line 160, column 7
[WARNING] 
[INFO] Scanning for projects...
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for com.vesoft:nebula-utils:jar:1.0.0-rc4
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-source-plugin is missing. @ line 188, column 21
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-deploy-plugin is missing. @ line 230, column 21
[WARNING] 
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING] 
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING] 
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building nebula-utils 1.0.0-rc4
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ nebula-utils ---
[INFO] Deleting /home/lsz/nebula/nebula-master/src/jni/java/target
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.0:compile (default) @ nebula-utils ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to /home/lsz/nebula/nebula-master/src/jni/java/target/classes
[INFO] -------------------------------------------------------------
[ERROR] COMPILATION ERROR : 
[INFO] -------------------------------------------------------------
[ERROR] No compiler is provided in this environment. Perhaps you are running on a JRE rather than a JDK?
[INFO] 1 error
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 0.439 s
[INFO] Finished at: 2020-12-16T21:48:21+08:00
[INFO] Final Memory: 30M/1926M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile (default) on project nebula-utils: Compilation failure
[ERROR] No compiler is provided in this environment. Perhaps you are running on a JRE rather than a JDK?
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
CMakeFiles/java_lib.dir/build.make:57: recipe for target 'CMakeFiles/java_lib' failed
make[3]: *** [CMakeFiles/java_lib] Error 1
CMakeFiles/Makefile2:67: recipe for target 'CMakeFiles/java_lib.dir/all' failed
make[2]: *** [CMakeFiles/java_lib.dir/all] Error 2
CMakeFiles/Makefile2:74: recipe for target 'CMakeFiles/java_lib.dir/rule' failed
make[1]: *** [CMakeFiles/java_lib.dir/rule] Error 2
Makefile:118: recipe for target 'java_lib' failed
make: *** [java_lib] Error 2

此时可以找到libnebula_codec.so
重新运行exchange
会出现

20/12/16 22:04:10 INFO VerticesProcessor: Loading NebulaCodec successfully.
20/12/16 22:04:10 INFO CodeGenerator: Code generated in 9.842506 ms
20/12/16 22:04:10 INFO CodeGenerator: Code generated in 9.429534 ms
20/12/16 22:04:10 INFO CodeGenerator: Code generated in 6.698928 ms
20/12/16 22:04:11 INFO NebulaSSTWriter: Loading RocksDB successfully
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007fb3e4a78fe3, pid=28323, tid=0x00007fb4026f1700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_191-b12) (build 1.8.0_191-b12)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.191-b12 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C  [librocksdbjni6204471966138021700.so+0x4affe3]  rocksdb::SstFileWriter::Finish(rocksdb::ExternalSstFileInfo*)+0x13
#
# Core dump written. Default location: /home/lsz/jdk1.8.0_191/lib/core or core.28323
#
# An error report file with more information is saved as:
# /tmp/hs_err_pid28323.log
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
Aborted (core dumped)

程序终止,sst文件未全部生成

1 个赞
3
  1. nebula-utils build失败了，后面用的不是你编译出来的nebula-utils
  2. 调用jni时导致jvm崩溃了，贴一下 /tmp/hs_err_pid28323.log 这个文件吧
4 
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007fb3e4a78fe3, pid=28323, tid=0x00007fb4026f1700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_191-b12) (build 1.8.0_191-b12)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.191-b12 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C  [librocksdbjni6204471966138021700.so+0x4affe3]  rocksdb::SstFileWriter::Finish(rocksdb::ExternalSstFileInfo*)+0x13
#
# Core dump written. Default location: /home/lsz/jdk1.8.0_191/lib/core or core.28323
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

---------------  T H R E A D  ---------------

Current thread (0x00007fb48403b800):  JavaThread "Executor task launch worker for task 3" daemon [_thread_in_native, id=28416, stack(0x00007fb4025f1000,0x00007fb4026f2000)]

siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr: 0x0000000000000008

Registers:
RAX=0x00007fb3e47b6e00, RBX=0x0000000000000000, RCX=0x0000000000000010, RDX=0x0000000000000000
RSP=0x00007fb4026eff50, RBP=0x00007fb4026effd0, RSI=0x00007fb3f0447910, RDI=0x00007fb4026efff0
R8 =0x00007fb3e55a29c0, R9 =0x0000000000000006, R10=0x00007fb4f101869b, R11=0x00007fb50725b890
R12=0x0000000000000000, R13=0x00007fb4026efff0, R14=0x00007fb4026f00c8, R15=0x00007fb48403b800
RIP=0x00007fb3e4a78fe3, EFLAGS=0x0000000000010206, CSGSFS=0x002b000000000033, ERR=0x0000000000000004
  TRAPNO=0x000000000000000e

Top of Stack: (sp=0x00007fb4026eff50)
0x00007fb4026eff50:   00007fb4026efff0 0000000000000000
0x00007fb4026eff60:   00007fb48403b800 00007fb4026efff0
0x00007fb4026eff70:   00007fb4026f00a0 00007fb506f190ed
0x00007fb4026eff80:   00000000000003d8 00007fb4026effd0
0x00007fb4026eff90:   00007fb4a80bf090 00007fb4a80bf468
0x00007fb4026effa0:   00007fb5082ff400 000000b78403b800
0x00007fb4026effb0:   00007fb48403b9d8 00007fb48403b9f8
0x00007fb4026effc0:   0000000000000000 00007fb3e55a29b8
0x00007fb4026effd0:   00007fb4026f0030 00007fb3e47b6e22
0x00007fb4026effe0:   00007fb3e55a1570 00007fb48403b800
0x00007fb4026efff0:   00007fb3e55a29c0 00007fb48403b800
0x00007fb4026f0000:   00007fb4f10055d0 00007fb3e55a29c0
0x00007fb4026f0010:   0000000000000000 00007fb3e55a29b8
0x00007fb4026f0020:   00007fb4026f00c8 00007fb48403b800
0x00007fb4026f0030:   00007fb4026f0098 00007fb4f10186c7
0x00007fb4026f0040:   00007fb3e55a29c0 00007fb48403b800
0x00007fb4026f0050:   fffffffe00000000 00007fb4026f0058
0x00007fb4026f0060:   0000000000000000 00007fb4026f00c8
0x00007fb4026f0070:   00007fb3e55a2b58 0000000000000000
0x00007fb4026f0080:   00007fb3e55a29c0 0000000000000000
0x00007fb4026f0090:   00007fb4026f00b8 00007fb4026f0110
0x00007fb4026f00a0:   00007fb4f10082bd 0000000000000000
0x00007fb4026f00b0:   00007fb4f1011d18 00007fb3f0447910
0x00007fb4026f00c0:   00000000eeea5cd8 00000000eeea5cd8
0x00007fb4026f00d0:   00007fb4026f00d0 00007fb3e55a238d
0x00007fb4026f00e0:   00007fb4026f0120 00007fb3e55a2b58
0x00007fb4026f00f0:   00007fb3e55a42a8 00007fb3e55a23a0
0x00007fb4026f0100:   00007fb4026f00b8 00007fb4026f0120
0x00007fb4026f0110:   00007fb4026f0168 00007fb4f10082bd
0x00007fb4026f0120:   00000000eeea5cd8 00007fb4026f0128
0x00007fb4026f0130:   00007fb3e5558b4c 00007fb4026f0178
0x00007fb4026f0140:   00007fb3e5558da8 00007fb3e55a4030 

Instructions: (pc=0x00007fb3e4a78fe3)
0x00007fb3e4a78fc3:   fe e8 73 6e cd ff eb db 90 0f 1f 40 00 55 48 89
0x00007fb3e4a78fd3:   e5 41 55 41 54 53 49 89 fd 48 83 ec 68 48 8b 1e
0x00007fb3e4a78fe3:   48 8b 73 08 48 85 f6 0f 84 98 02 00 00 48 83 bb
0x00007fb3e4a78ff3:   a0 03 00 00 00 49 89 d4 75 0e 48 83 bb a8 03 00 

Register to memory mapping:

RAX=0x00007fb3e47b6e00: Java_org_rocksdb_SstFileWriter_finish+0 in /tmp/librocksdbjni6204471966138021700.so at 0x00007fb3e45c9000
RBX=0x0000000000000000 is an unknown value
RCX=0x0000000000000010 is an unknown value
RDX=0x0000000000000000 is an unknown value
RSP=0x00007fb4026eff50 is pointing into the stack for thread: 0x00007fb48403b800
RBP=0x00007fb4026effd0 is pointing into the stack for thread: 0x00007fb48403b800
RSI=0x00007fb3f0447910 is an unknown value
RDI=0x00007fb4026efff0 is pointing into the stack for thread: 0x00007fb48403b800
R8 ={method} {0x00007fb3e55a29c0} 'finish' '(J)V' in 'org/rocksdb/SstFileWriter'
R9 =0x0000000000000006 is an unknown value
R10=0x00007fb4f101869b is at code_begin+859 in an Interpreter codelet
method entry point (kind = native)  [0x00007fb4f1018340, 0x00007fb4f1018cc0]  2432 bytes
R11=0x00007fb50725b890: <offset 0x9bb890> in /home/lsz/jdk1.8.0_191/jre/lib/amd64/server/libjvm.so at 0x00007fb5068a0000
R12=0x0000000000000000 is an unknown value
R13=0x00007fb4026efff0 is pointing into the stack for thread: 0x00007fb48403b800
R14=0x00007fb4026f00c8 is pointing into the stack for thread: 0x00007fb48403b800
R15=0x00007fb48403b800 is a thread


Stack: [0x00007fb4025f1000,0x00007fb4026f2000],  sp=0x00007fb4026eff50,  free space=1019k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C  [librocksdbjni6204471966138021700.so+0x4affe3]  rocksdb::SstFileWriter::Finish(rocksdb::ExternalSstFileInfo*)+0x13
C  [librocksdbjni6204471966138021700.so+0x1ede22]  Java_org_rocksdb_SstFileWriter_finish+0x22
j  org.rocksdb.SstFileWriter.finish(J)V+0
j  org.rocksdb.SstFileWriter.finish()V+5
j  com.vesoft.nebula.tools.importer.writer.NebulaSSTWriter.close()V+4
j  com.vesoft.nebula.tools.importer.processor.VerticesProcessor$$anonfun$process$2.apply(Lscala/collection/Iterator;)V+269
j  com.vesoft.nebula.tools.importer.processor.VerticesProcessor$$anonfun$process$2.apply(Ljava/lang/Object;)Ljava/lang/Object;+5
j  org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$28.apply(Lscala/collection/Iterator;)V+5
j  org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$28.apply(Ljava/lang/Object;)Ljava/lang/Object;+5
j  org.apache.spark.SparkContext$$anonfun$runJob$5.apply(Lorg/apache/spark/TaskContext;Lscala/collection/Iterator;)Ljava/lang/Object;+5
j  org.apache.spark.SparkContext$$anonfun$runJob$5.apply(Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+9
j  org.apache.spark.scheduler.ResultTask.runTask(Lorg/apache/spark/TaskContext;)Ljava/lang/Object;+190
j  org.apache.spark.scheduler.Task.run(JILorg/apache/spark/metrics/MetricsSystem;)Ljava/lang/Object;+210
j  org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply()Ljava/lang/Object;+37
j  org.apache.spark.util.Utils$.tryWithSafeFinally(Lscala/Function0;Lscala/Function0;)Ljava/lang/Object;+3
j  org.apache.spark.executor.Executor$TaskRunner.run()V+383
j  java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+95
j  java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5
j  java.lang.Thread.run()V+11
v  ~StubRoutines::call_stub
V  [libjvm.so+0x6852db]  JavaCalls::call_helper(JavaValue*, methodHandle*, JavaCallArguments*, Thread*)+0xddb
V  [libjvm.so+0x682ba3]  JavaCalls::call_virtual(JavaValue*, KlassHandle, Symbol*, Symbol*, JavaCallArguments*, Thread*)+0x263
V  [libjvm.so+0x683167]  JavaCalls::call_virtual(JavaValue*, Handle, KlassHandle, Symbol*, Symbol*, Thread*)+0x47
V  [libjvm.so+0x6ef0ec]  thread_entry(JavaThread*, Thread*)+0x6c
V  [libjvm.so+0xa76f9b]  JavaThread::thread_main_inner()+0xdb
V  [libjvm.so+0xa7722f]  JavaThread::run()+0x25f
V  [libjvm.so+0x909c92]  java_start(Thread*)+0x102
C  [libpthread.so.0+0x76ba]  start_thread+0xca

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j  org.rocksdb.SstFileWriter.finish(J)V+0
j  org.rocksdb.SstFileWriter.finish()V+5
j  com.vesoft.nebula.tools.importer.writer.NebulaSSTWriter.close()V+4
j  com.vesoft.nebula.tools.importer.processor.VerticesProcessor$$anonfun$process$2.apply(Lscala/collection/Iterator;)V+269
j  com.vesoft.nebula.tools.importer.processor.VerticesProcessor$$anonfun$process$2.apply(Ljava/lang/Object;)Ljava/lang/Object;+5
j  org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$28.apply(Lscala/collection/Iterator;)V+5
j  org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$28.apply(Ljava/lang/Object;)Ljava/lang/Object;+5
j  org.apache.spark.SparkContext$$anonfun$runJob$5.apply(Lorg/apache/spark/TaskContext;Lscala/collection/Iterator;)Ljava/lang/Object;+5
j  org.apache.spark.SparkContext$$anonfun$runJob$5.apply(Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+9
j  org.apache.spark.scheduler.ResultTask.runTask(Lorg/apache/spark/TaskContext;)Ljava/lang/Object;+190
j  org.apache.spark.scheduler.Task.run(JILorg/apache/spark/metrics/MetricsSystem;)Ljava/lang/Object;+210
j  org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply()Ljava/lang/Object;+37
j  org.apache.spark.util.Utils$.tryWithSafeFinally(Lscala/Function0;Lscala/Function0;)Ljava/lang/Object;+3
j  org.apache.spark.executor.Executor$TaskRunner.run()V+383
j  java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+95
j  java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5
j  java.lang.Thread.run()V+11
v  ~StubRoutines::call_stub

---------------  P R O C E S S  ---------------

Java Threads: ( => current thread )
  0x00007fb490042000 JavaThread "task-result-getter-2" daemon [_thread_blocked, id=28448, stack(0x00007fb3e56e8000,0x00007fb3e57e9000)]
  0x00007fb384001000 JavaThread "block-manager-ask-thread-pool-11" daemon [_thread_blocked, id=28447, stack(0x00007fb3e57e9000,0x00007fb3e58ea000)]
  0x00007fb380001000 JavaThread "block-manager-ask-thread-pool-10" daemon [_thread_blocked, id=28446, stack(0x00007fb3e58ea000,0x00007fb3e59eb000)]
  0x00007fb394003000 JavaThread "block-manager-slave-async-thread-pool-11" daemon [_thread_blocked, id=28445, stack(0x00007fb3e59eb000,0x00007fb3e5aec000)]
  0x00007fb394001000 JavaThread "block-manager-slave-async-thread-pool-10" daemon [_thread_blocked, id=28444, stack(0x00007fb3e5aec000,0x00007fb3e5bed000)]
  0x00007fb490040800 JavaThread "block-manager-ask-thread-pool-9" daemon [_thread_blocked, id=28443, stack(0x00007fb3e5bed000,0x00007fb3e5cee000)]
  0x00007fb484010800 JavaThread "block-manager-slave-async-thread-pool-9" daemon [_thread_blocked, id=28442, stack(0x00007fb3e5cee000,0x00007fb3e5def000)]
  0x00007fb39c001000 JavaThread "block-manager-ask-thread-pool-8" daemon [_thread_blocked, id=28441, stack(0x00007fb3e5def000,0x00007fb3e5ef0000)]
  0x00007fb398001000 JavaThread "block-manager-ask-thread-pool-7" daemon [_thread_blocked, id=28440, stack(0x00007fb3e5ef0000,0x00007fb3e5ff1000)]
  0x00007fb3a0003000 JavaThread "block-manager-slave-async-thread-pool-8" daemon [_thread_blocked, id=28439, stack(0x00007fb3e5ff1000,0x00007fb3e60f2000)]
  0x00007fb3a0001000 JavaThread "block-manager-slave-async-thread-pool-7" daemon [_thread_blocked, id=28438, stack(0x00007fb3e60f2000,0x00007fb3e61f3000)]
  0x00007fb490003000 JavaThread "block-manager-slave-async-thread-pool-6" daemon [_thread_blocked, id=28437, stack(0x00007fb3e61f3000,0x00007fb3e62f4000)]
  0x00007fb48400f000 JavaThread "block-manager-ask-thread-pool-6" daemon [_thread_blocked, id=28436, stack(0x00007fb3e62f4000,0x00007fb3e63f5000)]
  0x00007fb490056800 JavaThread "task-result-getter-1" daemon [_thread_blocked, id=28435, stack(0x00007fb3e65f5000,0x00007fb3e66f6000)]
  0x00007fb3f025e800 JavaThread "org.apache.hadoop.hdfs.PeerCache@7ca0900f" daemon [_thread_blocked, id=28434, stack(0x00007fb3e66f6000,0x00007fb3e67f7000)]
  0x00007fb3bc001000 JavaThread "block-manager-ask-thread-pool-5" daemon [_thread_blocked, id=28433, stack(0x00007fb3e67f7000,0x00007fb3e68f8000)]
  0x00007fb3b8001000 JavaThread "block-manager-ask-thread-pool-4" daemon [_thread_blocked, id=28432, stack(0x00007fb3e68f8000,0x00007fb3e69f9000)]
  0x00007fb3cc002800 JavaThread "block-manager-slave-async-thread-pool-5" daemon [_thread_blocked, id=28431, stack(0x00007fb3e69f9000,0x00007fb3e6afa000)]
  0x00007fb3cc001000 JavaThread "block-manager-slave-async-thread-pool-4" daemon [_thread_blocked, id=28430, stack(0x00007fb3e6afa000,0x00007fb3e6bfb000)]
  0x00007fb490055000 JavaThread "block-manager-ask-thread-pool-3" daemon [_thread_blocked, id=28429, stack(0x00007fb3e6bfb000,0x00007fb3e6cfc000)]
  0x00007fb48400d000 JavaThread "block-manager-slave-async-thread-pool-3" daemon [_thread_blocked, id=28428, stack(0x00007fb3e6cfc000,0x00007fb3e6dfd000)]
  0x00007fb3d4001000 JavaThread "block-manager-ask-thread-pool-2" daemon [_thread_blocked, id=28427, stack(0x00007fb3e6dfd000,0x00007fb3e6efe000)]
  0x00007fb3d0002000 JavaThread "block-manager-ask-thread-pool-1" daemon [_thread_blocked, id=28426, stack(0x00007fb3e6efe000,0x00007fb3e6fff000)]
  0x00007fb3d8004000 JavaThread "block-manager-slave-async-thread-pool-2" daemon [_thread_blocked, id=28425, stack(0x00007fb3e6fff000,0x00007fb3e7100000)]
  0x00007fb3d8003000 JavaThread "block-manager-slave-async-thread-pool-1" daemon [_thread_blocked, id=28424, stack(0x00007fb3e7100000,0x00007fb3e7201000)]
  0x00007fb490053000 JavaThread "block-manager-slave-async-thread-pool-0" daemon [_thread_blocked, id=28423, stack(0x00007fb3e7201000,0x00007fb3e7302000)]
  0x00007fb48400b800 JavaThread "block-manager-ask-thread-pool-0" daemon [_thread_blocked, id=28422, stack(0x00007fb3e7302000,0x00007fb3e7403000)]
  0x00007fb49005c800 JavaThread "task-result-getter-0" daemon [_thread_blocked, id=28421, stack(0x00007fb4000ec000,0x00007fb4001ed000)]
  0x00007fb488005800 JavaThread "rpc-server-4-1" daemon [_thread_in_native, id=28418, stack(0x00007fb4023ef000,0x00007fb4024f0000)]
  0x00007fb3f0027000 JavaThread "files-client-8-1" daemon [_thread_in_native, id=28417, stack(0x00007fb4024f0000,0x00007fb4025f1000)]
=>0x00007fb48403b800 JavaThread "Executor task launch worker for task 3" daemon [_thread_in_native, id=28416, stack(0x00007fb4025f1000,0x00007fb4026f2000)]
  0x00007fb5029ad800 JavaThread "IPC Parameter Sending Thread #0" daemon [_thread_blocked, id=28415, stack(0x00007fb403eff000,0x00007fb404000000)]
  0x00007fb5029ac000 JavaThread "IPC Client (1638472859) connection to /192.168.30.71:8020 from datax" daemon [_thread_blocked, id=28414, stack(0x00007fb4c80b3000,0x00007fb4c81b4000)]
  0x00007fb50278e000 JavaThread "org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner" daemon [_thread_blocked, id=28413, stack(0x00007fb4c8a47000,0x00007fb4c8b48000)]
  0x00007fb5026e0000 JavaThread "spark-listener-group-streams" daemon [_thread_blocked, id=28412, stack(0x00007fb4c8b48000,0x00007fb4c8c49000)]
  0x00007fb502417000 JavaThread "spark-listener-group-shared" daemon [_thread_blocked, id=28410, stack(0x00007fb4c9449000,0x00007fb4c954a000)]
  0x00007fb414011800 JavaThread "element-tracking-store-worker" daemon [_thread_blocked, id=28409, stack(0x00007fb4c954a000,0x00007fb4c964b000)]
  0x00007fb5023b1800 JavaThread "spark-listener-group-executorManagement" daemon [_thread_blocked, id=28408, stack(0x00007fb4c964b000,0x00007fb4c974c000)]
  0x00007fb5023af800 JavaThread "spark-listener-group-appStatus" daemon [_thread_blocked, id=28407, stack(0x00007fb4c974c000,0x00007fb4c984d000)]
  0x00007fb5023ac000 JavaThread "context-cleaner-periodic-gc" daemon [_thread_blocked, id=28406, stack(0x00007fb4c984d000,0x00007fb4c994e000)]
  0x00007fb5023aa000 JavaThread "Spark Context Cleaner" daemon [_thread_blocked, id=28405, stack(0x00007fb4c994e000,0x00007fb4c9a4f000)]
  0x00007fb501f2b800 JavaThread "shuffle-boss-6-1" daemon [_thread_in_native, id=28404, stack(0x00007fb4c9ed5000,0x00007fb4c9fd6000)]
  0x00007fb501ed9800 JavaThread "driver-heartbeater" daemon [_thread_blocked, id=28403, stack(0x00007fb4c9fd6000,0x00007fb4ca0d7000)]
  0x00007fb501d9a800 JavaThread "dag-scheduler-event-loop" daemon [_thread_blocked, id=28402, stack(0x00007fb4ca3ec000,0x00007fb4ca4ed000)]
  0x00007fb44000b800 JavaThread "netty-rpc-env-timeout" daemon [_thread_blocked, id=28401, stack(0x00007fb4ca4ed000,0x00007fb4ca5ee000)]
  0x00007fb501c43800 JavaThread "Timer-1" daemon [_thread_blocked, id=28400, stack(0x00007fb4ca0d7000,0x00007fb4ca1d8000)]
  0x00007fb501c42000 JavaThread "Timer-0" daemon [_thread_blocked, id=28399, stack(0x00007fb4ca1d8000,0x00007fb4ca2d9000)]
  0x00007fb48402b800 JavaThread "heartbeat-receiver-event-loop-thread" daemon [_thread_blocked, id=28398, stack(0x00007fb4ca2d9000,0x00007fb4ca3da000)]
  0x00007fb5019b1000 JavaThread "SparkUI-34" daemon [_thread_blocked, id=28397, stack(0x00007fb4ca5ee000,0x00007fb4ca6ef000)]
  0x00007fb5019af000 JavaThread "SparkUI-33" daemon [_thread_blocked, id=28396, stack(0x00007fb4ca6ef000,0x00007fb4ca7f0000)]
  0x00007fb5019ad000 JavaThread "SparkUI-32-acceptor-0@fcae2b6-ServerConnector@10d1d3f{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}" daemon [_thread_in_native, id=28395, stack(0x00007fb4ca7f0000,0x00007fb4ca8f1000)]
  0x00007fb5019ab800 JavaThread "SparkUI-31" daemon [_thread_blocked, id=28394, stack(0x00007fb4ca8f1000,0x00007fb4ca9f2000)]
  0x00007fb5019a9800 JavaThread "SparkUI-30" daemon [_thread_in_native, id=28393, stack(0x00007fb4ca9f2000,0x00007fb4caaf3000)]
  0x00007fb5019a8000 JavaThread "SparkUI-29" daemon [_thread_in_native, id=28392, stack(0x00007fb4caaf3000,0x00007fb4cabf4000)]
  0x00007fb50196e800 JavaThread "SparkUI-28" daemon [_thread_in_native, id=28391, stack(0x00007fb4cabf4000,0x00007fb4cacf5000)]
  0x00007fb501847000 JavaThread "SparkUI-27" daemon [_thread_in_native, id=28390, stack(0x00007fb4cacf5000,0x00007fb4cadf6000)]
  0x00007fb501775800 JavaThread "RemoteBlock-temp-file-clean-thread" daemon [_thread_blocked, id=28389, stack(0x00007fb4caff6000,0x00007fb4cb0f7000)]
  0x00007fb501695800 JavaThread "map-output-dispatcher-7" daemon [_thread_blocked, id=28388, stack(0x00007fb4cb2f7000,0x00007fb4cb3f8000)]
  0x00007fb501694000 JavaThread "map-output-dispatcher-6" daemon [_thread_blocked, id=28387, stack(0x00007fb4cb3f8000,0x00007fb4cb4f9000)]
  0x00007fb501692000 JavaThread "map-output-dispatcher-5" daemon [_thread_blocked, id=28386, stack(0x00007fb4cb4f9000,0x00007fb4cb5fa000)]
  0x00007fb501690000 JavaThread "map-output-dispatcher-4" daemon [_thread_blocked, id=28385, stack(0x00007fb4cb5fa000,0x00007fb4cb6fb000)]
  0x00007fb501624800 JavaThread "map-output-dispatcher-3" daemon [_thread_blocked, id=28384, stack(0x00007fb4cb6fb000,0x00007fb4cb7fc000)]
  0x00007fb501623000 JavaThread "map-output-dispatcher-2" daemon [_thread_blocked, id=28383, stack(0x00007fb4cb7fc000,0x00007fb4cb8fd000)]
  0x00007fb50161f000 JavaThread "map-output-dispatcher-1" daemon [_thread_blocked, id=28382, stack(0x00007fb4cb8fd000,0x00007fb4cb9fe000)]
  0x00007fb50161e000 JavaThread "map-output-dispatcher-0" daemon [_thread_blocked, id=28381, stack(0x00007fb4cb9fe000,0x00007fb4cbaff000)]
  0x00007fb5015d3800 JavaThread "rpc-boss-3-1" daemon [_thread_in_native, id=28380, stack(0x00007fb4cbaff000,0x00007fb4cbc00000)]
  0x00007fb5014be800 JavaThread "dispatcher-event-loop-1" daemon [_thread_blocked, id=28379, stack(0x00007fb4d007a000,0x00007fb4d017b000)]
  0x00007fb5014ba800 JavaThread "dispatcher-event-loop-0" daemon [_thread_blocked, id=28378, stack(0x00007fb4d118c000,0x00007fb4d128d000)]
  0x00007fb5010fc000 JavaThread "process reaper" daemon [_thread_blocked, id=28376, stack(0x00007fb4d128d000,0x00007fb4d12c6000)]
  0x00007fb5000ef800 JavaThread "Service Thread" daemon [_thread_blocked, id=28373, stack(0x00007fb4d3671000,0x00007fb4d3772000)]
  0x00007fb5000d2800 JavaThread "C1 CompilerThread3" daemon [_thread_blocked, id=28372, stack(0x00007fb4d3772000,0x00007fb4d3873000)]
  0x00007fb5000d0800 JavaThread "C2 CompilerThread2" daemon [_thread_blocked, id=28371, stack(0x00007fb4d3873000,0x00007fb4d3974000)]
  0x00007fb5000ce800 JavaThread "C2 CompilerThread1" daemon [_thread_blocked, id=28370, stack(0x00007fb4d3974000,0x00007fb4d3a75000)]
  0x00007fb5000cb800 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=28369, stack(0x00007fb4d3a75000,0x00007fb4d3b76000)]
  0x00007fb5000ca000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=28368, stack(0x00007fb4d80b9000,0x00007fb4d81ba000)]
  0x00007fb500096000 JavaThread "Finalizer" daemon [_thread_blocked, id=28367, stack(0x00007fb4d81ba000,0x00007fb4d82bb000)]
  0x00007fb500093800 JavaThread "Reference Handler" daemon [_thread_blocked, id=28366, stack(0x00007fb4d82bb000,0x00007fb4d83bc000)]
  0x00007fb500010000 JavaThread "main" [_thread_blocked, id=28354, stack(0x00007fb508390000,0x00007fb508491000)]

Other Threads:
  0x00007fb50008a000 VMThread [stack: 0x00007fb4d83bc000,0x00007fb4d84bd000] [id=28365]
  0x00007fb500104800 WatcherThread [stack: 0x00007fb4d3570000,0x00007fb4d3671000] [id=28374]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap:
 PSYoungGen      total 118784K, used 81014K [0x00000000eab00000, 0x00000000ffd00000, 0x0000000100000000)
  eden space 116736K, 68% used [0x00000000eab00000,0x00000000ef892288,0x00000000f1d00000)
  from space 2048K, 77% used [0x00000000f1d00000,0x00000000f1e8b8a0,0x00000000f1f00000)
  to   space 114688K, 0% used [0x00000000f8d00000,0x00000000f8d00000,0x00000000ffd00000)
 ParOldGen       total 699392K, used 288929K [0x00000000c0000000, 0x00000000eab00000, 0x00000000eab00000)
  object space 699392K, 41% used [0x00000000c0000000,0x00000000d1a28460,0x00000000eab00000)
 Metaspace       used 86448K, capacity 87260K, committed 87552K, reserved 1124352K
  class space    used 12517K, capacity 12733K, committed 12800K, reserved 1048576K

Card table byte_map: [0x00007fb504f34000,0x00007fb505135000] byte_map_base: 0x00007fb504934000

Marking Bits: (ParMarkBitMap*) 0x00007fb507866d40
 Begin Bits: [0x00007fb4da000000, 0x00007fb4db000000)
 End Bits:   [0x00007fb4db000000, 0x00007fb4dc000000)

Polling page: 0x00007fb5084ab000

CodeCache: size=245760Kb used=19660Kb max_used=19660Kb free=226099Kb
 bounds [0x00007fb4f1000000, 0x00007fb4f2360000, 0x00007fb500000000]
 total_blobs=7470 nmethods=6769 adapters=611
 compilation: enabled

Compilation events (10 events):
Event: 16.061 Thread 0x00007fb5000d0800 nmethod 7895 0x00007fb4f2347390 code [0x00007fb4f23474e0, 0x00007fb4f2347618]
Event: 16.061 Thread 0x00007fb5000d2800 nmethod 7897 0x00007fb4f23480d0 code [0x00007fb4f2348280, 0x00007fb4f2348930]
Event: 16.061 Thread 0x00007fb5000d2800 7900       3       org.apache.xerces.parsers.XML11Configuration::addComponent (27 bytes)
Event: 16.062 Thread 0x00007fb5000d2800 nmethod 7900 0x00007fb4f234b390 code [0x00007fb4f234b580, 0x00007fb4f234bd88]
Event: 16.062 Thread 0x00007fb5000d2800 7903   !   3       java.net.URLClassLoader::getResourceAsStream (137 bytes)
Event: 16.062 Thread 0x00007fb5000ce800 7904       4       org.apache.xerces.dom.ElementImpl::getDefaultAttributes (48 bytes)
Event: 16.063 Thread 0x00007fb5000cb800 nmethod 7889 0x00007fb4f234f890 code [0x00007fb4f234faa0, 0x00007fb4f23504f8]
Event: 16.063 Thread 0x00007fb5000d2800 nmethod 7903 0x00007fb4f234c9d0 code [0x00007fb4f234cc00, 0x00007fb4f234dc48]
Event: 16.064 Thread 0x00007fb5000d2800 7905   !   3       com.google.common.collect.MapMakerInternalMap$Segment::runLockedCleanup (38 bytes)
Event: 16.064 Thread 0x00007fb5000ce800 nmethod 7904 0x00007fb4f2341890 code [0x00007fb4f23419e0, 0x00007fb4f2341ad8]

GC Heap History (10 events):
Event: 12.100 GC heap before
{Heap before GC invocations=31 (full 4):
 PSYoungGen      total 232960K, used 133216K [0x00000000eab00000, 0x0000000100000000, 0x0000000100000000)
  eden space 116736K, 100% used [0x00000000eab00000,0x00000000f1d00000,0x00000000f1d00000)
  from space 116224K, 14% used [0x00000000f8e80000,0x00000000f9e98010,0x0000000100000000)
  to   space 116224K, 0% used [0x00000000f1d00000,0x00000000f1d00000,0x00000000f8e80000)
 ParOldGen       total 699392K, used 256033K [0x00000000c0000000, 0x00000000eab00000, 0x00000000eab00000)
  object space 699392K, 36% used [0x00000000c0000000,0x00000000cfa08440,0x00000000eab00000)
 Metaspace       used 84670K, capacity 85438K, committed 85504K, reserved 1122304K
  class space    used 12293K, capacity 12496K, committed 12544K, reserved 1048576K
Event: 12.106 GC heap after
Heap after GC invocations=31 (full 4):
 PSYoungGen      total 232960K, used 16512K [0x00000000eab00000, 0x0000000100000000, 0x0000000100000000)
  eden space 116736K, 0% used [0x00000000eab00000,0x00000000eab00000,0x00000000f1d00000)
  from space 116224K, 14% used [0x00000000f1d00000,0x00000000f2d20010,0x00000000f8e80000)
  to   space 116224K, 0% used [0x00000000f8e80000,0x00000000f8e80000,0x0000000100000000)
 ParOldGen       total 699392K, used 256033K [0x00000000c0000000, 0x00000000eab00000, 0x00000000eab00000)
  object space 699392K, 36% used [0x00000000c0000000,0x00000000cfa08440,0x00000000eab00000)
 Metaspace       used 84670K, capacity 85438K, committed 85504K, reserved 1122304K
  class space    used 12293K, capacity 12496K, committed 12544K, reserved 1048576K
}
Event: 12.297 GC heap before
{Heap before GC invocations=32 (full 4):
 PSYoungGen      total 232960K, used 133248K [0x00000000eab00000, 0x0000000100000000, 0x0000000100000000)
  eden space 116736K, 100% used [0x00000000eab00000,0x00000000f1d00000,0x00000000f1d00000)
  from space 116224K, 14% used [0x00000000f1d00000,0x00000000f2d20010,0x00000000f8e80000)
  to   space 116224K, 0% used [0x00000000f8e80000,0x00000000f8e80000,0x0000000100000000)
 ParOldGen       total 699392K, used 256033K [0x00000000c0000000, 0x00000000eab00000, 0x00000000eab00000)
  object space 699392K, 36% used [0x00000000c0000000,0x00000000cfa08440,0x00000000eab00000)
 Metaspace       used 84670K, capacity 85438K, committed 85504K, reserved 1122304K
  class space    used 12293K, capacity 12496K, committed 12544K, reserved 1048576K
Event: 12.304 GC heap after
Heap after GC invocations=32 (full 4):
 PSYoungGen      total 232960K, used 16448K [0x00000000eab00000, 0x0000000100000000, 0x0000000100000000)
  eden space 116736K, 0% used [0x00000000eab00000,0x00000000eab00000,0x00000000f1d00000)
  from space 116224K, 14% used [0x00000000f8e80000,0x00000000f9e90010,0x0000000100000000)
  to   space 116224K, 0% used [0x00000000f1d00000,0x00000000f1d00000,0x00000000f8e80000)
 ParOldGen       total 699392K, used 256041K [0x00000000c0000000, 0x00000000eab00000, 0x00000000eab00000)
  object space 699392K, 36% used [0x00000000c0000000,0x00000000cfa0a440,0x00000000eab00000)
 Metaspace       used 84670K, capacity 85438K, committed 85504K, reserved 1122304K
  class space    used 12293K, capacity 12496K, committed 12544K, reserved 1048576K
}
Event: 12.469 GC heap before
{Heap before GC invocations=33 (full 4):
 PSYoungGen      total 232960K, used 133184K [0x00000000eab00000, 0x0000000100000000, 0x0000000100000000)
  eden space 116736K, 100% used [0x00000000eab00000,0x00000000f1d00000,0x00000000f1d00000)
  from space 116224K, 14% used [0x00000000f8e80000,0x00000000f9e90010,0x0000000100000000)
  to   space 116224K, 0% used [0x00000000f1d00000,0x00000000f1d00000,0x00000000f8e80000)
 ParOldGen       total 699392K, used 256041K [0x00000000c0000000, 0x00000000eab00000, 0x00000000eab00000)
  object space 699392K, 36% used [0x00000000c0000000,0x00000000cfa0a440,0x00000000eab00000)
 Metaspace       used 84670K, capacity 85438K, committed 85504K, reserved 1122304K
  class space    used 12293K, capacity 12496K, committed 12544K, reserved 1048576K
Event: 12.481 GC heap after
Heap after GC invocations=33 (full 4):
 PSYoungGen      total 232960K, used 16480K [0x00000000eab00000, 0x0000000100000000, 0x0000000100000000)
  eden space 116736K, 0% used [0x00000000eab00000,0x00000000eab00000,0x00000000f1d00000)
  from space 116224K, 14% used [0x00000000f1d00000,0x00000000f2d18010,0x00000000f8e80000)
  to   space 116224K, 0% used [0x00000000f8e80000,0x00000000f8e80000,0x0000000100000000)
 ParOldGen       total 699392K, used 272449K [0x00000000c0000000, 0x00000000eab00000, 0x00000000eab00000)
  object space 699392K, 38% used [0x00000000c0000000,0x00000000d0a10450,0x00000000eab00000)
 Metaspace       used 84670K, capacity 85438K, committed 85504K, reserved 1122304K
  class space    used 12293K, capacity 12496K, committed 12544K, reserved 1048576K
}
Event: 12.728 GC heap before
{Heap before GC invocations=34 (full 4):
 PSYoungGen      total 232960K, used 133216K [0x00000000eab00000, 0x0000000100000000, 0x0000000100000000)
  eden space 116736K, 100% used [0x00000000eab00000,0x00000000f1d00000,0x00000000f1d00000)
  from space 116224K, 14% used [0x00000000f1d00000,0x00000000f2d18010,0x00000000f8e80000)
  to   space 116224K, 0% used [0x00000000f8e80000,0x00000000f8e80000,0x0000000100000000)
 ParOldGen       total 699392K, used 272449K [0x00000000c0000000, 0x00000000eab00000, 0x00000000eab00000)
  object space 699392K, 38% used [0x00000000c0000000,0x00000000d0a10450,0x00000000eab00000)
 Metaspace       used 84721K, capacity 85502K, committed 85760K, reserved 1122304K
  class space    used 12295K, capacity 12496K, committed 12544K, reserved 1048576K
Event: 12.733 GC heap after
Heap after GC invocations=34 (full 4):
 PSYoungGen      total 232960K, used 192K [0x00000000eab00000, 0x0000000100000000, 0x0000000100000000)
  eden space 116736K, 0% used [0x00000000eab00000,0x00000000eab00000,0x00000000f1d00000)
  from space 116224K, 0% used [0x00000000f8e80000,0x00000000f8eb0000,0x0000000100000000)
  to   space 116224K, 0% used [0x00000000f1d00000,0x00000000f1d00000,0x00000000f8e80000)
 ParOldGen       total 699392K, used 288857K [0x00000000c0000000, 0x00000000eab00000, 0x00000000eab00000)
  object space 699392K, 41% used [0x00000000c0000000,0x00000000d1a16460,0x00000000eab00000)
 Metaspace       used 84721K, capacity 85502K, committed 85760K, reserved 1122304K
  class space    used 12295K, capacity 12496K, committed 12544K, reserved 1048576K
}
Event: 15.447 GC heap before
{Heap before GC invocations=35 (full 4):
 PSYoungGen      total 232960K, used 116928K [0x00000000eab00000, 0x0000000100000000, 0x0000000100000000)
  eden space 116736K, 100% used [0x00000000eab00000,0x00000000f1d00000,0x00000000f1d00000)
  from space 116224K, 0% used [0x00000000f8e80000,0x00000000f8eb0000,0x0000000100000000)
  to   space 116224K, 0% used [0x00000000f1d00000,0x00000000f1d00000,0x00000000f8e80000)
 ParOldGen       total 699392K, used 288857K [0x00000000c0000000, 0x00000000eab00000, 0x00000000eab00000)
  object space 699392K, 41% used [0x00000000c0000000,0x00000000d1a16460,0x00000000eab00000)
 Metaspace       used 85856K, capacity 86680K, committed 86912K, reserved 1124352K
  class space    used 12475K, capacity 12669K, committed 12672K, reserved 1048576K
Event: 15.451 GC heap after
Heap after GC invocations=35 (full 4):
 PSYoungGen      total 118784K, used 1582K [0x00000000eab00000, 0x00000000ffd00000, 0x0000000100000000)
  eden space 116736K, 0% used [0x00000000eab00000,0x00000000eab00000,0x00000000f1d00000)
  from space 2048K, 77% used [0x00000000f1d00000,0x00000000f1e8b8a0,0x00000000f1f00000)
  to   space 114688K, 0% used [0x00000000f8d00000,0x00000000f8d00000,0x00000000ffd00000)
 ParOldGen       total 699392K, used 288929K [0x00000000c0000000, 0x00000000eab00000, 0x00000000eab00000)
  object space 699392K, 41% used [0x00000000c0000000,0x00000000d1a28460,0x00000000eab00000)
 Metaspace       used 85856K, capacity 86680K, committed 86912K, reserved 1124352K
  class space    used 12475K, capacity 12669K, committed 12672K, reserved 1048576K
}

Deoptimization events (10 events):
Event: 15.892 Thread 0x00007fb48403b800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007fb4f11b6d7c method=org.apache.spark.util.collection.unsafe.sort.UnsafeInMemorySorter$SortComparator.compare(Lorg/apache/spark/util/collection/unsafe/sort/RecordPointerAndKeyPrefix;Lorg/apa
Event: 15.892 Thread 0x00007fb48403b800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007fb4f2160b00 method=org.apache.spark.util.collection.unsafe.sort.UnsafeInMemorySorter$SortComparator.compare(Lorg/apache/spark/util/collection/unsafe/sort/RecordPointerAndKeyPrefix;Lorg/apa
Event: 15.892 Thread 0x00007fb48403b800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007fb4f2156a40 method=org.apache.spark.util.collection.unsafe.sort.UnsafeInMemorySorter$SortComparator.compare(Lorg/apache/spark/util/collection/unsafe/sort/RecordPointerAndKeyPrefix;Lorg/apa
Event: 15.892 Thread 0x00007fb48403b800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007fb4f2150ad4 method=org.apache.spark.util.collection.unsafe.sort.UnsafeInMemorySorter$SortComparator.compare(Lorg/apache/spark/util/collection/unsafe/sort/RecordPointerAndKeyPrefix;Lorg/apa
Event: 15.892 Thread 0x00007fb48403b800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007fb4f21478fc method=org.apache.spark.util.collection.unsafe.sort.UnsafeInMemorySorter$SortComparator.compare(Lorg/apache/spark/util/collection/unsafe/sort/RecordPointerAndKeyPrefix;Lorg/apa
Event: 15.895 Thread 0x00007fb48403b800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007fb4f2145c88 method=org.apache.spark.util.collection.unsafe.sort.UnsafeInMemorySorter$SortComparator.compare(Lorg/apache/spark/util/collection/unsafe/sort/RecordPointerAndKeyPrefix;Lorg/apa
Event: 16.029 Thread 0x00007fb48403b800 Uncommon trap: reason=speculate_class_check action=maybe_recompile pc=0x00007fb4f212275c method=org.apache.spark.sql.execution.BufferedRowIterator.hasNext()Z @ 11
Event: 16.029 Thread 0x00007fb48403b800 Uncommon trap: reason=speculate_class_check action=maybe_recompile pc=0x00007fb4f212275c method=org.apache.spark.sql.execution.BufferedRowIterator.hasNext()Z @ 11
Event: 16.029 Thread 0x00007fb48403b800 Uncommon trap: reason=speculate_class_check action=maybe_recompile pc=0x00007fb4f212275c method=org.apache.spark.sql.execution.BufferedRowIterator.hasNext()Z @ 11
Event: 16.064 Thread 0x00007fb48403b800 Uncommon trap: reason=unstable_if action=reinterpret pc=0x00007fb4f148acb8 method=java.util.HashMap.hash(Ljava/lang/Object;)I @ 1

Classes redefined (0 events):
No events

Internal exceptions (10 events):
Event: 8.553 Thread 0x00007fb500010000 Exception <a 'java/lang/NoSuchMethodError': <clinit>> (0x00000000f2df9c10) thrown at [/HUDSON/workspace/8-2-build-linux-amd64/jdk8u191/11894/hotspot/src/share/vm/prims/jni.cpp, line 1613]
Event: 8.553 Thread 0x00007fb500010000 Exception <a 'java/lang/NoSuchMethodError': <clinit>> (0x00000000f2e05118) thrown at [/HUDSON/workspace/8-2-build-linux-amd64/jdk8u191/11894/hotspot/src/share/vm/prims/jni.cpp, line 1613]
Event: 8.553 Thread 0x00007fb500010000 Exception <a 'java/lang/NoSuchMethodError': <clinit>> (0x00000000f2e14da8) thrown at [/HUDSON/workspace/8-2-build-linux-amd64/jdk8u191/11894/hotspot/src/share/vm/prims/jni.cpp, line 1613]
Event: 8.580 Thread 0x00007fb501d9a800 Exception <a 'java/lang/NoSuchMethodError': <clinit>> (0x00000000f32306a8) thrown at [/HUDSON/workspace/8-2-build-linux-amd64/jdk8u191/11894/hotspot/src/share/vm/prims/jni.cpp, line 1613]
Event: 8.592 Thread 0x00007fb5014be800 Exception <a 'java/lang/NoSuchMethodError': <clinit>> (0x00000000f231e340) thrown at [/HUDSON/workspace/8-2-build-linux-amd64/jdk8u191/11894/hotspot/src/share/vm/prims/jni.cpp, line 1613]
Event: 8.608 Thread 0x00007fb48403b800 Implicit null exception at 0x00007fb4f1e6f4f4 to 0x00007fb4f1e6f9ed
Event: 8.633 Thread 0x00007fb48403b800 Implicit null exception at 0x00007fb4f1e96fd5 to 0x00007fb4f1e9809d
Event: 15.315 Thread 0x00007fb5014ba800 Exception <a 'java/lang/NoSuchMethodError': <clinit>> (0x00000000f08852a0) thrown at [/HUDSON/workspace/8-2-build-linux-amd64/jdk8u191/11894/hotspot/src/share/vm/prims/jni.cpp, line 1613]
Event: 15.468 Thread 0x00007fb48403b800 Implicit null exception at 0x00007fb4f2118a19 to 0x00007fb4f2118ec1
Event: 16.064 Thread 0x00007fb48403b800 Implicit null exception at 0x00007fb4f148aa75 to 0x00007fb4f148aca9

Events (10 events):
Event: 16.029 Thread 0x00007fb48403b800 DEOPT PACKING pc=0x00007fb4f212275c sp=0x00007fb4026effe0
Event: 16.029 Thread 0x00007fb48403b800 DEOPT UNPACKING pc=0x00007fb4f104573a sp=0x00007fb4026f0010 mode 2
Event: 16.029 Thread 0x00007fb48403b800 Uncommon trap: trap_request=0xffffff76 fr.pc=0x00007fb4f212275c
Event: 16.029 Thread 0x00007fb48403b800 DEOPT PACKING pc=0x00007fb4f212275c sp=0x00007fb4026effe0
Event: 16.029 Thread 0x00007fb48403b800 DEOPT UNPACKING pc=0x00007fb4f104573a sp=0x00007fb4026f0010 mode 2
Event: 16.053 loading class com/vesoft/nebula/tools/importer/utils/HDFSUtils$
Event: 16.053 loading class com/vesoft/nebula/tools/importer/utils/HDFSUtils$ done
Event: 16.064 Thread 0x00007fb48403b800 Uncommon trap: trap_request=0xffffff65 fr.pc=0x00007fb4f148acb8
Event: 16.064 Thread 0x00007fb48403b800 DEOPT PACKING pc=0x00007fb4f148acb8 sp=0x00007fb4026efc60
Event: 16.064 Thread 0x00007fb48403b800 DEOPT UNPACKING pc=0x00007fb4f104573a sp=0x00007fb4026efbd0 mode 2


Dynamic libraries:
00400000-00401000 r-xp 00000000 08:02 20583299                           /home/lsz/jdk1.8.0_191/bin/java
00600000-00601000 r--p 00000000 08:02 20583299                           /home/lsz/jdk1.8.0_191/bin/java
00601000-00602000 rw-p 00001000 08:02 20583299                           /home/lsz/jdk1.8.0_191/bin/java
00a37000-00a58000 rw-p 00000000 00:00 0                                  [heap]
c0000000-ffd00000 rw-p 00000000 00:00 0 
ffd00000-100000000 ---p 00000000 00:00 0 
100000000-100c80000 rw-p 00000000 00:00 0 
100c80000-140000000 ---p 00000000 00:00 0 
7fb378000000-7fb378021000 rw-p 00000000 00:00 0 
7fb378021000-7fb37c000000 ---p 00000000 00:00 0 

......
 
7fb3e0021000-7fb3e4000000 ---p 00000000 00:00 0 
7fb3e4031000-7fb3e4047000 r-xp 00000000 08:02 16519623                   /lib/x86_64-linux-gnu/libgcc_s.so.1
7fb3e4047000-7fb3e4246000 ---p 00016000 08:02 16519623                   /lib/x86_64-linux-gnu/libgcc_s.so.1
7fb3e4246000-7fb3e4247000 rw-p 00015000 08:02 16519623                   /lib/x86_64-linux-gnu/libgcc_s.so.1
7fb3e4247000-7fb3e43b9000 r-xp 00000000 08:02 18743325                   /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21
7fb3e43b9000-7fb3e45b9000 ---p 00172000 08:02 18743325                   /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21
7fb3e45b9000-7fb3e45c3000 r--p 00172000 08:02 18743325                   /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21
7fb3e45c3000-7fb3e45c5000 rw-p 0017c000 08:02 18743325                   /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21
7fb3e45c5000-7fb3e45c9000 rw-p 00000000 00:00 0 
7fb3e45c9000-7fb3e4cff000 r-xp 00000000 08:02 14158198                   /tmp/librocksdbjni6204471966138021700.so
7fb3e4cff000-7fb3e4eff000 ---p 00736000 08:02 14158198                   /tmp/librocksdbjni6204471966138021700.so
7fb3e4eff000-7fb3e4f13000 r--p 00736000 08:02 14158198                   /tmp/librocksdbjni6204471966138021700.so
7fb3e4f13000-7fb3e4f1d000 rw-p 0074a000 08:02 14158198                   /tmp/librocksdbjni6204471966138021700.so
7fb3e4f1d000-7fb3e4f24000 rw-p 00000000 00:00 0 
7fb3e4f24000-7fb3e50dc000 r-xp 00000000 08:02 18755746                   /usr/lib/libnebula_codec.so
7fb3e50dc000-7fb3e52dc000 ---p 001b8000 08:02 18755746                   /usr/lib/libnebula_codec.so
7fb3e52dc000-7fb3e52e5000 r--p 001b8000 08:02 18755746                   /usr/lib/libnebula_codec.so
7fb3e52e5000-7fb3e52e9000 rw-p 001c1000 08:02 18755746                   /usr/lib/libnebula_codec.so
7fb3e52e9000-7fb3e52fc000 rw-p 00000000 00:00 0 
7fb3e52fc000-7fb3e53a5000 r--p 00000000 08:02 14158089                   /tmp/libnebula_codec.so
7fb3e53a5000-7fb3e5482000 r-xp 000a9000 08:02 14158089                   /tmp/libnebula_codec.so
7fb3e5482000-7fb3e54c7000 r--p 00186000 08:02 14158089                   /tmp/libnebula_codec.so
7fb3e54c7000-7fb3e54c8000 ---p 001cb000 08:02 14158089                   /tmp/libnebula_codec.so
7fb3e54c8000-7fb3e54d1000 r--p 001cb000 08:02 14158089                   /tmp/libnebula_codec.so
7fb3e54d1000-7fb3e54d5000 rw-p 001d4000 08:02 14158089                   /tmp/libnebula_codec.so
7fb3e54d5000-7fb3e55e8000 rw-p 00000000 00:00 0 
......
7fb3e7305000-7fb3e7603000 rw-p 00000000 00:00 0 
7fb3e7603000-7fb3e8000000 r--s 0aeb4000 08:02 14293272                   /tmp/spark-696e8eec-ce5f-42a3-913a-eb3ac259e638/userFiles-4b9fbea2-2158-4c8d-a378-158a533037c9/exchange-1.1.0.jar
7fb3e8000000-7fb3e8021000 rw-p 00000000 00:00 0 
7fb3e8021000-7fb3ec000000 ---p 00000000 00:00 0 

....

7fb4025f4000-7fb4028f2000 rw-p 00000000 00:00 0 
7fb4028f2000-7fb402af2000 rw-p 00000000 00:00 0 
7fb402af2000-7fb402aff000 r-xp 00000000 08:02 14158088                   /tmp/liblz4-java241143278026293395.so
7fb402aff000-7fb402cfe000 ---p 0000d000 08:02 14158088                   /tmp/liblz4-java241143278026293395.so
7fb402cfe000-7fb402cff000 rw-p 0000c000 08:02 14158088                   /tmp/liblz4-java241143278026293395.so
7fb402cff000-7fb402eff000 rw-p 00000000 00:00 0 
7fb402eff000-7fb4030ff000 rw-p 00000000 00:00 0 
7fb4030ff000-7fb4032ff000 rw-p 00000000 00:00 0 
7fb4032ff000-7fb4034ff000 rw-p 00000000 00:00 0 

......

7fb4cb2f7000-7fb4cb2fa000 ---p 00000000 00:00 0 
7fb4cb2fa000-7fb4cb3f8000 rw-p 00000000 00:00 0 
7fb4cb3f8000-7fb4cb3fb000 ---p 00000000 00:00 0 
7fb4cb3fb000-7fb4cb4f9000 rw-p 00000000 00:00 0 
7fb4cb4f9000-7fb4cb4fc000 ---p 00000000 00:00 0 
7fb4cb4fc000-7fb4cb5fa000 rw-p 00000000 00:00 0 
7fb4cb5fa000-7fb4cb5fd000 ---p 00000000 00:00 0 
7fb4cb5fd000-7fb4cb6fb000 rw-p 00000000 00:00 0 
7fb4cb6fb000-7fb4cb6fe000 ---p 00000000 00:00 0 
7fb4cb6fe000-7fb4cb7fc000 rw-p 00000000 00:00 0 
7fb4cb7fc000-7fb4cb7ff000 ---p 00000000 00:00 0 
7fb4cb7ff000-7fb4cb8fd000 rw-p 00000000 00:00 0 
7fb4cb8fd000-7fb4cb900000 ---p 00000000 00:00 0 
7fb4cb900000-7fb4cb9fe000 rw-p 00000000 00:00 0 
7fb4cb9fe000-7fb4cba01000 ---p 00000000 00:00 0 
7fb4cba01000-7fb4cbaff000 rw-p 00000000 00:00 0 
7fb4cbaff000-7fb4cbb02000 ---p 00000000 00:00 0 
7fb4cbb02000-7fb4cbe00000 rw-p 00000000 00:00 0 
7fb4cbe00000-7fb4cc000000 rw-p 00000000 00:00 0 
7fb4cc000000-7fb4cc021000 rw-p 00000000 00:00 0 
7fb4cc021000-7fb4d0000000 ---p 00000000 00:00 0 
7fb4d007a000-7fb4d007d000 ---p 00000000 00:00 0 
7fb4d007d000-7fb4d017b000 rw-p 00000000 00:00 0 
7fb4d017b000-7fb4d018c000 r-xp 00000000 08:02 133674                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libnio.so
7fb4d018c000-7fb4d038b000 ---p 00011000 08:02 133674                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libnio.so
7fb4d038b000-7fb4d038c000 r--p 00010000 08:02 133674                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libnio.so
7fb4d038c000-7fb4d038d000 rw-p 00011000 08:02 133674                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libnio.so
7fb4d038d000-7fb4d0d8a000 r--s 0aeb4000 08:02 17040561                   /home/lsz/nebula/exchange_1/target/exchange-1.1.0.jar
7fb4d0d8a000-7fb4d0f8a000 rw-p 00000000 00:00 0 
7fb4d0f8a000-7fb4d0f8b000 r-xp 00000000 08:02 133656                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libjaas_unix.so
7fb4d0f8b000-7fb4d118a000 ---p 00001000 08:02 133656                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libjaas_unix.so
7fb4d118a000-7fb4d118b000 r--p 00000000 08:02 133656                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libjaas_unix.so
7fb4d118b000-7fb4d118c000 rw-p 00001000 08:02 133656                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libjaas_unix.so
7fb4d118c000-7fb4d118f000 ---p 00000000 00:00 0 
7fb4d118f000-7fb4d128d000 rw-p 00000000 00:00 0 
7fb4d128d000-7fb4d1290000 ---p 00000000 00:00 0 
7fb4d1290000-7fb4d14c6000 rw-p 00000000 00:00 0 
7fb4d14c6000-7fb4d14ce000 r-xp 00000000 08:02 133679                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libmanagement.so
7fb4d14ce000-7fb4d16ce000 ---p 00008000 08:02 133679                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libmanagement.so
7fb4d16ce000-7fb4d16cf000 r--p 00008000 08:02 133679                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libmanagement.so
7fb4d16cf000-7fb4d16d0000 rw-p 00009000 08:02 133679                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libmanagement.so
7fb4d16d0000-7fb4d18d0000 rw-p 00000000 00:00 0 
7fb4d18d0000-7fb4d18e7000 r-xp 00000000 08:02 16516484                   /lib/x86_64-linux-gnu/libresolv-2.23.so
7fb4d18e7000-7fb4d1ae7000 ---p 00017000 08:02 16516484                   /lib/x86_64-linux-gnu/libresolv-2.23.so
7fb4d1ae7000-7fb4d1ae8000 r--p 00017000 08:02 16516484                   /lib/x86_64-linux-gnu/libresolv-2.23.so
7fb4d1ae8000-7fb4d1ae9000 rw-p 00018000 08:02 16516484                   /lib/x86_64-linux-gnu/libresolv-2.23.so
7fb4d1ae9000-7fb4d1aeb000 rw-p 00000000 00:00 0 
7fb4d1aeb000-7fb4d1af0000 r-xp 00000000 08:02 16516263                   /lib/x86_64-linux-gnu/libnss_dns-2.23.so
7fb4d1af0000-7fb4d1cf0000 ---p 00005000 08:02 16516263                   /lib/x86_64-linux-gnu/libnss_dns-2.23.so
7fb4d1cf0000-7fb4d1cf1000 r--p 00005000 08:02 16516263                   /lib/x86_64-linux-gnu/libnss_dns-2.23.so
7fb4d1cf1000-7fb4d1cf2000 rw-p 00006000 08:02 16516263                   /lib/x86_64-linux-gnu/libnss_dns-2.23.so
7fb4d1cf2000-7fb4d1cf4000 r-xp 00000000 08:02 16519690                   /lib/x86_64-linux-gnu/libnss_mdns4_minimal.so.2
7fb4d1cf4000-7fb4d1ef3000 ---p 00002000 08:02 16519690                   /lib/x86_64-linux-gnu/libnss_mdns4_minimal.so.2
7fb4d1ef3000-7fb4d1ef4000 r--p 00001000 08:02 16519690                   /lib/x86_64-linux-gnu/libnss_mdns4_minimal.so.2
7fb4d1ef4000-7fb4d1ef5000 rw-p 00002000 08:02 16519690                   /lib/x86_64-linux-gnu/libnss_mdns4_minimal.so.2
7fb4d1f03000-7fb4d1f06000 r--s 0001a000 08:02 133687                     /home/lsz/jdk1.8.0_191/jre/lib/jce.jar
7fb4d1f06000-7fb4d1f0b000 r--s 000a0000 08:02 133511                     /home/lsz/jdk1.8.0_191/jre/lib/jsse.jar
7fb4d1f0b000-7fb4d220b000 rw-p 00000000 00:00 0 
7fb4d220b000-7fb4d2221000 r-xp 00000000 08:02 133671                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libnet.so
7fb4d2221000-7fb4d2420000 ---p 00016000 08:02 133671                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libnet.so
7fb4d2420000-7fb4d2421000 r--p 00015000 08:02 133671                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libnet.so
7fb4d2421000-7fb4d2422000 rw-p 00016000 08:02 133671                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libnet.so
7fb4d2422000-7fb4d2622000 rw-p 00000000 00:00 0 
7fb4d2622000-7fb4d2685000 r--s 004de000 08:02 16782573                   /usr/local/spark/jars/hive-metastore-1.2.1.spark2.jar
7fb4d2685000-7fb4d269e000 r--s 000f4000 08:02 16782545                   /usr/local/spark/jars/parquet-column-1.10.1.jar
7fb4d269e000-7fb4d26a8000 r--s 0009a000 08:02 16782510                   /usr/local/spark/jars/scala-xml_2.11-1.0.5.jar
7fb4d26a8000-7fb4d26ad000 r--s 0003e000 08:02 16782454                   /usr/local/spark/jars/commons-net-3.1.jar
7fb4d26ad000-7fb4d26b1000 r--s 00014000 08:02 16782562                   /usr/local/spark/jars/parquet-common-1.10.1.jar
7fb4d26b1000-7fb4d26c5000 r--s 0016b000 08:02 16782407                   /usr/local/spark/jars/orc-core-1.5.5-nohive.jar
7fb4d26c5000-7fb4d26c7000 r--s 00012000 08:02 16782379                   /usr/local/spark/jars/arrow-memory-0.10.0.jar
7fb4d26c7000-7fb4d26d5000 r--s 00089000 08:02 16782365                   /usr/local/spark/jars/json4s-scalap_2.11-3.5.3.jar
7fb4d26d5000-7fb4d26d7000 r--s 0000b000 08:02 16782371                   /usr/local/spark/jars/arrow-format-0.10.0.jar
7fb4d26d7000-7fb4d26f0000 r--s 00164000 08:02 16782380                   /usr/local/spark/jars/hadoop-mapreduce-client-core-2.7.3.jar
7fb4d26f0000-7fb4d26fd000 r--s 00071000 08:02 16782471                   /usr/local/spark/jars/jackson-module-scala_2.11-2.6.7.1.jar
7fb4d26fd000-7fb4d27c4000 r--s 008b0000 08:02 16782444                   /usr/local/spark/jars/spark-sql_2.11-2.4.7.jar
7fb4d27c4000-7fb4d27d1000 r--s 00083000 08:02 16782544                   /usr/local/spark/jars/commons-collections-3.2.2.jar
7fb4d27d1000-7fb4d27d2000 r--s 00003000 08:02 16782447                   /usr/local/spark/jars/spark-tags_2.11-2.4.7.jar
7fb4d27d2000-7fb4d27d9000 r--s 00049000 08:02 16782468                   /usr/local/spark/jars/httpcore-4.4.10.jar
7fb4d27d9000-7fb4d27da000 r--s 00009000 08:02 16782500                   /usr/local/spark/jars/hive-cli-1.2.1.spark2.jar
7fb4d27da000-7fb4d27e1000 r--s 00039000 08:02 16782587                   /usr/local/spark/jars/calcite-avatica-1.2.0-incubating.jar
7fb4d27e1000-7fb4d27f7000 r--s 001a4000 08:02 16782459                   /usr/local/spark/jars/datanucleus-rdbms-3.2.9.jar
7fb4d27f7000-7fb4d27f9000 r--s 0000c000 08:02 16782547                   /usr/local/spark/jars/spark-kvstore_2.11-2.4.7.jar
7fb4d27f9000-7fb4d27ff000 r--s 0003c000 08:02 16782410                   /usr/local/spark/jars/snakeyaml-1.15.jar
7fb4d27ff000-7fb4d2800000 r--s 00000000 08:02 16782398                   /usr/local/spark/jars/kubernetes-model-common-4.6.1.jar
7fb4d2800000-7fb4d2819000 r--s 0012c000 08:02 16782507                   /usr/local/spark/jars/netty-3.9.9.Final.jar
7fb4d2819000-7fb4d281c000 r--s 0000e000 08:02 16782528                   /usr/local/spark/jars/jersey-container-servlet-core-2.22.2.jar
7fb4d281c000-7fb4d282d000 r--s 0010c000 08:02 16782423                   /usr/local/spark/jars/jackson-databind-2.6.7.3.jar
7fb4d282d000-7fb4d282e000 r--s 00001000 08:02 16782575                   /usr/local/spark/jars/javax.inject-2.4.0-b34.jar
7fb4d282e000-7fb4d282f000 r--s 00002000 08:02 16782446                   /usr/local/spark/jars/jpam-1.1.jar
7fb4d282f000-7fb4d2853000 r--s 001cd000 08:02 16782452                   /usr/local/spark/jars/commons-math3-3.4.1.jar
7fb4d2853000-7fb4d2894000 r--s 006c0000 08:02 16782518                   /usr/local/spark/jars/mesos-1.4.0-shaded-protobuf.jar
7fb4d2894000-7fb4d2895000 r--s 00003000 08:02 16782430                   /usr/local/spark/jars/metrics-json-3.1.5.jar
7fb4d2895000-7fb4d2897000 r--s 00000000 08:02 16782496                   /usr/local/spark/jars/aopalliance-1.0.jar
7fb4d2897000-7fb4d2899000 r--s 00004000 08:02 16782402                   /usr/local/spark/jars/metrics-graphite-3.1.5.jar
7fb4d2899000-7fb4d28a2000 r--s 00046000 08:02 16782585                   /usr/local/spark/jars/jackson-dataformat-yaml-2.6.7.jar
7fb4d28a2000-7fb4d28d1000 r--s 0021a000 08:02 16782453                   /usr/local/spark/jars/spark-network-common_2.11-2.4.7.jar
7fb4d28d1000-7fb4d28d3000 r--s 00010000 08:02 16782424                   /usr/local/spark/jars/jersey-media-jaxb-2.22.2.jar
7fb4d28d3000-7fb4d28da000 r--s 0003f000 08:02 16782538                   /usr/local/spark/jars/commons-codec-1.10.jar
7fb4d28da000-7fb4d28e5000 r--s 000b0000 08:02 16782581                   /usr/local/spark/jars/jtransforms-2.4.0.jar
7fb4d28e5000-7fb4d28f2000 r--s 00077000 08:02 16782560                   /usr/local/spark/jars/spark-kubernetes_2.11-2.4.7.jar
7fb4d28f2000-7fb4d290a000 r--s 00115000 08:02 16782579                   /usr/local/spark/jars/xercesImpl-2.9.1.jar
7fb4d290a000-7fb4d290d000 r--s 00006000 08:02 16782526                   /usr/local/spark/jars/jsr305-1.3.9.jar
7fb4d290d000-7fb4d2921000 r--s 000ec000 08:02 16782494                   /usr/local/spark/jars/parquet-jackson-1.10.1.jar
7fb4d2921000-7fb4d2924000 r--s 0001e000 08:02 16782457                   /usr/local/spark/jars/aircompressor-0.10.jar
7fb4d2924000-7fb4d2925000 r--s 00007000 08:02 16782393                   /usr/local/spark/jars/jackson-module-jaxb-annotations-2.6.7.jar
7fb4d2925000-7fb4d292e000 r--s 0006f000 08:02 16782432                   /usr/local/spark/jars/log4j-1.2.17.jar
7fb4d292e000-7fb4d2a3b000 r--s 00dd7000 08:02 16782421                   /usr/local/spark/jars/scala-compiler-2.11.12.jar
7fb4d2a3b000-7fb4d2a3e000 r--s 00019000 08:02 16782394                   /usr/local/spark/jars/bonecp-0.8.0.RELEASE.jar
7fb4d2a3e000-7fb4d2a3f000 r--s 00003000 08:02 16782534                   /usr/local/spark/jars/generex-1.0.2.jar
7fb4d2a3f000-7fb4d2a41000 r--s 00004000 08:02 16782583                   /usr/local/spark/jars/stax-api-1.0-2.jar
7fb4d2a41000-7fb4d2a43000 r--s 00011000 08:02 16782525                   /usr/local/spark/jars/spark-launcher_2.11-2.4.7.jar
7fb4d2a43000-7fb4d2a52000 r--s 0009f000 08:02 16782484                   /usr/local/spark/jars/guice-3.0.jar
7fb4d2a52000-7fb4d2a54000 r--s 00015000 08:02 16782463                   /usr/local/spark/jars/hadoop-auth-2.7.3.jar
7fb4d2a54000-7fb4d2a58000 r--s 00025000 08:02 16782577                   /usr/local/spark/jars/antlr-runtime-3.4.jar
7fb4d2a58000-7fb4d2a71000 r--s 00150000 08:02 16782564                   /usr/local/spark/jars/htrace-core-3.1.0-incubating.jar
7fb4d2a71000-7fb4d2a73000 r--s 00003000 08:02 16782565                   /usr/local/spark/jars/JavaEWAH-0.3.2.jar
7fb4d2a73000-7fb4d2a77000 r--s 0002a000 08:02 16782540                   /usr/local/spark/jars/avro-mapred-1.8.2-hadoop2.jar
7fb4d2a77000-7fb4d2ac4000 r--s 0041c000 08:02 16782491                   /usr/local/spark/jars/scala-reflect-2.11.12.jar
7fb4d2ac4000-7fb4d2ac9000 r--s 0004e000 08:02 16782451                   /usr/local/spark/jars/datanucleus-api-jdo-3.2.6.jar
7fb4d2ac9000-7fb4d2ace000 r--s 00041000 08:02 16782404                   /usr/local/spark/jars/commons-lang-2.6.jar
7fb4d2ace000-7fb4d2b05000 r--s 00325000 08:02 16782386                   /usr/local/spark/jars/calcite-core-1.2.0-incubating.jar
7fb4d2b05000-7fb4d2b13000 r--s 0009d000 08:02 16782574                   /usr/local/spark/jars/jersey-common-2.22.2.jar
7fb4d2b13000-7fb4d2b20000 r--s 000a0000 08:02 16782436                   /usr/local/spark/jars/spark-graphx_2.11-2.4.7.jar
7fb4d2b20000-7fb4d2b28000 r--s 00059000 08:02 16782433                   /usr/local/spark/jars/javolution-5.5.1.jar
7fb4d2b28000-7fb4d2b2a000 r--s 00005000 08:02 16782479                   /usr/local/spark/jars/stax-api-1.0.1.jar
7fb4d2b2a000-7fb4d2b31000 r--s 00046000 08:02 16782403                   /usr/local/spark/jars/libfb303-0.9.3.jar
7fb4d2b31000-7fb4d2b33000 r--s 00012000 08:02 16782363                   /usr/local/spark/jars/compress-lzf-1.0.3.jar
7fb4d2b33000-7fb4d2b36000 r--s 00028000 08:02 16782464                   /usr/local/spark/jars/stream-2.7.0.jar
7fb4d2b36000-7fb4d2b38000 r--s 0000e000 08:02 16782485                   /usr/local/spark/jars/commons-logging-1.1.3.jar
7fb4d2b38000-7fb4d2b45000 r--s 0009c000 08:02 16782448                   /usr/local/spark/jars/json4s-core_2.11-3.5.3.jar
7fb4d2b45000-7fb4d2b50000 r--s 000c5000 08:02 16782377                   /usr/local/spark/jars/parquet-encoding-1.10.1.jar
7fb4d2b50000-7fb4d2b51000 r--s 00004000 08:02 16782531                   /usr/local/spark/jars/opencsv-2.3.jar
7fb4d2b51000-7fb4d2bfa000 r--s 00a4f000 08:02 16782517                   /usr/local/spark/jars/hive-exec-1.2.1.spark2.jar
7fb4d2bfa000-7fb4d2bff000 r--s 0002a000 08:02 16782426                   /usr/local/spark/jars/gson-2.2.4.jar
7fb4d2bff000-7fb4d2c03000 r--s 00019000 08:02 16782420                   /usr/local/spark/jars/javax.ws.rs-api-2.0.1.jar
7fb4d2c03000-7fb4d2c05000 r--s 0000a000 08:02 16782474                   /usr/local/spark/jars/json4s-jackson_2.11-3.5.3.jar
7fb4d2c05000-7fb4d2c70000 r--s 0093d000 08:02 16782456                   /usr/local/spark/jars/spire_2.11-0.13.0.jar
7fb4d2c70000-7fb4d2c76000 r--s 00043000 08:02 16782390                   /usr/local/spark/jars/commons-configuration-1.6.jar
7fb4d2c76000-7fb4d2c7a000 r--s 0002a000 08:02 16782482                   /usr/local/spark/jars/commons-io-2.4.jar
7fb4d2c7a000-7fb4d2c7b000 r--s 00006000 08:02 16782362                   /usr/local/spark/jars/hadoop-client-2.7.3.jar
7fb4d2c7b000-7fb4d2c82000 r--s 00058000 08:02 16782554                   /usr/local/spark/jars/hadoop-yarn-server-common-2.7.3.jar
7fb4d2c82000-7fb4d2c84000 r--s 00007000 08:02 16782488                   /usr/local/spark/jars/zjsonpatch-0.3.0.jar
7fb4d2c84000-7fb4d2c87000 r--s 00026000 08:02 16782396                   /usr/local/spark/jars/hadoop-yarn-client-2.7.3.jar
7fb4d2c87000-7fb4d2c89000 r--s 00006000 08:02 16782489                   /usr/local/spark/jars/spark-sketch_2.11-2.4.7.jar
7fb4d2c89000-7fb4d2c9f000 r--s 000d3000 08:02 16782557                   /usr/local/spark/jars/jersey-server-2.22.2.jar
7fb4d2c9f000-7fb4d2ca5000 r--s 00062000 08:02 16782576                   /usr/local/spark/jars/okhttp-3.12.0.jar
7fb4d2ca5000-7fb4d2cd4000 r--s 001e4000 08:02 16782443                   /usr/local/spark/jars/spark-streaming_2.11-2.4.7.jar
7fb4d2cd4000-7fb4d2cd5000 r--s 00004000 08:02 16782530                   /usr/local/spark/jars/jackson-jaxrs-1.9.13.jar
7fb4d2cd5000-7fb4d2cd9000 r--s 0001a000 08:02 16782431                   /usr/local/spark/jars/hk2-utils-2.4.0-b34.jar
7fb4d2cd9000-7fb4d2ce0000 r--s 0007d000 08:02 16782477                   /usr/local/spark/jars/jetty-6.1.26.jar
7fb4d2ce0000-7fb4d2ce4000 r--s 00015000 08:02 16782438                   /usr/local/spark/jars/xz-1.5.jar
7fb4d2ce4000-7fb4d2cee000 r--s 0007b000 08:02 16782578                   /usr/local/spark/jars/hadoop-mapreduce-client-app-2.7.3.jar
7fb4d2cee000-7fb4d2cef000 r--s 00002000 08:02 16782382                   /usr/local/spark/jars/flatbuffers-1.2.0-3f79e055.jar
7fb4d2cef000-7fb4d2cf1000 r--s 0001f000 08:02 16782546                   /usr/local/spark/jars/commons-crypto-1.0.0.jar
7fb4d2cf1000-7fb4d2cf6000 r--s 00027000 08:02 16782572                   /usr/local/spark/jars/automaton-1.11-8.jar
7fb4d2cf6000-7fb4d2cfe000 r--s 0007b000 08:02 16782505                   /usr/local/spark/jars/protobuf-java-2.5.0.jar
7fb4d2cfe000-7fb4d2d01000 r--s 00022000 08:02 16782570                   /usr/local/spark/jars/stringtemplate-3.2.1.jar
7fb4d2d01000-7fb4d2d03000 r--s 00012000 08:02 16782566                   /usr/local/spark/jars/api-util-1.0.0-M20.jar
7fb4d2d03000-7fb4d2d1a000 r--s 00183000 08:02 16782512                   /usr/local/spark/jars/hadoop-yarn-common-2.7.3.jar
7fb4d2d1a000-7fb4d2d1c000 r--s 0000b000 08:02 16782481                   /usr/local/spark/jars/spark-unsafe_2.11-2.4.7.jar
7fb4d2d1c000-7fb4d2d3f000 rw-p 00000000 00:00 0 
7fb4d2d3f000-7fb4d2e36000 r--s 00bf5000 08:02 16782509                   /usr/local/spark/jars/spark-core_2.11-2.4.7.jar
7fb4d2e36000-7fb4d2e38000 r--s 00008000 08:02 16782498                   /usr/local/spark/jars/metrics-jvm-3.1.5.jar
7fb4d2e38000-7fb4d2e3b000 r--s 0000f000 08:02 16782455                   /usr/local/spark/jars/commons-compiler-3.0.16.jar
7fb4d2e3b000-7fb4d2e4c000 r--s 00089000 08:02 16782535                   /usr/local/spark/jars/joda-time-2.9.3.jar
7fb4d2e4c000-7fb4d2e59000 r--s 000b1000 08:02 16782487                   /usr/local/spark/jars/hadoop-mapreduce-client-common-2.7.3.jar
7fb4d2e59000-7fb4d2e5b000 r--s 00001000 08:02 16782413                   /usr/local/spark/jars/spark-tags_2.11-2.4.7-tests.jar
7fb4d2e5b000-7fb4d2e61000 r--s 0004c000 08:02 16782466                   /usr/local/spark/jars/antlr4-runtime-4.7.jar
7fb4d2e61000-7fb4d2e65000 r--s 00028000 08:02 16782533                   /usr/local/spark/jars/jetty-util-6.1.26.jar
7fb4d2e65000-7fb4d2e67000 r--s 00020000 08:02 16782399                   /usr/local/spark/jars/hive-beeline-1.2.1.spark2.jar
7fb4d2e67000-7fb4d2e68000 r--s 00003000 08:02 16782506                   /usr/local/spark/jars/jta-1.1.jar
7fb4d2e68000-7fb4d2e6d000 r--s 00041000 08:02 16782428                   /usr/local/spark/jars/parquet-hadoop-1.10.1.jar
7fb4d2e6d000-7fb4d2e6e000 r--s 0000a000 08:02 16782429                   /usr/local/spark/jars/apacheds-i18n-2.0.0-M15.jar
7fb4d2e6e000-7fb4d2e8f000 r--s 00177000 08:02 16782450                   /usr/local/spark/jars/hppc-0.7.2.jar
7fb4d2e8f000-7fb4d2e95000 r--s 00045000 08:02 16782556                   /usr/local/spark/jars/commons-httpclient-3.1.jar
7fb4d2e95000-7fb4d2e98000 r--s 00009000 08:02 16782561                   /usr/local/spark/jars/jackson-annotations-2.6.7.jar
7fb4d2e98000-7fb4d2e9c000 r--s 00029000 08:02 16782367                   /usr/local/spark/jars/hk2-locator-2.4.0-b34.jar
7fb4d2e9c000-7fb4d2e9e000 r--s 00002000 08:02 16782435                   /usr/local/spark/jars/aopalliance-repackaged-2.4.0-b34.jar
7fb4d2e9e000-7fb4d2ebf000 r--s 0019b000 08:02 16782395                   /usr/local/spark/jars/spark-hive-thriftserver_2.11-2.4.7.jar
7fb4d2ebf000-7fb4d2ec7000 r--s 00066000 08:02 16782501                   /usr/local/spark/jars/apache-log4j-extras-1.2.17.jar
7fb4d2ec7000-7fb4d2ec9000 r--s 0000e000 08:02 16782502                   /usr/local/spark/jars/guice-servlet-3.0.jar
7fb4d2ec9000-7fb4d2ed3000 r--s 000a5000 08:02 16782374                   /usr/local/spark/jars/javassist-3.18.1-GA.jar
7fb4d2ed3000-7fb4d2ed5000 r--s 00238000 08:02 16782542                   /usr/local/spark/jars/zstd-jni-1.3.2-2.jar
7fb4d2ed5000-7fb4d2ed7000 r--s 00014000 08:02 16782551                   /usr/local/spark/jars/okio-1.15.0.jar
7fb4d2ed7000-7fb4d2ee7000 r--s 00133000 08:02 16782412                   /usr/local/spark/jars/arrow-vector-0.10.0.jar
7fb4d2ee7000-7fb4d2ef5000 r--s 000a3000 08:02 16782442                   /usr/local/spark/jars/parquet-format-2.4.0.jar
7fb4d2ef5000-7fb4d2ef8000 r--s 00014000 08:02 16782369                   /usr/local/spark/jars/super-csv-2.2.0.jar
7fb4d2ef8000-7fb4d2ef9000 r--s 00000000 08:02 16782483                   /usr/local/spark/jars/javax.inject-1.jar
7fb4d2ef9000-7fb4d2efc000 r--s 0000f000 08:02 16782559                   /usr/local/spark/jars/spark-network-shuffle_2.11-2.4.7.jar
7fb4d2efc000-7fb4d2f00000 r--s 0001e000 08:02 16782529                   /usr/local/spark/jars/spark-repl_2.11-2.4.7.jar
7fb4d2f00000-7fb4d2f16000 r--s 00124000 08:02 16782469                   /usr/local/spark/jars/ivy-2.4.0.jar
7fb4d2f16000-7fb4d2f18000 r--s 0000d000 08:02 16782497                   /usr/local/spark/jars/hadoop-yarn-server-web-proxy-2.7.3.jar
7fb4d2f18000-7fb4d2f1b000 r--s 00014000 08:02 16782391                   /usr/local/spark/jars/json4s-ast_2.11-3.5.3.jar
7fb4d2f1b000-7fb4d2f1c000 r--s 00000000 08:02 16782434                   /usr/local/spark/jars/macro-compat_2.11-1.1.1.jar
7fb4d2f1c000-7fb4d2f20000 r--s 0000c000 08:02 16782368                   /usr/local/spark/jars/validation-api-1.1.0.Final.jar
7fb4d2f20000-7fb4d2f21000 r--s 00008000 08:02 16782397                   /usr/local/spark/jars/machinist_2.11-0.6.1.jar
7fb4d2f21000-7fb4d2f24000 r--s 00025000 08:02 16782503                   /usr/local/spark/jars/commons-dbcp-1.4.jar
7fb4d2f24000-7fb4d2f26000 r--s 00017000 08:02 16782392                   /usr/local/spark/jars/hive-jdbc-1.2.1.spark2.jar
7fb4d2f26000-7fb4d2f2b000 r--s 00027000 08:02 16782409                   /usr/local/spark/jars/hk2-api-2.4.0-b34.jar
7fb4d2f2b000-7fb4d2f2f000 r--s 00035000 08:02 16782495                   /usr/local/spark/jars/jackson-core-asl-1.9.13.jar
7fb4d2f2f000-7fb4d2f33000 r--s 00025000 08:02 16782376                   /usr/local/spark/jars/jersey-client-2.22.2.jar
7fb4d2f33000-7fb4d2f37000 r--s 0001a000 08:02 16782584                   /usr/local/spark/jars/metrics-core-3.1.5.jar
7fb4d2f37000-7fb4d2f3a000 r--s 00015000 08:02 16782516                   /usr/local/spark/jars/javax.servlet-api-3.1.0.jar
7fb4d2f3a000-7fb4d2f3c000 r--s 00003000 08:02 16782440                   /usr/local/spark/jars/jersey-container-servlet-2.22.2.jar
7fb4d2f3c000-7fb4d2f47000 r--s 000bc000 08:02 16782508                   /usr/local/spark/jars/orc-mapreduce-1.5.5-nohive.jar
7fb4d2f47000-7fb4d2f48000 r--s 00000000 08:02 16782536                   /usr/local/spark/jars/shims-0.7.45.jar
7fb4d2f48000-7fb4d2fa1000 r--s 00523000 08:02 16782527                   /usr/local/spark/jars/scala-library-2.11.12.jar
7fb4d2fa1000-7fb4d2fbe000 r--s 001d5000 08:02 16782427                   /usr/local/spark/jars/hadoop-yarn-api-2.7.3.jar
7fb4d2fbe000-7fb4d2fc1000 r--s 0000b000 08:02 16782537                   /usr/local/spark/jars/objenesis-2.5.1.jar
7fb4d2fc1000-7fb4d2fce000 r--s 000af000 08:02 16782549                   /usr/local/spark/jars/httpclient-4.5.6.jar
7fb4d2fce000-7fb4d2fd0000 r--s 00007000 08:02 16782555                   /usr/local/spark/jars/paranamer-2.8.jar
7fb4d2fd0000-7fb4d2fd8000 r--s 0003b000 08:02 16782473                   /usr/local/spark/jars/curator-recipes-2.7.1.jar
7fb4d2fd8000-7fb4d300c000 r--s 00277000 08:02 16782567                   /usr/local/spark/jars/parquet-hadoop-bundle-1.6.0.jar
7fb4d300c000-7fb4d300e000 r--s 00014000 08:02 16782515                   /usr/local/spark/jars/spire-macros_2.11-0.13.0.jar
7fb4d300e000-7fb4d3020000 r--s 00112000 08:02 16782425                   /usr/local/spark/jars/arpack_combined_all-0.1.jar
7fb4d3020000-7fb4d30b3000 r--s 00716000 08:02 16782486                   /usr/local/spark/jars/spark-mllib_2.11-2.4.7.jar
7fb4d30b3000-7fb4d30b4000 r--s 00002000 08:02 16782383                   /usr/local/spark/jars/slf4j-log4j12-1.7.16.jar
7fb4d30b4000-7fb4d30cc000 r--s 001b6000 08:02 16782385                   /usr/local/spark/jars/datanucleus-core-3.2.10.jar
7fb4d30cc000-7fb4d30d4000 r--s 0006e000 08:02 16782532                   /usr/local/spark/jars/commons-lang3-3.5.jar
7fb4d30d4000-7fb4d30e3000 r--s 00096000 08:02 16782417                   /usr/local/spark/jars/spark-yarn_2.11-2.4.7.jar
7fb4d30e3000-7fb4d30f1000 r--s 000b1000 08:02 16782513                   /usr/local/spark/jars/jackson-mapper-asl-1.9.13.jar
7fb4d30f1000-7fb4d3112000 r--s 0015c000 08:02 16782461                   /usr/local/spark/jars/avro-1.8.2.jar
7fb4d3112000-7fb4d3118000 r--s 00028000 08:02 16782418                   /usr/local/spark/jars/curator-framework-2.7.1.jar
7fb4d3118000-7fb4d315f000 r--s 003af000 08:02 16782504                   /usr/local/spark/jars/netty-all-4.1.47.Final.jar
7fb4d315f000-7fb4d3249000 r--s 009a3000 08:02 16782493                   /usr/local/spark/jars/kubernetes-model-4.6.1.jar
7fb4d3249000-7fb4d324b000 r--s 00010000 08:02 16782582                   /usr/local/spark/jars/hadoop-mapreduce-client-shuffle-2.7.3.jar
7fb4d324b000-7fb4d3257000 r--s 000b6000 08:02 16782521                   /usr/local/spark/jars/zookeeper-3.4.6.jar
7fb4d3257000-7fb4d325a000 r--s 001d6000 08:02 16782548                   /usr/local/spark/jars/snappy-java-1.1.7.5.jar
7fb4d325a000-7fb4d325f000 r--s 00035000 08:02 16782462                   /usr/local/spark/jars/chill_2.11-0.9.3.jar
7fb4d325f000-7fb4d3265000 r--s 0002c000 08:02 16782445                   /usr/local/spark/jars/jdo-api-3.0.1.jar
7fb4d3265000-7fb4d3268000 r--s 0001e000 08:02 16782586                   /usr/local/spark/jars/avro-ipc-1.8.2.jar
7fb4d3268000-7fb4d3274000 r--s 00068000 08:02 16782524                   /usr/local/spark/jars/scala-parser-combinators_2.11-1.1.0.jar
7fb4d3274000-7fb4d3276000 r--s 00003000 08:02 16782415                   /usr/local/spark/jars/api-asn1-api-1.0.0-M20.jar
7fb4d3276000-7fb4d3278000 r--s 0000e000 08:02 16782375                   /usr/local/spark/jars/oro-2.0.8.jar
7fb4d3278000-7fb4d327d000 r--s 00038000 08:02 16782437                   /usr/local/spark/jars/commons-beanutils-1.9.4.jar
7fb4d327d000-7fb4d3281000 r--s 00029000 08:02 16782550                   /usr/local/spark/jars/spark-mllib-local_2.11-2.4.7.jar
7fb4d3281000-7fb4d3282000 r--s 00009000 08:02 16782543                   /usr/local/spark/jars/hadoop-annotations-2.7.3.jar
7fb4d3282000-7fb4d32c8000 r--s 00317000 08:02 16782411                   /usr/local/spark/jars/shapeless_2.11-2.3.2.jar
7fb4d32c8000-7fb4d32cc000 r--s 0003e000 08:02 16782558                   /usr/local/spark/jars/jline-2.14.6.jar
7fb4d32cc000-7fb4d32ce000 r--s 00002000 08:02 16782381                   /usr/local/spark/jars/logging-interceptor-3.12.0.jar
7fb4d32ce000-7fb4d32d1000 r--s 00015000 08:02 16782405                   /usr/local/spark/jars/pyrolite-4.13.jar
7fb4d32d1000-7fb4d32d3000 r--s 0000e000 08:02 16782460                   /usr/local/spark/jars/hadoop-mapreduce-client-jobclient-2.7.3.jar
7fb4d32d3000-7fb4d32d5000 r--s 00000000 08:02 16782514                   /usr/local/spark/jars/jul-to-slf4j-1.7.16.jar
7fb4d32d5000-7fb4d32db000 r--s 00034000 08:02 16782400                   /usr/local/spark/jars/libthrift-0.9.3.jar
7fb4d32db000-7fb4d32dd000 r--s 0001c000 08:02 16782539                   /usr/local/spark/jars/py4j-0.10.7.jar
7fb4d32dd000-7fb4d32e0000 r--s 00058000 08:02 16782406                   /usr/local/spark/jars/lz4-java-1.4.0.jar
7fb4d32e0000-7fb4d32e1000 r--s 00001000 08:02 16782416                   /usr/local/spark/jars/minlog-1.3.0.jar
7fb4d32e1000-7fb4d32e5000 r--s 00020000 08:02 16782522                   /usr/local/spark/jars/commons-digester-1.8.jar
7fb4d32e5000-7fb4d32fd000 r--s 000d6000 08:02 16782580                   /usr/local/spark/jars/jersey-guava-2.22.2.jar
7fb4d32fd000-7fb4d3300000 r--s 00016000 08:02 16782492                   /usr/local/spark/jars/jsp-api-2.1.jar
7fb4d3300000-7fb4d3305000 r--s 00068000 08:02 16782387                   /usr/local/spark/jars/antlr-2.7.7.jar
7fb4d3305000-7fb4d3307000 r--s 0000f000 08:02 16782520                   /usr/local/spark/jars/curator-client-2.7.1.jar
7fb4d3307000-7fb4d3308000 r--s 00003000 08:02 16782439                   /usr/local/spark/jars/xmlenc-0.52.jar
7fb4d3308000-7fb4d330a000 r--s 0000d000 08:02 16782366                   /usr/local/spark/jars/chill-java-0.9.3.jar
7fb4d330a000-7fb4d3340000 r--s 0031c000 08:02 16782372                   /usr/local/spark/jars/hadoop-common-2.7.3.jar
7fb4d3340000-7fb4d3344000 r--s 0004c000 08:02 16782541                   /usr/local/spark/jars/RoaringBitmap-0.7.45.jar
7fb4d3344000-7fb4d3356000 r--s 00097000 08:02 16782465                   /usr/local/spark/jars/apacheds-kerberos-codec-2.0.0-M15.jar
7fb4d3356000-7fb4d3359000 r--s 00017000 08:02 16782389                   /usr/local/spark/jars/jaxb-api-2.2.2.jar
7fb4d3359000-7fb4d335b000 r--s 00027000 08:02 16782449                   /usr/local/spark/jars/core-1.1.2.jar
7fb4d335b000-7fb4d3368000 r--s 0009b000 08:02 16782571                   /usr/local/spark/jars/kubernetes-client-4.6.1.jar
7fb4d3368000-7fb4d336f000 r--s 00053000 08:02 16782419                   /usr/local/spark/jars/commons-compress-1.8.1.jar
7fb4d336f000-7fb4d342d000 r--s 00912000 08:02 16782478                   /usr/local/spark/jars/spark-catalyst_2.11-2.4.7.jar
7fb4d342d000-7fb4d3498000 r--s 00784000 08:02 16782552                   /usr/local/spark/jars/hadoop-hdfs-2.7.3.jar
7fb4d3498000-7fb4d3570000 r--s 00d92000 08:02 16782553                   /usr/local/spark/jars/breeze_2.11-0.13.2.jar
7fb4d3570000-7fb4d3571000 ---p 00000000 00:00 0 
7fb4d3571000-7fb4d3671000 rw-p 00000000 00:00 0 

......

7fb4d3977000-7fb4d3a75000 rw-p 00000000 00:00 0 
7fb4d3a75000-7fb4d3a78000 ---p 00000000 00:00 0 
7fb4d3a78000-7fb4d3b76000 rw-p 00000000 00:00 0 
7fb4d3b76000-7fb4d4000000 r--p 00000000 08:02 18744149                   /usr/lib/locale/locale-archive
7fb4d4000000-7fb4d4021000 rw-p 00000000 00:00 0 
7fb4d4021000-7fb4d8000000 ---p 00000000 00:00 0 
7fb4d8000000-7fb4d8001000 r--s 00004000 08:02 16782480                   /usr/local/spark/jars/eigenbase-properties-1.1.5.jar
7fb4d8001000-7fb4d8003000 r--s 00003000 08:02 16782441                   /usr/local/spark/jars/jcl-over-slf4j-1.7.16.jar
7fb4d8003000-7fb4d8014000 r--s 00097000 08:02 16782499                   /usr/local/spark/jars/spark-mesos_2.11-2.4.7.jar
7fb4d8014000-7fb4d8019000 r--s 00041000 08:02 16782523                   /usr/local/spark/jars/xbean-asm6-shaded-4.8.jar
7fb4d8019000-7fb4d8024000 r--s 00062000 08:02 16782408                   /usr/local/spark/jars/calcite-linq4j-1.2.0-incubating.jar
7fb4d8024000-7fb4d802c000 r--s 0005b000 08:02 16782490                   /usr/local/spark/jars/univocity-parsers-2.7.3.jar
7fb4d802c000-7fb4d8030000 r--s 0002a000 08:02 16782568                   /usr/local/spark/jars/breeze-macros_2.11-0.13.2.jar
7fb4d8030000-7fb4d803e000 r--s 000d5000 08:02 16782378                   /usr/local/spark/jars/janino-3.0.16.jar
7fb4d803e000-7fb4d8067000 r--s 001ee000 08:02 16782384                   /usr/local/spark/jars/guava-14.0.1.jar
7fb4d8067000-7fb4d8096000 r--s 002e5000 08:02 16782458                   /usr/local/spark/jars/derby-10.12.1.1.jar
7fb4d8096000-7fb4d80b9000 rw-p 00000000 00:00 0 
7fb4d80b9000-7fb4d80bc000 ---p 00000000 00:00 0 

......

7fb4ec021000-7fb4f0000000 ---p 00000000 00:00 0 
7fb4f0000000-7fb4f0001000 r--s 00006000 08:02 16782422                   /usr/local/spark/jars/jackson-xc-1.9.13.jar
7fb4f0001000-7fb4f0005000 r--s 00036000 08:02 16782563                   /usr/local/spark/jars/ST4-4.0.4.jar
7fb4f0005000-7fb4f0020000 r--s 00131000 08:02 16782373                   /usr/local/spark/jars/spark-hive_2.11-2.4.7.jar
7fb4f0020000-7fb4f0626000 rw-p 00000000 00:00 0 
7fb4f0626000-7fb4f0800000 r--s 03d6c000 08:02 133454                     /home/lsz/jdk1.8.0_191/jre/lib/rt.jar
7fb4f0800000-7fb4f1000000 rw-p 00000000 00:00 0 
7fb4f1000000-7fb4f2360000 rwxp 00000000 00:00 0 
7fb4f2360000-7fb500000000 ---p 00000000 00:00 0 
7fb500000000-7fb503309000 rw-p 00000000 00:00 0 
7fb503309000-7fb504000000 ---p 00000000 00:00 0 
7fb504000000-7fb504001000 r--s 00006000 08:02 16782472                   /usr/local/spark/jars/orc-shims-1.5.5.jar
7fb504001000-7fb504002000 r--s 0000b000 08:02 16782569                   /usr/local/spark/jars/snappy-0.2.jar
7fb504002000-7fb504006000 r--s 0003c000 08:02 16782388                   /usr/local/spark/jars/jackson-core-2.6.7.jar
7fb504006000-7fb50400e000 r--s 0005d000 08:02 16782470                   /usr/local/spark/jars/kryo-shaded-4.0.2.jar
7fb50400e000-7fb5043d4000 rw-p 00000000 00:00 0 
7fb5043d4000-7fb5043d5000 ---p 00000000 00:00 0 

......

7fb505133000-7fb505134000 ---p 00000000 00:00 0 
7fb505134000-7fb505183000 rw-p 00000000 00:00 0 
7fb505183000-7fb5054f5000 ---p 00000000 00:00 0 
7fb5054f5000-7fb50550f000 r-xp 00000000 08:02 133667                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libzip.so
7fb50550f000-7fb50570f000 ---p 0001a000 08:02 133667                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libzip.so
7fb50570f000-7fb505710000 r--p 0001a000 08:02 133667                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libzip.so
7fb505710000-7fb505711000 rw-p 0001b000 08:02 133667                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libzip.so
7fb505711000-7fb50571c000 r-xp 00000000 08:02 16516265                   /lib/x86_64-linux-gnu/libnss_files-2.23.so
7fb50571c000-7fb50591b000 ---p 0000b000 08:02 16516265                   /lib/x86_64-linux-gnu/libnss_files-2.23.so
7fb50591b000-7fb50591c000 r--p 0000a000 08:02 16516265                   /lib/x86_64-linux-gnu/libnss_files-2.23.so
7fb50591c000-7fb50591d000 rw-p 0000b000 08:02 16516265                   /lib/x86_64-linux-gnu/libnss_files-2.23.so
7fb50591d000-7fb505923000 rw-p 00000000 00:00 0 
7fb505923000-7fb50592e000 r-xp 00000000 08:02 16516483                   /lib/x86_64-linux-gnu/libnss_nis-2.23.so
7fb50592e000-7fb505b2d000 ---p 0000b000 08:02 16516483                   /lib/x86_64-linux-gnu/libnss_nis-2.23.so
7fb505b2d000-7fb505b2e000 r--p 0000a000 08:02 16516483                   /lib/x86_64-linux-gnu/libnss_nis-2.23.so
7fb505b2e000-7fb505b2f000 rw-p 0000b000 08:02 16516483                   /lib/x86_64-linux-gnu/libnss_nis-2.23.so
7fb505b2f000-7fb505b45000 r-xp 00000000 08:02 16516254                   /lib/x86_64-linux-gnu/libnsl-2.23.so
7fb505b45000-7fb505d44000 ---p 00016000 08:02 16516254                   /lib/x86_64-linux-gnu/libnsl-2.23.so
7fb505d44000-7fb505d45000 r--p 00015000 08:02 16516254                   /lib/x86_64-linux-gnu/libnsl-2.23.so
7fb505d45000-7fb505d46000 rw-p 00016000 08:02 16516254                   /lib/x86_64-linux-gnu/libnsl-2.23.so
7fb505d46000-7fb505d48000 rw-p 00000000 00:00 0 
7fb505d48000-7fb505d50000 r-xp 00000000 08:02 16516481                   /lib/x86_64-linux-gnu/libnss_compat-2.23.so
7fb505d50000-7fb505f4f000 ---p 00008000 08:02 16516481                   /lib/x86_64-linux-gnu/libnss_compat-2.23.so
7fb505f4f000-7fb505f50000 r--p 00007000 08:02 16516481                   /lib/x86_64-linux-gnu/libnss_compat-2.23.so
7fb505f50000-7fb505f51000 rw-p 00008000 08:02 16516481                   /lib/x86_64-linux-gnu/libnss_compat-2.23.so
7fb505f51000-7fb505f7e000 r-xp 00000000 08:02 133661                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libjava.so
7fb505f7e000-7fb50617d000 ---p 0002d000 08:02 133661                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libjava.so
7fb50617d000-7fb50617e000 r--p 0002c000 08:02 133661                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libjava.so
7fb50617e000-7fb506180000 rw-p 0002d000 08:02 133661                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libjava.so
7fb506180000-7fb50618d000 r-xp 00000000 08:02 133666                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libverify.so
7fb50618d000-7fb50638c000 ---p 0000d000 08:02 133666                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libverify.so
7fb50638c000-7fb50638e000 r--p 0000c000 08:02 133666                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libverify.so
7fb50638e000-7fb50638f000 rw-p 0000e000 08:02 133666                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/libverify.so
7fb50638f000-7fb506396000 r-xp 00000000 08:02 16516486                   /lib/x86_64-linux-gnu/librt-2.23.so
7fb506396000-7fb506595000 ---p 00007000 08:02 16516486                   /lib/x86_64-linux-gnu/librt-2.23.so
7fb506595000-7fb506596000 r--p 00006000 08:02 16516486                   /lib/x86_64-linux-gnu/librt-2.23.so
7fb506596000-7fb506597000 rw-p 00007000 08:02 16516486                   /lib/x86_64-linux-gnu/librt-2.23.so
7fb506597000-7fb50669f000 r-xp 00000000 08:02 16516255                   /lib/x86_64-linux-gnu/libm-2.23.so
7fb50669f000-7fb50689e000 ---p 00108000 08:02 16516255                   /lib/x86_64-linux-gnu/libm-2.23.so
7fb50689e000-7fb50689f000 r--p 00107000 08:02 16516255                   /lib/x86_64-linux-gnu/libm-2.23.so
7fb50689f000-7fb5068a0000 rw-p 00108000 08:02 16516255                   /lib/x86_64-linux-gnu/libm-2.23.so
7fb5068a0000-7fb507582000 r-xp 00000000 08:02 133643                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/server/libjvm.so
7fb507582000-7fb507782000 ---p 00ce2000 08:02 133643                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/server/libjvm.so
7fb507782000-7fb507818000 r--p 00ce2000 08:02 133643                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/server/libjvm.so
7fb507818000-7fb507849000 rw-p 00d78000 08:02 133643                     /home/lsz/jdk1.8.0_191/jre/lib/amd64/server/libjvm.so
7fb507849000-7fb507884000 rw-p 00000000 00:00 0 
7fb507884000-7fb507a44000 r-xp 00000000 08:02 16516251                   /lib/x86_64-linux-gnu/libc-2.23.so
7fb507a44000-7fb507c44000 ---p 001c0000 08:02 16516251                   /lib/x86_64-linux-gnu/libc-2.23.so
7fb507c44000-7fb507c48000 r--p 001c0000 08:02 16516251                   /lib/x86_64-linux-gnu/libc-2.23.so
7fb507c48000-7fb507c4a000 rw-p 001c4000 08:02 16516251                   /lib/x86_64-linux-gnu/libc-2.23.so
7fb507c4a000-7fb507c4e000 rw-p 00000000 00:00 0 
7fb507c4e000-7fb507c51000 r-xp 00000000 08:02 16516249                   /lib/x86_64-linux-gnu/libdl-2.23.so
7fb507c51000-7fb507e50000 ---p 00003000 08:02 16516249                   /lib/x86_64-linux-gnu/libdl-2.23.so
7fb507e50000-7fb507e51000 r--p 00002000 08:02 16516249                   /lib/x86_64-linux-gnu/libdl-2.23.so
7fb507e51000-7fb507e52000 rw-p 00003000 08:02 16516249                   /lib/x86_64-linux-gnu/libdl-2.23.so
7fb507e52000-7fb507e69000 r-xp 00000000 08:02 133321                     /home/lsz/jdk1.8.0_191/lib/amd64/jli/libjli.so
7fb507e69000-7fb508068000 ---p 00017000 08:02 133321                     /home/lsz/jdk1.8.0_191/lib/amd64/jli/libjli.so
7fb508068000-7fb508069000 r--p 00016000 08:02 133321                     /home/lsz/jdk1.8.0_191/lib/amd64/jli/libjli.so
7fb508069000-7fb50806a000 rw-p 00017000 08:02 133321                     /home/lsz/jdk1.8.0_191/lib/amd64/jli/libjli.so
7fb50806a000-7fb508082000 r-xp 00000000 08:02 16516252                   /lib/x86_64-linux-gnu/libpthread-2.23.so
7fb508082000-7fb508281000 ---p 00018000 08:02 16516252                   /lib/x86_64-linux-gnu/libpthread-2.23.so
7fb508281000-7fb508282000 r--p 00017000 08:02 16516252                   /lib/x86_64-linux-gnu/libpthread-2.23.so
7fb508282000-7fb508283000 rw-p 00018000 08:02 16516252                   /lib/x86_64-linux-gnu/libpthread-2.23.so
7fb508283000-7fb508287000 rw-p 00000000 00:00 0 
7fb508287000-7fb5082ad000 r-xp 00000000 08:02 16516262                   /lib/x86_64-linux-gnu/ld-2.23.so
7fb5082ad000-7fb5082af000 r--s 00009000 08:02 16782475                   /usr/local/spark/jars/commons-cli-1.2.jar
7fb5082af000-7fb5082b2000 r--s 000fd000 08:02 16782370                   /usr/local/spark/jars/leveldbjni-all-1.8.jar
7fb5082b2000-7fb5082b5000 r--s 00015000 08:02 16782401                   /usr/local/spark/jars/commons-pool-1.5.4.jar
7fb5082b5000-7fb5082b7000 r--s 00009000 08:02 16782414                   /usr/local/spark/jars/jackson-module-paranamer-2.7.9.jar
7fb5082b7000-7fb508390000 rw-p 00000000 00:00 0 
7fb508390000-7fb508393000 ---p 00000000 00:00 0 
7fb508393000-7fb508496000 rw-p 00000000 00:00 0 
7fb508496000-7fb508497000 r--s 00004000 08:02 16782467                   /usr/local/spark/jars/osgi-resource-locator-1.0.1.jar
7fb508497000-7fb50849d000 r--s 00063000 08:02 16782519                   /usr/local/spark/jars/jodd-core-3.5.2.jar
7fb50849d000-7fb50849e000 r--s 00009000 08:02 16782476                   /usr/local/spark/jars/slf4j-api-1.7.16.jar
7fb50849e000-7fb5084a0000 r--s 0000f000 08:02 16782364                   /usr/local/spark/jars/activation-1.1.1.jar
7fb5084a0000-7fb5084a2000 r--s 00005000 08:02 16782511                   /usr/local/spark/jars/javax.annotation-api-1.2.jar
7fb5084a2000-7fb5084aa000 rw-s 00000000 08:02 15075789                   /tmp/hsperfdata_datax/28323
7fb5084aa000-7fb5084ab000 rw-p 00000000 00:00 0 
7fb5084ab000-7fb5084ac000 r--p 00000000 00:00 0 
7fb5084ac000-7fb5084ad000 r--p 00025000 08:02 16516262                   /lib/x86_64-linux-gnu/ld-2.23.so
7fb5084ad000-7fb5084ae000 rw-p 00026000 08:02 16516262                   /lib/x86_64-linux-gnu/ld-2.23.so
7fb5084ae000-7fb5084af000 rw-p 00000000 00:00 0 
7ffe4e299000-7ffe4e2ba000 rw-p 00000000 00:00 0                          [stack]
7ffe4e386000-7ffe4e389000 r--p 00000000 00:00 0                          [vvar]
7ffe4e389000-7ffe4e38b000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]

VM Arguments:
jvm_args: -Xmx1g 
java_command: org.apache.spark.deploy.SparkSubmit --master local --class com.vesoft.nebula.tools.importer.Exchange /home/lsz/nebula/exchange_1/target/exchange-1.1.0.jar -c /home/lsz/nebula/csv.conf
java_class_path (initial): /usr/local/spark/conf/:/usr/local/spark/jars/javax.annotation-api-1.2.jar:/usr/local/spark/jars/activation-1.1.1.jar:/usr/local/spark/jars/slf4j-api-1.7.16.jar:/usr/local/spark/jars/jodd-core-3.5.2.jar:/usr/local/spark/jars/jackson-module-paranamer-2.7.9.jar:/usr/local/spark/jars/osgi-resource-locator-1.0.1.jar:/usr/local/spark/jars/breeze_2.11-0.13.2.jar:/usr/local/spark/jars/commons-pool-1.5.4.jar:/usr/local/spark/jars/leveldbjni-all-1.8.jar:/usr/local/spark/jars/spark-hive_2.11-2.4.7.jar:/usr/local/spark/jars/derby-10.12.1.1.jar:/usr/local/spark/jars/commons-cli-1.2.jar:/usr/local/spark/jars/hadoop-hdfs-2.7.3.jar:/usr/local/spark/jars/kryo-shaded-4.0.2.jar:/usr/local/spark/jars/guava-14.0.1.jar:/usr/local/spark/jars/jackson-core-2.6.7.jar:/usr/local/spark/jars/ST4-4.0.4.jar:/usr/local/spark/jars/snappy-0.2.jar:/usr/local/spark/jars/janino-3.0.16.jar:/usr/local/spark/jars/breeze-macros_2.11-0.13.2.jar:/usr/local/spark/jars/univocity-parsers-2.7.3.jar:/usr/local/spark/jars/calcite-linq4j-1.2.0-incubating.jar:/usr/local/spark/jars/orc-shims-1.5.5.jar:/usr/local/spark/jars/xbean-asm6-shaded-4.8.jar:/usr/local/spark/jars/spark-mesos_2.11-2.4.7.jar:/usr/local/spark/jars/jcl-over-slf4j-1.7.16.jar:/usr/local/spark/jars/jackson-xc-1.9.13.jar:/usr/local/spark/jars/spark-catalyst_2.11-2.4.7.jar:/usr/local/spark/jars/eigenbase-properties-1.1.5.jar:/usr/local/spark/jars/commons-compress-1.8.1.jar:/usr/local/spark/jars/kubernetes-client-4.6.1.jar:/usr/local/spark/jars/core-1.1.2.jar:/usr/local/spark/jars/jaxb-api-2.2.2.jar:/usr/local/spark/jars/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/local/spark/jars/RoaringBitmap-0.7.45.jar:/usr/local/spark/jars/hadoop-common-2.7.3.jar:/usr/local/spark/jars/chill-java-0.9.3.jar:/usr/local/spark/jars/xmlenc-0.52.jar:/usr/local/spark/jars/curator-client-2.7.1.jar:/usr/local/spark/jars/antlr-2.7.7.jar:/usr/local/spark/jars/jsp-api-2.1.jar:/usr/local/spark/jars/jersey-guava-2.22.2.jar:/usr/local/spark/jars/commons-
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=/home/lsz/jdk1.8.0_191
CLASSPATH=.:/home/lsz/jdk1.8.0_191/lib/dt.jar:/home/lsz/jdk1.8.0_191/lib/tools.jar
PATH=/usr/lib/scala/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/local/spark/bin
SHELL=/bin/bash

Signal Handlers:
SIGSEGV: [libjvm.so+0xaced60], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGBUS: [libjvm.so+0xaced60], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGFPE: [libjvm.so+0x907ca0], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGPIPE: [libjvm.so+0x907ca0], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGXFSZ: [libjvm.so+0x907ca0], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGILL: [libjvm.so+0x907ca0], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGUSR1: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none
SIGUSR2: [libjvm.so+0x907b70], sa_mask[0]=00000000000000000000000000000000, sa_flags=SA_RESTART|SA_SIGINFO
SIGHUP: [libjvm.so+0x908190], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGINT: [libjvm.so+0x908190], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGTERM: [libjvm.so+0x908190], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGQUIT: [libjvm.so+0x908190], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
5

我换个机器成功编译jni

[ 77%] Built target nebula_codec_obj
[100%] Built target nebula_codec
[INFO] Scanning for projects...
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for com.vesoft:nebula-utils:jar:1.0.0-rc4
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-source-plugin is missing. @ line 188, column 21
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-deploy-plugin is missing. @ line 230, column 21
[WARNING] 
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING] 
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING] 
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building nebula-utils 1.0.0-rc4
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ nebula-utils ---
[INFO] Deleting /home/lsz/nebula-master/src/jni/java/target
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.0:compile (default) @ nebula-utils ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to /home/lsz/nebula-master/src/jni/java/target/classes
[WARNING] bootstrap class path not set in conjunction with -source 1.6
[INFO] 
[INFO] --- maven-checkstyle-plugin:3.1.0:check (checkstyle) @ nebula-utils ---
[INFO] 
[INFO] --- native-maven-plugin:1.0-alpha-9:javah (javah) @ nebula-utils ---
[INFO] /bin/sh -c cd '/home/lsz/nebula-master/src/jni/java' && 'javah' '-o' '/home/lsz/nebula-master/src/jni/src/com_vesoft_nebula_NebulaCodec.h' '-classpath' '/home/lsz/nebula-master/src/jni/java/target/classes:/home/lsz/.m2/repository/org/slf4j/slf4j-api/1.7.25/slf4j-api-1.7.25.jar:/home/lsz/.m2/repository/org/slf4j/slf4j-log4j12/1.7.25/slf4j-log4j12-1.7.25.jar:/home/lsz/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar' 'com.vesoft.nebula.NebulaCodec'
[INFO] 
[INFO] --- maven-resources-plugin:3.1.0:resources (default-resources) @ nebula-utils ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent!
[INFO] Copying 1 resource
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.0:compile (default-compile) @ nebula-utils ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to /home/lsz/nebula-master/src/jni/java/target/classes
[WARNING] bootstrap class path not set in conjunction with -source 1.6
[INFO] 
[INFO] --- maven-resources-plugin:3.1.0:testResources (default-testResources) @ nebula-utils ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory /home/lsz/nebula-master/src/jni/java/src/test/resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.0:testCompile (default-testCompile) @ nebula-utils ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/lsz/nebula-master/src/jni/java/target/test-classes
[WARNING] bootstrap class path not set in conjunction with -source 1.6
[INFO] 
[INFO] --- maven-surefire-plugin:2.10:test (default-test) @ nebula-utils ---
[INFO] Surefire report directory: /home/lsz/nebula-master/src/jni/java/target/surefire-reports

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running com.vesoft.nebula.NebulaCodecTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.122 sec

Results :

Tests run: 1, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ nebula-utils ---
[INFO] Building jar: /home/lsz/nebula-master/src/jni/java/target/nebula-utils-1.0.0-rc4.jar
[INFO] 
[INFO] --- maven-resources-plugin:3.1.0:copy-resources (copy-resources) @ nebula-utils ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] 
[INFO] >>> maven-source-plugin:3.2.1:jar (attach-sources) > generate-sources @ nebula-utils >>>
[INFO] 
[INFO] --- maven-compiler-plugin:3.8.0:compile (default) @ nebula-utils ---
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-checkstyle-plugin:3.1.0:check (checkstyle) @ nebula-utils ---
[INFO] 
[INFO] <<< maven-source-plugin:3.2.1:jar (attach-sources) < generate-sources @ nebula-utils <<<
[INFO] 
[INFO] --- maven-source-plugin:3.2.1:jar (attach-sources) @ nebula-utils ---
[INFO] Building jar: /home/lsz/nebula-master/src/jni/java/target/nebula-utils-1.0.0-rc4-sources.jar
[INFO] 
[INFO] --- maven-javadoc-plugin:3.1.1:jar (attach-javadocs) @ nebula-utils ---
[WARNING] Source files encoding has not been set, using platform encoding UTF-8, i.e. build is platform dependent!
[INFO] 
Loading source files for package com.vesoft.nebula...
Constructing Javadoc information...
Standard Doclet version 1.8.0_191
Building tree for all the packages and classes...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/com/vesoft/nebula/NebulaCodec.html...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/com/vesoft/nebula/NebulaCodec.Pair.html...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/com/vesoft/nebula/NebulaCodecResourceLoader.html...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/com/vesoft/nebula/package-frame.html...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/com/vesoft/nebula/package-summary.html...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/com/vesoft/nebula/package-tree.html...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/constant-values.html...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/com/vesoft/nebula/class-use/NebulaCodecResourceLoader.html...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/com/vesoft/nebula/class-use/NebulaCodec.html...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/com/vesoft/nebula/class-use/NebulaCodec.Pair.html...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/com/vesoft/nebula/package-use.html...
Building index for all the packages and classes...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/overview-tree.html...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/index-all.html...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/deprecated-list.html...
Building index for all classes...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/allclasses-frame.html...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/allclasses-noframe.html...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/index.html...
Generating /home/lsz/nebula-master/src/jni/java/target/apidocs/help-doc.html...
[INFO] Building jar: /home/lsz/nebula-master/src/jni/java/target/nebula-utils-1.0.0-rc4-javadoc.jar
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 7.583 s
[INFO] Finished at: 2020-12-17T10:37:39+08:00
[INFO] Final Memory: 31M/181M
[INFO] ------------------------------------------------------------------------
[100%] Built target java_lib

安装

cd target/
mvn install:install-file -Dfile=nebula-utils-1.0.0-rc4.jar -DgroupId=com.vesoft -DartifactId=nebula-utils -Dversion=1.0.0-rc4 -Dpackaging=jar

此时所在目录
pwd:  xxx/nebula-master/src/jni/build/target/
jar tf nebula-utils-1.0.0-rc4.jar 下可查看到 libnebula_codec.so
解压nebula-utils-1.0.0-rc4.jar 使用其下的 libnebula_codec.so
1. 使用libnebula_codec.so运行exchange 导sst功能还是jvm崩溃问题
C  [librocksdbjni8470246881813860888.so+0x4affe3]  rocksdb::SstFileWriter::Finish(rocksdb::ExternalSstFileInfo*)+0x13
 
2. 如未使用libnebula_codec.so 运行exchange 导sst功能
java.lang.UnsatisfiedLinkError: no nebula_codec in java.library.path
6

@critical27 帮忙看下

7

没有java环境

8

环境是指哪里的环境?
DF4BC18B-979B-440e-AB7F-01644CD6DA18

9

echo $JAVA_HOME

10 
lsz@vm-10-188:~$ echo $JAVA_HOME
/opt/jdk1.8.0_191
11

失败的环境？

12

对 /etc/profile中配置生效的

13

执行client方式写入是无问题的, sst下会出问题

可不可以给提供个官方编译的exchange1.1.0工具以及nebula-utils, libnebula_codec.so
nebula安装版本 1.2.0
我换个机器在跑一次

14

你不需要自己编译nebula-utils的，直接编译exchange1.1.0就可， nebula-utils在远程仓库有的。
先把本地maven仓库中的nebula-utils和 client删除，重新package exchange。

15

nebula-utils可否给个链接

16

nebula-utils依赖包在 java-client的包中有的，不需要手动处理utils包的

17

java version “1.8.0_191”
scala 2.10.7
spark 2.4.7
清空maven仓库下nebula相关,安装nebula-utils,打包exchange

git clone -b v1.0 https://github.com/vesoft-inc/nebula-java.git
cd nebula-java/tools/exchange
mvn package -DskipTests

打包期间有两个WARNING

[WARNING] /home/lsz/exchange/nebula-java/tools/exchange/src/main/scala/com/vesoft/nebula/tools/importer/writer/ServerBaseWriter.scala:79: warning: match may not be exhaustive.
[INFO] It would fail on the following input: Some((x: com.vesoft.nebula.tools.importer.KeyPolicy.Value forSome x not in (HASH, UUID)))
[INFO]             val source = edges.sourcePolicy match {
[INFO]                                ^
[WARNING]/home/lsz/exchange/nebula-java/tools/exchange/src/main/scala/com/vesoft/nebula/tools/importer/writer/ServerBaseWriter.scala:88: warning: match may not be exhaustive.
[INFO] It would fail on the following input: Some((x: com.vesoft.nebula.tools.importer.KeyPolicy.Value forSome x not in (HASH, UUID)))
[INFO]             val target = edges.targetPolicy match {
[INFO]                                ^
[WARNING] two warnings found

打包结束后测试,问题与上述一致

安装nebula graph 1.0.1与1.2.0测试结果一样

20/12/18 15:01:35 INFO VerticesProcessor: Loading NebulaCodec successfully.
20/12/18 15:01:35 INFO CodeGenerator: Code generated in 24.532443 ms
20/12/18 15:01:35 INFO CodeGenerator: Code generated in 20.496316 ms
20/12/18 15:01:35 INFO CodeGenerator: Code generated in 8.648632 ms
20/12/18 15:01:36 INFO NebulaSSTWriter: Loading RocksDB successfully
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007fed2ee3f012, pid=7243, tid=0x00007fed347df700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_191-b12) (build 1.8.0_191-b12)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.191-b12 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C  [librocksdbjni6537484319835269195.so+0x4b0012]  rocksdb::SstFileWriter::Finish(rocksdb::ExternalSstFileInfo*)+0x42
#
# Core dump written. Default location: /home/lsz/exchange/nebula-java/tools/exchange/core or core.7243
#
# An error report file with more information is saved as:
# /home/lsz/exchange/nebula-java/tools/exchange/hs_err_pid7243.log
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
18

看起来是没放在 LD PATH

19
  • libnebula_codec.so 放在了/usr/lib下
  • rocksdb也重新安装了下
wget https://github.com/facebook/rocksdb/archive/v6.6.4.zip #6.6.4 (2020-01-31)
unzip v6.6.4.zip 
cd rocksdb-6.6.4/
sudo make static_lib && sudo make install-static
sudo make shared_lib && sudo make install-shared
  • 本地spark, hadoop配置无异常
export JAVA_HOME=/home/xuwenlong/jdk1.8.0_191
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export PATH=$PATH:$JAVA_HOME/bin


export SCALA_HOME=/usr/lib/scala
export PATH=${SCALA_HOME}/bin:$PATH
export PATH=$PATH:/usr/local/spark/bin

export PATH=$PATH:/data6/hadoop
export LD_LIBRARY_PATH=$HADOOP_HOME/lib/native

执行的时候还是上面那个错误

C  [librocksdbjni6537484319835269195.so+0x4b0012]  rocksdb::SstFileWriter::Finish(rocksdb::ExternalSstFileInfo*)+0x42

难道是我编译出了问题, nebula_utils用的是官方提供的, 编译的时候也没报错啊

20

@darionyaphet @critical27 帮忙看下？