使用工具批量导入数据：
sh spark-submit --class com.vesoft.nebula.tools.generator.v2.SparkClientGenerator --master yarn --executor-memory XXG --num-executors XX --executor-cores X sst.generator-1.0.0-rc4.jar -c nebula_writer.conf -d
映射文件：
{
spark: {
app: {
name: Nebula_graph_importer
}
driver: {
cores: 4
maxResultSize: 1G
}
}
nebula: {
addresses: [ip_list]
user: user
pswd: password
space: relation0
connection {
timeout: 10000
retry: 3
}
execution {
retry: 6
}
}
tags: [
{
name: user
type: parquet
path: "XXXXXXX"
fields: {
user_id: user_id,
......
}
vertex: user_id
batch : 100
}
]
}
insert batch 设置的 100
导入异常日志：ERROR AsyncGraphClientImpl: execute error: Insert vertex not complete, completeness: 94
storage error 日志：E0422 15:47:36.724191 120110 Part.cpp:422] [Port: 44501, Space: 10, Part: 32] Consensus error -5
其他非error日志：
I0422 15:36:05.621559 120102 SlowOpTracker.h:33] [Port: 44501, Space: 10, Part: 3] , total time:191ms, Write WAL, total 5
I0422 15:36:05.867715 120121 SlowOpTracker.h:33] [Port: 44501, Space: 10, Part: 4] , total time:72ms, Write WAL, total 8
I0422 15:36:06.034884 120121 SlowOpTracker.h:33] [Port: 44501, Space: 10, Part: 2] , total time:120ms, Write WAL, total 11
I0422 15:36:06.418220 120123 SlowOpTracker.h:33] [Port: 44501, Space: 10, Part: 62] , total time:69ms, Write WAL, total 15
I0422 15:36:06.554832 120104 SlowOpTracker.h:33] [Port: 44501, Space: 10, Part: 31] , total time:67ms, Write WAL, total 7
I0422 15:36:06.910140 120134 SlowOpTracker.h:33] [Port: 44501, Space: 10, Part: 61] , total time:80ms, Write WAL, total 10
I0422 15:36:06.911126 120134 SlowOpTracker.h:33] [Port: 44501, Space: 10, Part: 60] , total time:70ms, Total send logs: 35
I0422 15:36:07.817355 120133 SlowOpTracker.h:33] [Port: 44501, Space: 10, Part: 119] , total time:77ms, Write WAL, total 2
I0422 15:36:08.194954 120120 SlowOpTracker.h:33] [Port: 44501, Space: 10, Part: 118] , total time:52ms, Write WAL, total 5
I0422 15:36:09.135303 120133 SlowOpTracker.h:33] [Port: 44501, Space: 10, Part: 90] , total time:405ms, Write WAL, total 21
I0422 15:36:09.919193 120115 SlowOpTracker.h:33] [Port: 44501, Space: 10, Part: 120] , total time:72ms, Write WAL, total 3
W0422 15:36:10.012905 120134 RaftPart.cpp:576] [Port: 44501, Space: 10, Part: 33] The appendLog buffer is full. Please slow down the log appending rate.replicatingLogs_ :1