在进行poc,导入大数据量前遇到panic,换成小数量测试,还是同样的报错,请帮忙看下是什么原因。
- nebula 版本:3.8
- 部署方式:单机
- 安装方式:tar.gz
- 是否上生产环境:N
使用impoter 3.1 版本导入csv数据,报错
具体情况如下
edges.csv文件
~from,~to
12,13
13,42
42,56
56,12
vertices.csv
~id
12
13
42
56
数据库创建对象如下
CREATE SPACE twitter(partition_num=100, replica_factor=1, vid_type=FIXED_STRING(32));
USE twitter;
CREATE TAG User();
CREATE EDGE FOLLOWS();
test.yaml 文件
version: v3
description: Twitter dataset import for NebulaGraph 3.8
clientSettings:
retry: 3
concurrency: 50
channelBufferSize: 1024
space: twitter
connection:
user: root
password: nebula
address: 127.0.0.1:9669
postStart:
commands: |
USE twitter;
SHOW TAGS;
SHOW EDGES;
afterPeriod: 30s
logPath: ./import_logs
files:
顶点文件配置
- path: ./vertices.csv
failDataPath: ./vertex_errors.csv
batchSize: 100000
type: csv
csv:
withHeader: true
delimiter: “,”
schema:
type: vertex
vertex:
vid:
index: 0
tags:
- name: User
# 无属性时保持为空数组
props:
边文件配置
- path: ./edges.csv
failDataPath: ./edge_errors.csv
batchSize: 500000
type: csv
csv:
withHeader: true
delimiter: “,”
schema:
type: edge
edge:
name: FOLLOWS
withRanking: false
src:
index: 0
dst:
index: 1
# 无属性时保持为空数组
props:
报错如下
[root@pgnode3 test]# ./impoter --config test.yaml
2025/06/26 21:03:59 — START OF NEBULA IMPORTER —
2025/06/26 21:03:59 [WARN] config.go:169: You have not configured whether to remove generated temporary files, reset to default value. removeTempFiles: false
2025/06/26 21:03:59 [INFO] config.go:411: files[0].csv.withLabel: false
2025/06/26 21:03:59 [WARN] config.go:568: Not set files[0].schema.vertex.vid.Type, reset to default value `string’
2025/06/26 21:03:59 [INFO] config.go:411: files[1].csv.withLabel: false
2025/06/26 21:04:29 [INFO] clientmgr.go:31: Create 50 Nebula Graph clients
2025/06/26 21:04:29 [INFO] reader.go:49: The delimiter of /nebula/test/vertices.csv is U+002C ‘,’
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x532e61]
goroutine 65 [running]:
github.com/vesoft-inc/nebula-importer/pkg/config.(*VID).String(0xc000114080, 0x7d91c8, 0x4, 0xc000024360, 0xc000068c08)
/home/runner/work/nebula-importer/nebula-importer/pkg/config/config.go:513 +0x221
github.com/vesoft-inc/nebula-importer/pkg/config.(*Vertex).String(0xc000114020, 0x6, 0xc000118120)
/home/runner/work/nebula-importer/nebula-importer/pkg/config/config.go:755 +0x44d
github.com/vesoft-inc/nebula-importer/pkg/config.(*Schema).String(0xc000102048, 0x19, 0xc00001ae20)
/home/runner/work/nebula-importer/nebula-importer/pkg/config/config.go:429 +0xa5
github.com/vesoft-inc/nebula-importer/pkg/reader.(*FileReader).startLog(0xc00005e3c0)
/home/runner/work/nebula-importer/nebula-importer/pkg/reader/reader.go:68 +0x85
github.com/vesoft-inc/nebula-importer/pkg/reader.(*FileReader).Read(0xc00005e3c0, 0x0, 0x0, 0x0)
/home/runner/work/nebula-importer/nebula-importer/pkg/reader/reader.go:160 +0x705
github.com/vesoft-inc/nebula-importer/pkg/cmd.(*Runner).Run.func2(0xc0000db0a0, 0xc000076880, 0xc00005e3c0, 0xc00001ae20, 0x19)
/home/runner/work/nebula-importer/nebula-importer/pkg/cmd/runner.go:74 +0x45
created by github.com/vesoft-inc/nebula-importer/pkg/cmd.(*Runner).Run
/home/runner/work/nebula-importer/nebula-importer/pkg/cmd/runner.go:73 +0x766