importer导入过程失败

  • nebula 版本:3.0.2
  • 部署方式:单机
  • 安装方式:源码编译
  • 是否为线上版本:Y
  • 硬件信息
    • 磁盘 SSD
    • CPU、内存信息
      这是运行过程中发生的问题
      ./nebula-importer --config examples/v2/example.yaml
      2022/07/27 16:09:31 — START OF NEBULA IMPORTER —
      2022/07/27 16:09:31 [WARN] config.go:323: You have not configured the failed data output file path in: files[0].failDataPath, reset to default path: /home/zcl/nebula/nebula-importer/examples/v2/err/pokec_new.csv
      2022/07/27 16:09:39 [INFO] clientmgr.go:28: Create 10 Nebula Graph clients
      2022/07/27 16:09:39 [INFO] reader.go:26: The delimiter of /home/zcl/nebula/nebula-importer/examples/v2/pokec_new.csv is U+002C ‘,’
      2022/07/27 16:09:39 [INFO] reader.go:64: Start to read file(1): /home/zcl/nebula/nebula-importer/examples/v2/pokec_new.csv, schema: < :VID(string),ts.na:string >
      2022/07/27 16:09:39 [INFO] reader.go:26: The delimiter of /home/zcl/nebula/nebula-importer/examples/v2/pokec_new.csv is U+002C ‘,’
      2022/07/27 16:09:39 [INFO] reader.go:64: Start to read file(0): /home/zcl/nebula/nebula-importer/examples/v2/pokec_new.csv, schema: < :SRC_VID(string)/eg.name:string,:DST_VID(string),:RANK >
      panic: runtime error: index out of range [2] with length 2

goroutine 30 [running]:
github.com/vesoft-inc/nebula-importer/pkg/config.(*Edge).FormatValues(0xc000420040, 0xc00000f7e0, 0x2, 0x2, 0x20, 0xc0003b6460, 0x0, 0x20)
/home/zcl/nebula/nebula-importer/pkg/config/config.go:589 +0x6b2
github.com/vesoft-inc/nebula-importer/pkg/reader.(*BatchMgr).makeEdgeInsertStmt(0xc00040c050, 0xc000423000, 0x80, 0x80, 0xc0004677e0, 0xc000455516, 0x6, 0x1)
/home/zcl/nebula/nebula-importer/pkg/reader/batchmgr.go:323 +0x138
github.com/vesoft-inc/nebula-importer/pkg/reader.(*BatchMgr).makeEdgeBatchStmt(0xc00040c050, 0xc000423000, 0x80, 0x80, 0x100000000000986, 0x0, 0x4, 0x1)
/home/zcl/nebula/nebula-importer/pkg/reader/batchmgr.go:310 +0x15d
github.com/vesoft-inc/nebula-importer/pkg/reader.makeStmt(0xc000423000, 0x80, 0x80, 0xc00004ecd0, 0x4, 0xc00045551c, 0xc00004ecc0, 0xc00045551c)
/home/zcl/nebula/nebula-importer/pkg/reader/batchmgr.go:246 +0x28d
github.com/vesoft-inc/nebula-importer/pkg/reader.(*BatchMgr).MakeEdgeStmt(0xc00040c050, 0xc000423000, 0x80, 0x80, 0x0, 0x2, 0xc0004677e0, 0x2)
/home/zcl/nebula/nebula-importer/pkg/reader/batchmgr.go:303 +0x6b
github.com/vesoft-inc/nebula-importer/pkg/reader.(*Batch).requestClient(0xc0004200c0)
/home/zcl/nebula/nebula-importer/pkg/reader/batch.go:59 +0x23b
github.com/vesoft-inc/nebula-importer/pkg/reader.(*Batch).Add(0xc0004200c0, 0x1, 0xc0004677e0, 0x2, 0x2)
/home/zcl/nebula/nebula-importer/pkg/reader/batch.go:36 +0xa0
github.com/vesoft-inc/nebula-importer/pkg/reader.(*FileReader).Read(0xc000420000, 0x0, 0x0, 0x0)
/home/zcl/nebula/nebula-importer/pkg/reader/reader.go:162 +0x595
github.com/vesoft-inc/nebula-importer/pkg/cmd.(*Runner).Run.func2(0xc000060a80, 0xc000060a40, 0xc000420000, 0xc00001e380, 0x3a)
/home/zcl/nebula/nebula-importer/pkg/cmd/runner.go:70 +0x40
created by github.com/vesoft-inc/nebula-importer/pkg/cmd.(*Runner).Run
/home/zcl/nebula/nebula-importer/pkg/cmd/runner.go:69 +0x705

这是配置文件
version: v3
description: example
removeTempFiles: false
clientSettings:
retry: 1
concurrency: 10
channelBufferSize: 128
space: my_space_1
connection:
user: root
password: 123456
address: 192.168.116.128:9669
postStart:
commands: |
DROP SPACE IF EXISTS my_space_1;
CREATE SPACE IF NOT EXISTS my_space_1 (vid_type=FIXED_STRING(30));
USE my_space_1;
CREATE TAG ts(na string);
CREATE EDGE eg(name string);
afterPeriod: 8s
preStop:
commands: |
USE my_space_1;
logPath: ./err/test.log
files:

  • path: ./pokec_new.csv
    batchSize: 128
    inOrder: false
    type: csv
    csv:
    withHeader: false
    withLabel: false
    delimiter: “,”
    schema:
    type: edge
    edge:
    name: eg
    withRanking: true
    srcVID:
    type: string
    index: 0
    dstVID:
    type: string
    index: 1
    props:
    - name: name
    type: string
    index: 0

  • path: ./pokec_new.csv
    failDataPath: ./err/course.csv
    batchSize: 2
    inOrder: false
    type: csv
    csv:
    withHeader: false
    withLabel: false
    delimiter: “,”
    schema:
    type: vertex
    vertex:
    vid:
    type: string
    index: 0
    tags:
    - name: ts
    props:
    - name: na
    type: string
    index: 1

数据集是
0,1
0,3
0,2
这种
明明没有超出index的范围为什么还是会报错

withranking true的话,需要给出 rank 对应的 column index,配置没有给出

参考例子

https://github.com/vesoft-inc/nebula-importer/blob/8e376665042e7fffcb8db5017ec1c76f21e69131/examples/v2/example.yaml#L122-L134

1 个赞

此话题已在最后回复的 30 天后被自动关闭。不再允许新回复。