try to import data via nebula-importer in following links
https://github.com/wey-gu/nebula-shareholding-example/blob/main/nebula-importer.yaml
but fail to import data and get hang
nebula@lakehouse-1:~/data$ docker run --rm -ti --network=nebula-docker-compose_nebula-net -v ${HOME}/data/nebula-importer.yaml:/root/nebula-importer.yaml -v ${HOME}/data:/root vesoft/nebula-importer:v2 --config /root/nebula-importer.yaml
2024/11/12 08:54:43 — START OF NEBULA IMPORTER —
2024/11/12 08:54:43 [WARN] config.go:491: Not set files[0].schema.vertex.vid.Type, reset to default value string' 2024/11/12 08:54:43 [WARN] config.go:491: Not set files[1].schema.vertex.vid.Type, reset to default value string’
2024/11/12 08:54:43 [WARN] config.go:491: Not set files[2].schema.edge.srcVID.Type, reset to default value string' 2024/11/12 08:54:43 [WARN] config.go:491: Not set files[2].schema.edge.dstVID.Type, reset to default value string’
2024/11/12 08:54:43 [WARN] config.go:491: Not set files[3].schema.edge.srcVID.Type, reset to default value string' 2024/11/12 08:54:43 [WARN] config.go:491: Not set files[3].schema.edge.dstVID.Type, reset to default value string’
2024/11/12 08:54:43 [WARN] config.go:491: Not set files[4].schema.edge.srcVID.Type, reset to default value string' 2024/11/12 08:54:43 [WARN] config.go:491: Not set files[4].schema.edge.dstVID.Type, reset to default value string’
2024/11/12 08:54:43 [WARN] config.go:491: Not set files[5].schema.edge.srcVID.Type, reset to default value string' 2024/11/12 08:54:43 [WARN] config.go:491: Not set files[5].schema.edge.dstVID.Type, reset to default value string’
2024/11/12 08:54:43 [WARN] config.go:491: Not set files[6].schema.edge.srcVID.Type, reset to default value string' 2024/11/12 08:54:43 [WARN] config.go:491: Not set files[6].schema.edge.dstVID.Type, reset to default value string’
2024/11/12 08:54:43 [INFO] connection_pool.go:74: [nebula-clients] connection pool is initialized successfully
in err/test.log only showed
2024/11/12 08:54:43 [INFO] connection_pool.go:74: [nebula-clients] connection pool is initialized successfully
nebula@lakehouse-1:~/data$ more nebula-importer.yaml
version: v2
description: nebula shareholding relationship data importing
removeTempFiles: false
clientSettings:
retry: 3
concurrency: 2 # number of graph clients
channelBufferSize: 1
space: shareholding
connection:
user: root
password: nebula
address: graphd:9669
postStart:
commands: |
USE shareholding;
afterPeriod: 8s
logPath: ./err/test.log
files:
-
path: ./person.csv
failDataPath: ./err/person.csv
batchSize: 32
inOrder: true
type: csv
csv:
withHeader: false
withLabel: false
schema:
type: vertex
vertex:
vid:
index: 0
tags:
- name: person
props:
- name: name
type: string
index: 1 -
path: ./corp.csv
failDataPath: ./err/corp.csv
batchSize: 32
inOrder: true
type: csv
csv:
withHeader: false
withLabel: false
schema:
type: vertex
vertex:
vid:
index: 0
tags:
- name: corp
props:
- name: name
type: string
index: 1 -
path: ./person_corp_role.csv
failDataPath: ./err/person_corp_role.csv
batchSize: 32
inOrder: false
type: csv
csv:
withHeader: false
withLabel: false
schema:
type: edge
edge:
name: role_as
withRanking: false
srcVID:
index: 0
dstVID:
index: 1
props:
- name: role
type: string
index: 2 -
path: ./corp_rel.csv
failDataPath: ./err/corp_rel.csv
batchSize: 32
inOrder: false
type: csv
csv:
withHeader: false
withLabel: false
schema:
type: edge
edge:
name: is_branch_of
withRanking: false
srcVID:
index: 0
dstVID:
index: 1 -
path: ./corp_share.csv
failDataPath: ./err/corp_share.csv
batchSize: 32
inOrder: false
type: csv
csv:
withHeader: false
withLabel: false
schema:
type: edge
edge:
name: hold_share
withRanking: false
srcVID:
index: 0
dstVID:
index: 1
props:
- name: share
type: float
index: 2 -
path: ./person_corp_share.csv
failDataPath: ./err/person_corp_share.csv
batchSize: 32
inOrder: false
type: csv
csv:
withHeader: false
withLabel: false
schema:
type: edge
edge:
name: hold_share
withRanking: false
srcVID:
index: 0
dstVID:
index: 1
props:
- name: share
type: float
index: 2 -
path: ./person_rel.csv
failDataPath: ./err/person_rel.csv
batchSize: 32
inOrder: false
type: csv
csv:
withHeader: false
withLabel: false
schema:
type: edge
edge:
name: reletive_with
withRanking: false
srcVID:
index: 0
dstVID:
index: 1
props:
- name: degree
type: int
index: 2
Please help.
Best Regards,
Andrew
