带索引插入与不带索引插入的对比

nebula 版本:nebula-graph-2.0.0.el7.x86_64.rpm

  • 部署方式(分布式 / 单机 / Docker / DBaaS):分布式 三节点
  • 是否为线上版本:N
  • 硬件信息
    • 磁盘( 推荐使用 SSD):SSD
    • CPU、内存信息 每天64核,512G(和其他应用公用,可用磁盘空间约1T)
  • 问题的具体描述
  • 相关的 meta / storage / graph info 日志信息

带索引导入

nohup: ignoring input
2021/05/18 10:11:19 --- START OF NEBULA IMPORTER ---
2021/05/18 10:11:19 [INFO] connection_pool.go:74: [nebula-clients] connection pool is initialized successfully
2021/05/18 10:11:19 [INFO] clientmgr.go:28: Create 30 Nebula Graph clients
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/post_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(0): /data/home/nebula/mytest/social_network/dynamic/post_0_0.csv, schema: < :VID(string),Post.imageFile:string,Post.creationDate:string,Post.locationIP:string,Post.browserUsed:string,Post.language:string,Post.content:string,Post.length:int >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/comment_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/forum_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(1): /data/home/nebula/mytest/social_network/dynamic/comment_0_0.csv, schema: < :VID(string),Comment.creationDate:string,Comment.locationIP:string,Comment.browserUsed:string,Comment.content:string,Comment.length:int >
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(2): /data/home/nebula/mytest/social_network/dynamic/forum_0_0.csv, schema: < :VID(string),Forum.title:string,Forum.creationDate:string >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/organisation_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(4): /data/home/nebula/mytest/social_network/static/organisation_0_0.csv, schema: < :VID(string),Organisation.type:string,Organisation.name:string,Organisation.url:string >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/tag_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(6): /data/home/nebula/mytest/social_network/static/tag_0_0.csv, schema: < :VID(string),Tag.name:string,Tag.url:string >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/place_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(3): /data/home/nebula/mytest/social_network/dynamic/person_0_0.csv, schema: < :VID(string),Person.firstName:string,Person.lastName:string,Person.gender:string,Person.birthday:string,Person.creationDate:string,Person.locationIP:string,Person.browserUsed:string >
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(5): /data/home/nebula/mytest/social_network/static/place_0_0.csv, schema: < :VID(string),Place.name:string,Place.url:string,Place.type:string >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/tagclass_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(7): /data/home/nebula/mytest/social_network/static/tagclass_0_0.csv, schema: < :VID(string),Tagclass.name:string,Tagclass.url:string >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_isLocatedIn_place_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(8): /data/home/nebula/mytest/social_network/dynamic/person_isLocatedIn_place_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/post_hasCreator_person_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(9): /data/home/nebula/mytest/social_network/dynamic/post_hasCreator_person_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/post_hasTag_tag_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(10): /data/home/nebula/mytest/social_network/dynamic/post_hasTag_tag_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/tagclass_0_0.csv) is: 71, error lines: 0
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/post_isLocatedIn_place_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(11): /data/home/nebula/mytest/social_network/dynamic/post_isLocatedIn_place_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/comment_hasCreator_person_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(12): /data/home/nebula/mytest/social_network/dynamic/comment_hasCreator_person_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/comment_hasTag_tag_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(13): /data/home/nebula/mytest/social_network/dynamic/comment_hasTag_tag_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/comment_isLocatedIn_place_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(14): /data/home/nebula/mytest/social_network/dynamic/comment_isLocatedIn_place_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/comment_replyOf_comment_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(15): /data/home/nebula/mytest/social_network/dynamic/comment_replyOf_comment_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/comment_replyOf_post_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(16): /data/home/nebula/mytest/social_network/dynamic/comment_replyOf_post_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/forum_hasMember_person_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(18): /data/home/nebula/mytest/social_network/dynamic/forum_hasMember_person_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string),HAS_MEMBER.joinDate:string >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/forum_containerOf_post_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/forum_hasModerator_person_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_knows_person_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(19): /data/home/nebula/mytest/social_network/dynamic/forum_hasModerator_person_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(17): /data/home/nebula/mytest/social_network/dynamic/forum_containerOf_post_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/forum_hasTag_tag_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(20): /data/home/nebula/mytest/social_network/dynamic/forum_hasTag_tag_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_hasInterest_tag_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_likes_comment_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(23): /data/home/nebula/mytest/social_network/dynamic/person_likes_comment_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string),LIKES.creationDate:string >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_likes_post_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(21): /data/home/nebula/mytest/social_network/dynamic/person_hasInterest_tag_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/tag_hasType_tagclass_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(24): /data/home/nebula/mytest/social_network/dynamic/person_likes_post_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string),LIKES.creationDate:string >
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(30): /data/home/nebula/mytest/social_network/static/tag_hasType_tagclass_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_workAt_organisation_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_studyAt_organisation_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(26): /data/home/nebula/mytest/social_network/dynamic/person_workAt_organisation_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string),WORK_AT.workFrom:int >
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(25): /data/home/nebula/mytest/social_network/dynamic/person_studyAt_organisation_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string),STUDY_AT.classYear:int >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/place_isPartOf_place_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(22): /data/home/nebula/mytest/social_network/dynamic/person_knows_person_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string),KNOWS.creationDate:string >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/tagclass_isSubclassOf_tagclass_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(29): /data/home/nebula/mytest/social_network/static/tagclass_isSubclassOf_tagclass_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(28): /data/home/nebula/mytest/social_network/static/place_isPartOf_place_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/organisation_isLocatedIn_place_0_0.csv is U+007C '|'
2021/05/18 10:11:19 [INFO] reader.go:64: Start to read file(27): /data/home/nebula/mytest/social_network/static/organisation_isLocatedIn_place_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/18 10:11:19 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/tagclass_isSubclassOf_tagclass_0_0.csv) is: 70, error lines: 0
2021/05/18 10:11:19 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/place_isPartOf_place_0_0.csv) is: 1454, error lines: 0
2021/05/18 10:11:19 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/place_0_0.csv) is: 1460, error lines: 0
2021/05/18 10:11:19 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/organisation_isLocatedIn_place_0_0.csv) is: 7955, error lines: 0
2021/05/18 10:11:19 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/tag_hasType_tagclass_0_0.csv) is: 16080, error lines: 0
2021/05/18 10:11:29 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/tagclass_0_0.csv): Time(10.12s), Finished(3064), Failed(0), Latency AVG(5295us), Batches Req AVG(557149us), Rows AVG(302.88/s)
2021/05/18 10:11:29 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/place_0_0.csv): Time(10.41s), Finished(69005), Failed(0), Latency AVG(11878us), Batches Req AVG(90806us), Rows AVG(6626.75/s)
2021/05/18 10:11:29 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/tagclass_isSubclassOf_tagclass_0_0.csv): Time(10.49s), Finished(104871), Failed(0), Latency AVG(10163us), Batches Req AVG(64151us), Rows AVG(9994.43/s)
2021/05/18 10:11:30 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/place_isPartOf_place_0_0.csv): Time(10.54s), Finished(118415), Failed(0), Latency AVG(9937us), Batches Req AVG(58258us), Rows AVG(11238.30/s)
2021/05/18 10:11:30 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/organisation_0_0.csv) is: 7955, error lines: 0
2021/05/18 10:11:30 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/organisation_isLocatedIn_place_0_0.csv): Time(10.89s), Finished(253654), Failed(0), Latency AVG(8646us), Batches Req AVG(32145us), Rows AVG(23296.19/s)
2021/05/18 10:11:30 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/tag_0_0.csv) is: 16080, error lines: 0
2021/05/18 10:11:30 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/tag_hasType_tagclass_0_0.csv): Time(11.19s), Finished(386621), Failed(0), Latency AVG(7818us), Batches Req AVG(23519us), Rows AVG(34565.31/s)
2021/05/18 10:11:31 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/organisation_0_0.csv): Time(11.61s), Finished(575221), Failed(0), Latency AVG(7351us), Batches Req AVG(18054us), Rows AVG(49561.38/s)
2021/05/18 10:11:31 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/tag_0_0.csv): Time(11.83s), Finished(675225), Failed(0), Latency AVG(7212us), Batches Req AVG(16386us), Rows AVG(57071.16/s)
2021/05/18 10:11:32 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_studyAt_organisation_0_0.csv) is: 52632, error lines: 0
2021/05/18 10:11:32 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_isLocatedIn_place_0_0.csv) is: 65645, error lines: 0
2021/05/18 10:11:33 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_studyAt_organisation_0_0.csv): Time(13.90s), Finished(1442722), Failed(0), Latency AVG(7465us), Batches Req AVG(11994us), Rows AVG(103814.92/s)
2021/05/18 10:11:33 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_0_0.csv) is: 65645, error lines: 0
2021/05/18 10:11:33 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_isLocatedIn_place_0_0.csv): Time(14.29s), Finished(1598802), Failed(0), Latency AVG(7444us), Batches Req AVG(11559us), Rows AVG(111902.70/s)
2021/05/18 10:11:34 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_0_0.csv): Time(15.37s), Finished(1922647), Failed(0), Latency AVG(7818us), Batches Req AVG(11296us), Rows AVG(125110.32/s)
2021/05/18 10:11:37 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_workAt_organisation_0_0.csv) is: 143553, error lines: 0
2021/05/18 10:11:38 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_workAt_organisation_0_0.csv): Time(19.13s), Finished(3194200), Failed(0), Latency AVG(8133us), Batches Req AVG(10334us), Rows AVG(166982.65/s)

2021/05/18 10:12:29 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/forum_hasModerator_person_0_0.csv) is: 595453, error lines: 0
2021/05/18 10:12:29 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/forum_0_0.csv) is: 595453, error lines: 0
2021/05/18 10:12:30 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/forum_hasModerator_person_0_0.csv): Time(71.35s), Finished(11816962), Failed(0), Latency AVG(15252us), Batches Req AVG(16034us), Rows AVG(165612.41/s)
2021/05/18 10:12:31 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/forum_0_0.csv): Time(71.67s), Finished(11897906), Failed(0), Latency AVG(15226us), Batches Req AVG(16005us), Rows AVG(166012.13/s)
2021/05/18 10:15:07 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_hasInterest_tag_0_0.csv) is: 1535511, error lines: 0
2021/05/18 10:15:09 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_hasInterest_tag_0_0.csv): Time(230.18s), Finished(27825317), Failed(0), Latency AVG(23451us), Batches Req AVG(23923us), Rows AVG(120886.30/s)
2021/05/18 10:16:18 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_knows_person_0_0.csv) is: 1938516, error lines: 0
2021/05/18 10:16:20 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_knows_person_0_0.csv): Time(300.87s), Finished(34425633), Failed(0), Latency AVG(25064us), Batches Req AVG(25493us), Rows AVG(114421.32/s)
2021/05/18 10:16:26 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/forum_hasTag_tag_0_0.csv) is: 2065319, error lines: 0
2021/05/18 10:16:28 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/forum_hasTag_tag_0_0.csv): Time(309.36s), Finished(36192352), Failed(0), Latency AVG(24531us), Batches Req AVG(24951us), Rows AVG(116992.24/s)
2021/05/18 10:33:30 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/post_isLocatedIn_place_0_0.csv) is: 7435696, error lines: 0
2021/05/18 10:33:30 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/post_hasCreator_person_0_0.csv) is: 7435696, error lines: 0
2021/05/18 10:33:31 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/forum_containerOf_post_0_0.csv) is: 7435696, error lines: 0

2021/05/18 10:33:43 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/post_isLocatedIn_place_0_0.csv): Time(1343.55s), Finished(111308398), Failed(0), Latency AVG(35626us), Batches Req AVG(35937us), Rows AVG(82846.28/s)
2021/05/18 10:33:46 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/post_hasCreator_person_0_0.csv): Time(1347.07s), Finished(111342569), Failed(0), Latency AVG(35708us), Batches Req AVG(36019us), Rows AVG(82655.44/s)
2021/05/18 10:33:52 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/forum_containerOf_post_0_0.csv): Time(1353.33s), Finished(111390740), Failed(0), Latency AVG(35860us), Batches Req AVG(36171us), Rows AVG(82308.62/s)
2021/05/18 10:34:18 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/post_0_0.csv) is: 7435696, error lines: 0
2021/05/18 10:34:20 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/post_0_0.csv): Time(1380.54s), Finished(112153336), Failed(0), Latency AVG(36345us), Batches Req AVG(36657us), Rows AVG(81238.63/s)
2021/05/18 10:34:21 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/post_hasTag_tag_0_0.csv) is: 7599701, error lines: 0
2021/05/18 10:34:22 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/post_hasTag_tag_0_0.csv): Time(1383.50s), Finished(113081837), Failed(0), Latency AVG(36122us), Batches Req AVG(36433us), Rows AVG(81735.78/s)
2021/05/18 10:37:25 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_likes_post_0_0.csv) is: 8839875, error lines: 0
2021/05/18 10:37:32 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_likes_post_0_0.csv): Time(1572.75s), Finished(124276012), Failed(0), Latency AVG(37397us), Batches Req AVG(37703us), Rows AVG(79018.31/s)
2021/05/18 10:41:54 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/comment_replyOf_post_0_0.csv) is: 10776102, error lines: 0

2021/05/18 10:42:19 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/comment_replyOf_post_0_0.csv): Time(1859.89s), Finished(139693014), Failed(0), Latency AVG(39385us), Batches Req AVG(39689us), Rows AVG(75108.03/s)

2021/05/18 10:42:27 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/comment_replyOf_comment_0_0.csv) is: 11089373, error lines: 0
2021/05/18 10:43:02 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/comment_replyOf_comment_0_0.csv): Time(1902.97s), Finished(141869187), Failed(0), Latency AVG(39680us), Batches Req AVG(39983us), Rows AVG(74551.27/s)

2021/05/18 10:53:42 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/forum_hasMember_person_0_0.csv) is: 17168614, error lines: 0
2021/05/18 10:53:44 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/forum_hasMember_person_0_0.csv): Time(2544.67s), Finished(178216701), Failed(0), Latency AVG(42267us), Batches Req AVG(42563us), Rows AVG(70035.27/s)

2021/05/18 10:58:29 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_likes_comment_0_0.csv) is: 19949360, error lines: 0
2021/05/18 10:58:31 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_likes_comment_0_0.csv): Time(2831.76s), Finished(192031361), Failed(0), Latency AVG(43662us), Batches Req AVG(43957us), Rows AVG(67813.41/s)

2021/05/18 11:00:49 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/comment_isLocatedIn_place_0_0.csv) is: 21865475, error lines: 0
2021/05/18 11:00:49 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/comment_hasCreator_person_0_0.csv) is: 21865475, error lines: 0
2021/05/18 11:00:52 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/comment_isLocatedIn_place_0_0.csv): Time(2972.61s), Finished(199523762), Failed(0), Latency AVG(44114us), Batches Req AVG(44409us), Rows AVG(67120.66/s)
2021/05/18 11:00:52 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/comment_hasCreator_person_0_0.csv): Time(2972.66s), Finished(199534711), Failed(0), Latency AVG(44112us), Batches Req AVG(44407us), Rows AVG(67123.39/s)

2021/05/18 11:01:13 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/comment_0_0.csv) is: 21865475, error lines: 0

2021/05/18 11:01:39 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/comment_0_0.csv): Time(3020.32s), Finished(200692586), Failed(0), Latency AVG(44562us), Batches Req AVG(44857us), Rows AVG(66447.43/s)
2021/05/18 11:03:25 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/comment_hasTag_tag_0_0.csv) is: 28740194, error lines: 0
2021/05/18 11:03:26 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/comment_hasTag_tag_0_0.csv): Time(3126.70s), Finished(206611280), Failed(0), Latency AVG(44792us), Batches Req AVG(45085us), Rows AVG(66079.67/s)
2021/05/18 11:03:26 Finish import data, consume time: 3127.20s
2021/05/18 11:03:27 --- END OF NEBULA IMPORTER ---

不带索引的日志

2021/05/14 16:04:25 --- START OF NEBULA IMPORTER ---
2021/05/14 16:04:25 [INFO] connection_pool.go:74: [nebula-clients] connection pool is initialized successfully
2021/05/14 16:04:25 [INFO] clientmgr.go:28: Create 30 Nebula Graph clients
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/post_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(0): /data/home/nebula/mytest/social_network/dynamic/post_0_0.csv, schema: < :VID(string),Post.imageFile:string,Post.creationDate:string,Post.locationIP:string,Post.browserUsed:string,Post.language:string,Post.content:string,Post.length:int >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/comment_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/forum_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(1): /data/home/nebula/mytest/social_network/dynamic/comment_0_0.csv, schema: < :VID(string),Comment.creationDate:string,Comment.locationIP:string,Comment.browserUsed:string,Comment.content:string,Comment.length:int >
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(2): /data/home/nebula/mytest/social_network/dynamic/forum_0_0.csv, schema: < :VID(string),Forum.title:string,Forum.creationDate:string >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(3): /data/home/nebula/mytest/social_network/dynamic/person_0_0.csv, schema: < :VID(string),Person.firstName:string,Person.lastName:string,Person.gender:string,Person.birthday:string,Person.creationDate:string,Person.locationIP:string,Person.browserUsed:string >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/organisation_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(4): /data/home/nebula/mytest/social_network/static/organisation_0_0.csv, schema: < :VID(string),Organisation.type:string,Organisation.name:string,Organisation.url:string >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/place_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(5): /data/home/nebula/mytest/social_network/static/place_0_0.csv, schema: < :VID(string),Place.name:string,Place.url:string,Place.type:string >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/tag_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_isLocatedIn_place_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(6): /data/home/nebula/mytest/social_network/static/tag_0_0.csv, schema: < :VID(string),Tag.name:string,Tag.url:string >
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(8): /data/home/nebula/mytest/social_network/dynamic/person_isLocatedIn_place_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/post_hasCreator_person_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/tagclass_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/post_hasTag_tag_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(10): /data/home/nebula/mytest/social_network/dynamic/post_hasTag_tag_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(7): /data/home/nebula/mytest/social_network/static/tagclass_0_0.csv, schema: < :VID(string),Tagclass.name:string,Tagclass.url:string >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/comment_replyOf_comment_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/comment_hasTag_tag_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(13): /data/home/nebula/mytest/social_network/dynamic/comment_hasTag_tag_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(15): /data/home/nebula/mytest/social_network/dynamic/comment_replyOf_comment_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/comment_isLocatedIn_place_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(14): /data/home/nebula/mytest/social_network/dynamic/comment_isLocatedIn_place_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/forum_hasMember_person_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(18): /data/home/nebula/mytest/social_network/dynamic/forum_hasMember_person_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string),HAS_MEMBER.joinDate:string >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/forum_hasModerator_person_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(19): /data/home/nebula/mytest/social_network/dynamic/forum_hasModerator_person_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/tagclass_0_0.csv) is: 71, error lines: 0
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/comment_replyOf_post_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_hasInterest_tag_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(21): /data/home/nebula/mytest/social_network/dynamic/person_hasInterest_tag_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/comment_hasCreator_person_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/forum_hasTag_tag_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(16): /data/home/nebula/mytest/social_network/dynamic/comment_replyOf_post_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(12): /data/home/nebula/mytest/social_network/dynamic/comment_hasCreator_person_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(9): /data/home/nebula/mytest/social_network/dynamic/post_hasCreator_person_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/forum_containerOf_post_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/post_isLocatedIn_place_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(20): /data/home/nebula/mytest/social_network/dynamic/forum_hasTag_tag_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_knows_person_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(22): /data/home/nebula/mytest/social_network/dynamic/person_knows_person_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string),KNOWS.creationDate:string >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_likes_comment_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(23): /data/home/nebula/mytest/social_network/dynamic/person_likes_comment_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string),LIKES.creationDate:string >
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(11): /data/home/nebula/mytest/social_network/dynamic/post_isLocatedIn_place_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(17): /data/home/nebula/mytest/social_network/dynamic/forum_containerOf_post_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_likes_post_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_studyAt_organisation_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(25): /data/home/nebula/mytest/social_network/dynamic/person_studyAt_organisation_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string),STUDY_AT.classYear:int >
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(24): /data/home/nebula/mytest/social_network/dynamic/person_likes_post_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string),LIKES.creationDate:string >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/dynamic/person_workAt_organisation_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(26): /data/home/nebula/mytest/social_network/dynamic/person_workAt_organisation_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string),WORK_AT.workFrom:int >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/organisation_isLocatedIn_place_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(27): /data/home/nebula/mytest/social_network/static/organisation_isLocatedIn_place_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/tagclass_isSubclassOf_tagclass_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/place_isPartOf_place_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:26: The delimiter of /data/home/nebula/mytest/social_network/static/tag_hasType_tagclass_0_0.csv is U+007C '|'
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(30): /data/home/nebula/mytest/social_network/static/tag_hasType_tagclass_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(29): /data/home/nebula/mytest/social_network/static/tagclass_isSubclassOf_tagclass_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:64: Start to read file(28): /data/home/nebula/mytest/social_network/static/place_isPartOf_place_0_0.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/05/14 16:04:25 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/tagclass_isSubclassOf_tagclass_0_0.csv) is: 70, error lines: 0
2021/05/14 16:04:25 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/place_isPartOf_place_0_0.csv) is: 1454, error lines: 0
2021/05/14 16:04:25 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/place_0_0.csv) is: 1460, error lines: 0
2021/05/14 16:04:25 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/organisation_isLocatedIn_place_0_0.csv) is: 7955, error lines: 0
2021/05/14 16:04:25 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/tag_hasType_tagclass_0_0.csv) is: 16080, error lines: 0
2021/05/14 16:04:34 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/tagclass_0_0.csv): Time(9.06s), Finished(24578), Failed(0), Latency AVG(2822us), Batches Req AVG(91543us), Rows AVG(2712.62/s)
2021/05/14 16:04:34 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/place_0_0.csv): Time(9.17s), Finished(58800), Failed(0), Latency AVG(5793us), Batches Req AVG(48996us), Rows AVG(6413.83/s)
2021/05/14 16:04:34 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/tagclass_isSubclassOf_tagclass_0_0.csv): Time(9.25s), Finished(86363), Failed(0), Latency AVG(6395us), Batches Req AVG(36646us), Rows AVG(9339.20/s)
2021/05/14 16:04:34 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/place_isPartOf_place_0_0.csv): Time(9.29s), Finished(104357), Failed(0), Latency AVG(6476us), Batches Req AVG(31922us), Rows AVG(11229.58/s)
2021/05/14 16:04:34 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/organisation_0_0.csv) is: 7955, error lines: 0
2021/05/14 16:04:34 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/organisation_isLocatedIn_place_0_0.csv): Time(9.57s), Finished(225812), Failed(0), Latency AVG(6291us), Batches Req AVG(18727us), Rows AVG(23607.95/s)
2021/05/14 16:04:34 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/static/tag_0_0.csv) is: 16080, error lines: 0
2021/05/14 16:04:34 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/tag_hasType_tagclass_0_0.csv): Time(9.77s), Finished(344257), Failed(0), Latency AVG(5848us), Batches Req AVG(14207us), Rows AVG(35230.56/s)
2021/05/14 16:04:35 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/organisation_0_0.csv): Time(9.96s), Finished(480053), Failed(0), Latency AVG(5271us), Batches Req AVG(11405us), Rows AVG(48195.10/s)
2021/05/14 16:04:35 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/static/tag_0_0.csv): Time(10.19s), Finished(623125), Failed(0), Latency AVG(5089us), Batches Req AVG(9905us), Rows AVG(61144.43/s)
2021/05/14 16:04:35 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_studyAt_organisation_0_0.csv) is: 52632, error lines: 0
2021/05/14 16:04:36 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_isLocatedIn_place_0_0.csv) is: 65645, error lines: 0
2021/05/14 16:04:36 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_studyAt_organisation_0_0.csv): Time(11.40s), Finished(1383721), Failed(0), Latency AVG(4719us), Batches Req AVG(7093us), Rows AVG(121417.46/s)
2021/05/14 16:04:36 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_0_0.csv) is: 65645, error lines: 0
2021/05/14 16:04:36 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_isLocatedIn_place_0_0.csv): Time(11.56s), Finished(1500778), Failed(0), Latency AVG(4643us), Batches Req AVG(6856us), Rows AVG(129866.11/s)
2021/05/14 16:04:37 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_0_0.csv): Time(12.07s), Finished(1855147), Failed(0), Latency AVG(4526us), Batches Req AVG(6378us), Rows AVG(153715.84/s)
2021/05/14 16:04:38 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_workAt_organisation_0_0.csv) is: 143553, error lines: 0
2021/05/14 16:04:39 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_workAt_organisation_0_0.csv): Time(14.35s), Finished(3155200), Failed(0), Latency AVG(4687us), Batches Req AVG(5911us), Rows AVG(219932.31/s)

2021/05/14 16:04:58 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/forum_hasModerator_person_0_0.csv) is: 595453, error lines: 0
2021/05/14 16:04:59 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/forum_0_0.csv) is: 595453, error lines: 0
2021/05/14 16:04:59 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/forum_hasModerator_person_0_0.csv): Time(34.30s), Finished(11647998), Failed(0), Latency AVG(6144us), Batches Req AVG(6732us), Rows AVG(339574.41/s)
2021/05/14 16:04:59 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/forum_0_0.csv): Time(34.56s), Finished(11830806), Failed(0), Latency AVG(6110us), Batches Req AVG(6693us), Rows AVG(342317.45/s)

2021/05/14 16:06:38 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_hasInterest_tag_0_0.csv) is: 1535511, error lines: 0
2021/05/14 16:06:52 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_hasInterest_tag_0_0.csv): Time(147.16s), Finished(27546017), Failed(0), Latency AVG(14609us), Batches Req AVG(15123us), Rows AVG(187180.57/s)

2021/05/14 16:07:22 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_knows_person_0_0.csv) is: 1938516, error lines: 0
2021/05/14 16:07:23 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_knows_person_0_0.csv): Time(178.24s), Finished(34122933), Failed(0), Latency AVG(14447us), Batches Req AVG(14939us), Rows AVG(191448.84/s)

2021/05/14 16:07:44 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/forum_hasTag_tag_0_0.csv) is: 2065319, error lines: 0
2021/05/14 16:07:44 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/forum_hasTag_tag_0_0.csv): Time(199.86s), Finished(35808452), Failed(0), Latency AVG(15550us), Batches Req AVG(16045us), Rows AVG(179170.81/s)

2021/05/14 16:16:32 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/post_isLocatedIn_place_0_0.csv) is: 7435696, error lines: 0
2021/05/14 16:16:32 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/post_hasCreator_person_0_0.csv) is: 7435696, error lines: 0
2021/05/14 16:16:32 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/forum_containerOf_post_0_0.csv) is: 7435696, error lines: 0
2021/05/14 16:16:32 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/post_isLocatedIn_place_0_0.csv): Time(727.74s), Finished(109833358), Failed(0), Latency AVG(19194us), Batches Req AVG(19642us), Rows AVG(150924.33/s)
2021/05/14 16:16:33 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/post_hasCreator_person_0_0.csv): Time(727.91s), Finished(109931240), Failed(0), Latency AVG(19182us), Batches Req AVG(19629us), Rows AVG(151024.09/s)
2021/05/14 16:16:33 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/forum_containerOf_post_0_0.csv): Time(727.92s), Finished(109939840), Failed(0), Latency AVG(19180us), Batches Req AVG(19628us), Rows AVG(151033.63/s)
2021/05/14 16:16:35 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/post_hasTag_tag_0_0.csv) is: 7599701, error lines: 0
2021/05/14 16:16:35 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/post_hasTag_tag_0_0.csv): Time(730.55s), Finished(111577741), Failed(0), Latency AVG(18964us), Batches Req AVG(19410us), Rows AVG(152731.37/s)

2021/05/14 16:17:39 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/post_0_0.csv) is: 7435696, error lines: 0
2021/05/14 16:17:40 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/post_0_0.csv): Time(794.93s), Finished(118461337), Failed(0), Latency AVG(19463us), Batches Req AVG(19912us), Rows AVG(149021.93/s)

2021/05/14 16:18:36 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_likes_post_0_0.csv) is: 8839875, error lines: 0
2021/05/14 16:18:36 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_likes_post_0_0.csv): Time(851.82s), Finished(123746612), Failed(0), Latency AVG(19992us), Batches Req AVG(20440us), Rows AVG(145273.18/s)
2021/05/14 16:21:10 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/comment_replyOf_post_0_0.csv) is: 10776102, error lines: 0
2021/05/14 16:21:37 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/comment_replyOf_post_0_0.csv): Time(1031.98s), Finished(138509214), Failed(0), Latency AVG(21707us), Batches Req AVG(22161us), Rows AVG(134217.27/s)
2021/05/14 16:21:39 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/comment_replyOf_comment_0_0.csv) is: 11089373, error lines: 0
2021/05/14 16:21:40 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/comment_replyOf_comment_0_0.csv): Time(1035.15s), Finished(140637987), Failed(0), Latency AVG(21440us), Batches Req AVG(21893us), Rows AVG(135862.51/s)

2021/05/14 16:28:14 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/forum_hasMember_person_0_0.csv) is: 17168614, error lines: 0
2021/05/14 16:28:15 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/forum_hasMember_person_0_0.csv): Time(1429.98s), Finished(176873401), Failed(0), Latency AVG(23641us), Batches Req AVG(24102us), Rows AVG(123689.22/s)
2021/05/14 16:29:59 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/person_likes_comment_0_0.csv) is: 19949360, error lines: 0
2021/05/14 16:29:59 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/person_likes_comment_0_0.csv): Time(1534.76s), Finished(190372261), Failed(0), Latency AVG(23583us), Batches Req AVG(24042us), Rows AVG(124040.07/s)
2021/05/14 16:31:00 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/comment_isLocatedIn_place_0_0.csv) is: 21865475, error lines: 0
2021/05/14 16:31:00 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/comment_hasCreator_person_0_0.csv) is: 21865475, error lines: 0
2021/05/14 16:31:00 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/comment_isLocatedIn_place_0_0.csv): Time(1595.73s), Finished(196185819), Failed(0), Latency AVG(23802us), Batches Req AVG(24261us), Rows AVG(122944.38/s)
2021/05/14 16:31:01 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/comment_hasCreator_person_0_0.csv): Time(1595.93s), Finished(196314811), Failed(0), Latency AVG(23789us), Batches Req AVG(24248us), Rows AVG(123009.92/s)
2021/05/14 16:32:17 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/comment_hasTag_tag_0_0.csv) is: 28740194, error lines: 0
2021/05/14 16:32:17 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/comment_hasTag_tag_0_0.csv): Time(1672.29s), Finished(205774105), Failed(0), Latency AVG(23781us), Batches Req AVG(24244us), Rows AVG(123049.46/s)
2021/05/14 16:32:21 [INFO] reader.go:180: Total lines of file(/data/home/nebula/mytest/social_network/dynamic/comment_0_0.csv) is: 21865475, error lines: 0
2021/05/14 16:32:21 [INFO] statsmgr.go:61: Done(/data/home/nebula/mytest/social_network/dynamic/comment_0_0.csv): Time(1676.65s), Finished(206611280), Failed(0), Latency AVG(23695us), Batches Req AVG(24157us), Rows AVG(123228.33/s)
2021/05/14 16:32:22 Finish import data, consume time: 1677.16s
2021/05/14 16:32:23 --- END OF NEBULA IMPORTER ---

1.日志经过精简,但是主要的内容都在
2.带上索引查询的导入速率是没有带上索引的的导入速率的一半。
带索引和不带索引导入速率的对比

导入数据量的情况

Space	vertices	29940307
Space	edges	176623382

不带索引的情况导入用时 1677.16s,平均值123162.78条/秒。计算公式:(29940307+176623382)/1677.16s

带上索引的情况导入用时 3127.20s,平均值66053.87条/秒。计算公式:(29940307+176623382)/3127.20s

6 个赞

浙ICP备20010487号