Studio导入数据失败

提问参考模版:

  • nebula 版本:2.0.0
  • Studio 版本:v2.1.9-beta
  • 部署方式(分布式 / 单机 / Docker / DBaaS):docker-compose单机部署
  • 问题的具体描述
    通过Studio导入数据报错
2021/04/06 07:23:46 [INFO] clientmgr.go:28: Create 10 Nebula Graph clients
2021/04/06 07:23:46 [INFO] reader.go:64: Start to read file(0): /home/nebula//case.csv, schema: < :VID(string) >
2021/04/06 07:23:46 [INFO] reader.go:64: Start to read file(1): /home/nebula//product_id.csv, schema: < :VID(string),product.name:string >
2021/04/06 07:23:46 [INFO] reader.go:64: Start to read file(2): /home/nebula//case2product.csv, schema: < :SRC_VID(string),:DST_VID(string) >
2021/04/06 07:23:46 [INFO] reader.go:180: Total lines of file(/home/nebula//product_id.csv) is: 478, error lines: 0
2021/04/06 07:23:46 [INFO] statsmgr.go:61: Done(/home/nebula//product_id.csv): Time(0.17s), Finished(2698), Failed(0), Latency AVG(4393us), Batches Req AVG(5209us), Rows AVG(15967.28/s)
.go:61: Tick: Time(5.00s), Finished(136368), Failed(0), Latency AVG(2952us), Batches Req AVG(3636us), Rows AVG(27272.23/s)
04/06 07:23:56 [INFO] statsmgr.go:61: Tick: Time(10.00s), Finished(273388), Failed(0), Latency AVG(2952us), Batches Req AVG(3637us), Rows AVG(27338.52/s)
04/06 07:23:57 [ERROR] handler.go:63: Client 0 fail to execute: INSERT EDGE `case2product`() VALUES "25899472"->"1243":() , "25852712"->"1100":() , "25879726"->"1030":() , "25902738"->"1242":() , "25756890"->"1201":() , "25909481"->"3218":() , "26047411"->"1241":() , "25982867"->"1241":() , "25801100"->"1096":() , "26010535"->"1220":() ;, ErrMsg: Storage Error: part: 75, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:57 [ERROR] handler.go:63: Client 1 fail to execute: INSERT VERTEX `cases`() VALUES "28080386": (), "28062505": (), "28067245": (), "28135529": (), "28069357": (), "28124951": (), "28136215": (), "28055389": (), "28108742": (), "28132769": ();, ErrMsg: Storage Error: part: 3, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:57 [ERROR] handler.go:63: Client 4 fail to execute: INSERT EDGE `case2product`() VALUES "26156085"->"1216":() , "26390454"->"1252":() , "26116980"->"1243":() , "26363433"->"1075":() , "26094781"->"1202":() , "26193475"->"1071":() , "26169701"->"5008":() , "26104850"->"1242":() , "26156958"->"1058":() , "26156958"->"5054":() ;, ErrMsg: Storage Error: part: 15, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:57 [ERROR] handler.go:63: Client 2 fail to execute: INSERT EDGE `case2product`() VALUES "26311999"->"1241":() , "26098229"->"1241":() , "26418098"->"1216":() , "26262294"->"1148":() , "26193966"->"1242":() , "26164761"->"1243":() , "26266578"->"1243":() , "26289715"->"1201":() , "26392079"->"1225":() , "26156079"->"1201":() ;, ErrMsg: Storage Error: part: 33, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:57 [ERROR] handler.go:63: Client 9 fail to execute: INSERT VERTEX `cases`() VALUES "28125034": (), "28091623": (), "28133363": (), "28098970": (), "28131530": (), "28084127": (), "28083892": (), "28067424": (), "28135286": (), "28105713": ();, ErrMsg: Storage Error: part: 15, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:57 [ERROR] handler.go:63: Client 6 fail to execute: INSERT EDGE `case2product`() VALUES "26346523"->"1224":() , "26236107"->"1242":() , "26262294"->"1247":() , "26125027"->"1241":() , "26173438"->"1201":() , "26253472"->"1201":() , "26265653"->"1221":() , "26408973"->"1243":() , "26392505"->"1241":() , "26180652"->"1243":() ;, ErrMsg: Storage Error: part: 39, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:57 [ERROR] handler.go:63: Client 8 fail to execute: INSERT VERTEX `cases`() VALUES "28044447": (), "28028525": (), "28112618": (), "28027057": (), "28121371": (), "28050071": (), "28114984": (), "28073487": (), "28065017": (), "28049665": ();, ErrMsg: Storage Error: part: 99, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:57 [ERROR] handler.go:63: Client 7 fail to execute: INSERT EDGE `case2product`() VALUES "26126826"->"1243":() , "26423436"->"3601":() , "26089008"->"3444":() , "26402096"->"1153":() , "26307688"->"1243":() , "26285244"->"7":() , "26412449"->"1075":() , "26165282"->"1241":() , "26403523"->"1242":() , "26239826"->"1175":() ;, ErrMsg: Storage Error: part: 27, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:57 [ERROR] handler.go:63: Client 5 fail to execute: INSERT VERTEX `cases`() VALUES "28050607": (), "28091925": (), "28074614": (), "28125123": (), "28120932": (), "28132754": (), "28040935": (), "28060657": (), "28064820": (), "28103856": ();, ErrMsg: Storage Error: part: 87, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:57 [ERROR] handler.go:63: Client 3 fail to execute: INSERT EDGE `case2product`() VALUES "25880022"->"1242":() , "25912510"->"1212":() , "26056499"->"1127":() , "26003543"->"1218":() , "25934787"->"1247":() , "25484371"->"1100":() , "25961724"->"1242":() , "25835759"->"1219":() , "25907293"->"1201":() , "26003584"->"1096":() ;, ErrMsg: Storage Error: part: 75, error: E_RPC_FAILURE(-3)., ErrCode: -8
0 fail to execute: INSERT VERTEX `cases`() VALUES "28029589": (), "28113575": (), "28045704": (), "28130624": (), "28132765": (), "28034620": (), "28072743": (), "28065179": (), "28116325": (), "28074911": ();, ErrMsg: Storage Error: part: 75, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:58 [ERROR] handler.go:63: Client 1 fail to execute: INSERT EDGE `case2product`() VALUES "26001124"->"1198":() , "26004612"->"1201":() , "26011220"->"1244":() , "26004660"->"1241":() , "25903438"->"1095":() , "25774757"->"1220":() , "25884867"->"1075":() , "25884832"->"1220":() , "25852603"->"1217":() , "25954246"->"1148":() ;, ErrMsg: Storage Error: part: 99, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:58 [ERROR] handler.go:63: Client 2 fail to execute: INSERT VERTEX `cases`() VALUES "28117574": (), "28125569": (), "28037111": (), "28096195": (), "28103560": (), "28091920": (), "28126321": (), "28100910": (), "28114574": (), "28124711": ();, ErrMsg: Storage Error: part: 75, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:58 [ERROR] handler.go:63: Client 9 fail to execute: INSERT EDGE `case2product`() VALUES "25919658"->"1243":() , "25919658"->"1241":() , "25897452"->"1242":() , "25931781"->"1242":() , "25912728"->"3132":() , "26007243"->"1199":() , "25971026"->"1198":() , "26050614"->"1201":() , "25906726"->"1108":() , "25970556"->"1242":() ;, ErrMsg: Storage Error: part: 33, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:58 [ERROR] handler.go:63: Client 4 fail to execute: INSERT VERTEX `cases`() VALUES "28131613": (), "28068413": (), "28079637": (), "28092061": (), "28128449": (), "28052704": (), "28124326": (), "28038860": (), "28053641": (), "28078878": ();, ErrMsg: Storage Error: part: 63, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:58 [ERROR] handler.go:63: Client 6 fail to execute: INSERT VERTEX `cases`() VALUES "28029686": (), "28126784": (), "28070869": (), "28078500": (), "28104521": (), "28115118": (), "28067728": (), "28080434": (), "28115542": (), "28060281": ();, ErrMsg: Storage Error: part: 3, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:58 [ERROR] handler.go:63: Client 8 fail to execute: INSERT EDGE `case2product`() VALUES "25899472"->"1241":() , "25852712"->"1187":() , "25879726"->"1040":() , "25964060"->"1243":() , "25979875"->"1188":() , "25907114"->"1201":() , "25937026"->"1245":() , "25937045"->"1201":() , "25895968"->"1176":() , "25991164"->"1247":() ;, ErrMsg: Storage Error: part: 33, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:58 [ERROR] handler.go:63: Client 7 fail to execute: INSERT VERTEX `cases`() VALUES "28116303": (), "28106515": (), "28122302": (), "28127614": (), "28069422": (), "28097073": (), "28062838": (), "28101770": (), "28075721": (), "28081085": ();, ErrMsg: Storage Error: part: 51, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:58 [ERROR] handler.go:63: Client 5 fail to execute: INSERT EDGE `case2product`() VALUES "25767432"->"1197":() , "25852712"->"1217":() , "26066634"->"1241":() , "25964060"->"1224":() , "25757102"->"1153":() , "25990781"->"1241":() , "25936897"->"1075":() , "26051014"->"1241":() , "25895968"->"1175":() , "26065532"->"1242":() ;, ErrMsg: Storage Error: part: 27, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:58 [ERROR] handler.go:63: Client 3 fail to execute: INSERT VERTEX `cases`() VALUES "28133791": (), "28104781": (), "28115420": (), "28091648": (), "28124283": (), "28079800": (), "28131598": (), "28060551": (), "28112964": (), "28102854": ();, ErrMsg: Storage Error: part: 3, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:59 [ERROR] handler.go:63: Client 2 fail to execute: INSERT EDGE `case2product`() VALUES "26310856"->"1243":() , "26180556"->"1201":() , "26116980"->"1241":() , "26363433"->"1244":() , "26247436"->"1220":() , "26390536"->"1242":() , "26169701"->"5044":() , "26191937"->"1242":() , "26156958"->"1073":() , "26156958"->"1133":() ;, ErrMsg: Storage Error: part: 39, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:59 [ERROR] handler.go:63: Client 0 fail to execute: INSERT EDGE `case2product`() VALUES "25913449"->"1224":() , "26066645"->"1242":() , "25979890"->"1225":() , "25778861"->"1131":() , "25364546"->"1176":() , "25893450"->"3218":() , "25928821"->"1242":() , "25980128"->"1081":() , "25980246"->"1175":() , "26065644"->"1241":() ;, ErrMsg: Storage Error: part: 75, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:59 [ERROR] handler.go:63: Client 9 fail to execute: INSERT VERTEX `cases`() VALUES "28050649": (), "28133450": (), "28135444": (), "28133263": (), "28123177": (), "28080590": (), "28111637": (), "28083972": (), "28134403": (), "28097641": ();, ErrMsg: Storage Error: part: 39, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:59 [ERROR] handler.go:63: Client 4 fail to execute: INSERT EDGE `case2product`() VALUES "26387240"->"1245":() , "26122006"->"1201":() , "26088751"->"1243":() , "26382812"->"1241":() , "26158691"->"1243":() , "26277846"->"1201":() , "26391432"->"1201":() , "26244564"->"1243":() , "26339718"->"1242":() , "26121171"->"1242":() ;, ErrMsg: Storage Error: part: 87, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:59 [ERROR] handler.go:63: Client 1 fail to execute: INSERT VERTEX `cases`() VALUES "28079070": (), "28083720": (), "28052614": (), "28069434": (), "28126970": (), "28134821": (), "28107053": (), "28050082": (), "28062680": (), "28052682": ();, ErrMsg: Storage Error: part: 75, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:23:59 [ERROR] handler.go:63: Client 8 fail to execute: INSERT VERTEX `cases`() VALUES "28029579": (), "28112672": (), "28045658": (), "28092987": (), "28132776": (), "28051213": (), "28117220": (), "28114548": (), "28086208": (), "28074298": ();, ErrMsg: Storage Error: part: 75, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:24:00 [ERROR] handler.go:63: Client 7 fail to execute: INSERT EDGE `case2product`() VALUES "26346523"->"1225":() , "26285291"->"1201":() , "26262294"->"1241":() , "26125027"->"1242":() , "26156557"->"1244":() , "26253472"->"1153":() , "26289715"->"1212":() , "26105178"->"1212":() , "26392505"->"1242":() , "26266586"->"1241":() ;, ErrMsg: Storage Error: part: 51, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:24:00 [ERROR] handler.go:63: Client 5 fail to execute: INSERT VERTEX `cases`() VALUES "28073730": (), "28055232": (), "28027082": (), "28117947": (), "28131265": (), "28068814": (), "28081161": (), "28114996": (), "28072828": (), "28058536": ();, ErrMsg: Storage Error: part: 3, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:24:00 [ERROR] handler.go:63: Client 3 fail to execute: INSERT EDGE `case2product`() VALUES "25912650"->"1058":() , "25873469"->"1241":() , "25979607"->"1073":() , "25979607"->"1057":() , "26009118"->"1221":() , "26062633"->"1242":() , "25816125"->"1242":() , "26064602"->"1082":() , "25506097"->"1057":() , "25963992"->"25":() ;, ErrMsg: Storage Error: part: 30, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:24:00 [ERROR] handler.go:63: Client 6 fail to execute: INSERT EDGE `case2product`() VALUES "26156215"->"1243":() , "26390454"->"1243":() , "26370910"->"1223":() , "26302492"->"1242":() , "26094781"->"1204":() , "26193475"->"1061":() , "26169701"->"5045":() , "26156958"->"1071":() , "26156958"->"1108":() , "26387240"->"1113":() ;, ErrMsg: Storage Error: part: 42, error: E_RPC_FAILURE(-3)., ErrCode: -8
"28125550": (), "28041876": (), "28030542": (), "28050389": (), "28101876": (), "28134157": (), "28117681": (), "28126279": (), "28053670": (), "28078391": ();, ErrMsg: Storage Error: part: 63, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:24:01 [ERROR] handler.go:63: Client 0 fail to execute: INSERT VERTEX `cases`() VALUES "28029301": (), "28077397": (), "28121433": (), "28088163": (), "28049643": (), "28032438": (), "28077144": (), "28093432": (), "28058591": (), "28109374": ();, ErrMsg: Storage Error: part: 15, error: E_RPC_FAILURE(-3)., ErrCode: -8
2021/04/06 07:24:01 [ERROR] handler.go:63: Client 5 fail to execute: INSERT EDGE `case2product`() VALUES "25800859"->"1241":() , "25500846"->"1140":() , "25398096"->"1213":() , "25861083"->"1177":() , "25923523"->"1073":() , "25961573"->"1241":() , "25905806"->"1243":() , "25852733"->"1245":() , "25980128"->"1113":() , "26065644"->"1198":() ;, ErrMsg: Storage Error: part: 21, error: E_RPC_FAILURE(-3)., ErrCode: -8
  • 相关的 meta / storage / graph info 日志信息
  • SHOW HOSTS
storaged0	9779	ONLINE	66	anti_fraud:33, liex:33	anti_fraud:33, liex:33
storaged1	9779	ONLINE	68	anti_fraud:34, liex:34	anti_fraud:34, liex:34
storaged2	9779	ONLINE	66	anti_fraud:33, liex:33	anti_fraud:33, liex:33
Total	_EMPTY_	_EMPTY_	200	anti_fraud:100, liex:100	anti_fraud:100, liex:100
  • graphd-stderr.log
E0406 02:49:54.049669    23 StorageClientBase.inl:209] Request to "storaged0":9779 failed: N6apache6thrift9transport19TTransportExceptionE: Channel is !good()
E0406 02:49:54.049705    60 StorageClientBase.inl:209] Request to "storaged0":9779 failed: N6apache6thrift9transport19TTransportExceptionE: Channel is !good()
E0406 02:49:54.049719    24 StorageClientBase.inl:209] Request to "storaged0":9779 failed: N6apache6thrift9transport19TTransportExceptionE: Channel is !good()
E0406 02:49:54.049696    65 StorageClientBase.inl:209] Request to "storaged0":9779 failed: N6apache6thrift9transport19TTransportExceptionE: Channel is !good()
E0406 02:49:54.049741    59 StorageClientBase.inl:209] Request to "storaged0":9779 failed: N6apache6thrift9transport19TTransportExceptionE: Channel is !good()
E0406 02:49:54.049762    19 StorageClientBase.inl:209] Request to "storaged0":9779 failed: N6apache6thrift9transport19TTransportExceptionE: Channel is !good()
E0406 02:49:54.057241    68 StorageClientBase.inl:209] Request to "storaged0":9779 failed: N6apache6thrift9transport19TTransportExceptionE: Channel is !good()
E0406 02:49:54.091358    39 StorageAccessExecutor.h:35] InsertVerticesExecutor failed, error E_RPC_FAILURE, part 99
E0406 02:49:54.091480    39 StorageAccessExecutor.h:35] InsertVerticesExecutor failed, error E_RPC_FAILURE, part 15
E0406 02:49:54.091585    39 StorageAccessExecutor.h:112] Storage Error: part: 99, error: E_RPC_FAILURE(-3).
E0406 02:49:54.091722    47 QueryInstance.cpp:103] Storage Error: part: 99, error: E_RPC_FAILURE(-3).
E0406 02:49:54.091821    39 StorageAccessExecutor.h:35] InsertVerticesExecutor failed, error E_RPC_FAILURE, part 15
E0406 02:49:54.091960    39 StorageAccessExecutor.h:35] InsertVerticesExecutor failed, error E_RPC_FAILURE, part 75
E0406 02:49:54.092042    39 StorageAccessExecutor.h:35] InsertVerticesExecutor failed, error E_RPC_FAILURE, part 63
E0406 02:49:54.092113    39 StorageAccessExecutor.h:35] InsertVerticesExecutor failed, error E_RPC_FAILURE, part 87
E0406 02:49:54.092249    39 StorageAccessExecutor.h:112] Storage Error: part: 15, error: E_RPC_FAILURE(-3).
E0406 02:49:54.092424    44 QueryInstance.cpp:103] Storage Error: part: 15, error: E_RPC_FAILURE(-3).
E0406 02:49:54.092386    39 StorageAccessExecutor.h:35] InsertVerticesExecutor failed, error E_RPC_FAILURE, part 39
E0406 02:49:54.092440    34 StorageAccessExecutor.h:35] InsertVerticesExecutor failed, error E_RPC_FAILURE, part 15
E0406 02:49:54.092523    39 StorageAccessExecutor.h:35] InsertVerticesExecutor failed, error E_RPC_FAILURE, part 99
  • 容器内确定能够telnet到storage容器的9779端口

这是不是和上面的问题是一个问题呀

不是的,timeout的问题已经解决,这是更新到最新版本后遇到的问题

1 个赞

看你导入的速度挺慢的,是不是 docker-compose 里 storage 的数据都在一个盘,然后数据盘不是 ssd 的?

在导入过程中,storage flush 磁盘,建议两个途径试一下。

  1. 关闭自动的 compact,见 nebula-importer/example.yaml at 5004016823ffb402bbae2511a13c38ddb2958fea · vesoft-inc/nebula-importer · GitHub

  2. 进入 importer 容器,按照文档用命令行方式导入,手动调整 buffersize 和 batchsize

3 个赞

请问你解决了吗?我也是集群中有一个节点连接失败导致插入数据部分失败,和你的日志基本一样。