import 100G csv文件，插入节点时报错invalid space vid len., ErrCode:-1005

[user20]

• nebula 版本：2.6.2
• 部署方式： 分布式
• 安装方式： RPM
• 是否上生产环境：Y
• 硬件信息
  • 磁盘 1.8T ssd
  • CPU Xeon4210 2.2GHz 20c cores
  • 内存 128G
• 问题的具体描述
  导入100Gcsv文件 yaml文件配置如下：
  
  

2023/07/20 13:59:14 [ERROR] handler.go:63: Client 23 fail to execute: INSERT VERTEX `place_0_1`(`ID`,`name`,`url`,`type`) VALUES  "place_12": ("place_12","El_Salvador","http://dbpedia.org/resource/El_Salvador","country"), "place_50": ("place_50","Germany","http://dbpedia.org/resource/Germany","country");, ErrMsg: Storage Error: Invalid space vid len., ErrCode: -1005
2023/07/20 13:59:14 [ERROR] handler.go:63: Client 26 fail to execute: INSERT EDGE `comment_isLocatedIn_place_0_1`() VALUES  "comment_52776558133277"->"place_58":() , "comment_26388279066686"->"place_13":() ;, ErrMsg: Storage Error: Invalid space vid len., ErrCode: -1005
2023/07/20 13:59:14 [ERROR] handler.go:63: Client 2 fail to execute: INSERT VERTEX `forum_0_1`(`name`,`title`,`creationDate`) VALUES  "forum_0": ("forum_0","Wall of Mahinda Perera","2010-02-14T15:32:20.447+0000"), "forum_35184372088876": ("forum_35184372088876","Album 4 of Rahul Reddy","2011-05-11T14:07:03.951+0000");, ErrMsg: Storage Error: Invalid space vid len., ErrCode: -1005
2023/07/20 13:59:14 [ERROR] handler.go:63: Client 5 fail to execute: INSERT EDGE `comment_isLocatedIn_place_0_1`() VALUES  "comment_65970697666567"->"place_88":() , "comment_57174604644391"->"place_13":() ;, ErrMsg: Storage Error: Invalid space vid len., ErrCode: -1005
2023/07/20 13:59:15 [ERROR] handler.go:63: Client 20 fail to execute: INSERT EDGE `comment_isLocatedIn_place_0_1`() VALUES  "comment_65970697666582"->"place_13":() , "comment_39582418599991"->"place_55":() ;, ErrMsg: Storage Error: Invalid space vid len., ErrCode: -1005

[steam]

把报错信息文本复制粘贴过来吧…截图加上反光，看着不是很清楚，读起来有点难。

[dbacyj]

你的vid长度定义是32位，看下是不是有数据超长了

[user20]

已经换成文本了，麻烦再看一下谢谢

[user20]

同样的数据我导入10G大小的就没问题，可以成功

[albert]

Invalid space vid len

fix_string(32) 长度无效，定义为128，64 试试

[user20]

谢谢，之前那个报错解决了，不过又有新的报错
2023/07/25 08:44:37 [ERROR] handler.go:63: Client 7 fail to execute: INSERT EDGE comment_replyOf_comment_0_1() VALUES “comment_57174914866678”->“comment_57174914866677”:() , “comment_57174914866749”->“comment_57174914866747”:() ;, ErrMsg: Storage Error: part: 1, error: E_RPC_FAILURE(-3)., ErrCode: -1005
2023/07/25 08:44:37 [ERROR] handler.go:63: Client 12 fail to execute: INSERT EDGE comment_hasCreator_person_0_1() VALUES “comment_65970786567564”->“person_24189255935113”:() , “comment_61572740056492”->“person_13194139890636”:() ;, ErrMsg: Storage Error: part: 5, error: E_RPC_FAILURE(-3)., ErrCode: -1005

[Reid00]

@user20

E_RPC_FAILURE

E_RPC_FAILURE 导入并发或者batch 太大了吧，可以调小试试

[user20]

调哪个参数呢？

[Reid00]

batch: 128
concurrency: 512
调整这两个试试看

[user20]

好的谢谢

[user20]

batch和concurrency 是import的yaml文件里设置的吗？我目前concurrency：10 batchSize：2

[steam]

对，是在 yaml 文件里设置的。不过你这个设置的数量也太小了。。

[Reid00]

确实，你这个数值不大，你参考这个 Storage Error: The leader has changed. Try again later ，Storage Error: part: 22, error: E_RPC_FAILURE(-3). 查询经常抱着两个错 - #8，来自 rocky
看看 日志和 集群状态是不是正常

[user20]

Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
E0725 16:13:42.627449 376558 MetaClient.cpp:624] Send request to “192.168.109.56”:9559, exceed retry limit
E0725 16:13:42.627795 376517 MetaClient.cpp:94] RPC failure in MetaClient: N6apache6thrift9transport19TTransportExceptionE: AsyncSocketException: connect failed, type = Socket not open, errno = 111 (Connection refused): Connection refused
E0725 16:13:42.627856 376517 StorageServer.cpp:163] waitForMetadReady error!
E0725 16:13:42.627869 376517 StorageDaemon.cpp:161] Storage server start failed

[Reid00]

Storage server start failed storage down了吧

[user20]

看status 没有down