insert vertex报错

  • nebula 版本:1.2
  • 部署方式(分布式 / 单机 / Docker / DBaaS):分布式
  • 出问题的 Space 的创建方式:执行 describe space xxx;
  • 问题的具体描述
    vertex tag信息:

相同的插入语句执行报错,多执行了几次就成功了。
报错信息:
[ERROR (-8)]: Insert vertex not complete, completeness: 23

执行了几次之后又不报错了:

插入语句如下:

INSERT VERTEX entity(entity_id) VALUES 0: ("entity_10024684871964"),1: ("entity_10024232584703"),2: ("entity_10024913203477"),3: ("entity_10023989572130"),4: ("entity_10022707920369"),5: ("entity_10024332282287"),6: ("entity_31809379539"),7: ("entity_68346917354"),8: ("entity_10023638972429"),9: ("entity_10023293941142"),10: ("entity_69263402729"),11: ("entity_65637988671"),12: ("entity_10021598827334"),13: ("entity_68409049214"),14: ("entity_10024762456841"),15: ("entity_10024304357856"),16: ("entity_59202905399"),17: ("entity_10021825382241"),18: ("entity_10024954549784"),19: ("entity_10023667437573")

尝试一下这个解决方案?

这个应该是因为你的space是多副本的原因,当你插入的id对应的part leader不是真正的leader的时候,这个时候需要重试。看了下你的space是100个part,你可以手动插入1~100的点,这个时候会有失败,但是graph本地已经能拿到每个part的leader。后续插入之后应该就没问题了。

是用java client导入的,不能每创建一个space都先手动导入一些点啊,没有其他的解决方案吗?这个会失败多少次呢,是不是把重试次数调高点就可以了。

配置了–local_config=true
UPDATE CONFIGS storage:rocksdb_column_family_options = { disable_auto_compactions = true };这样会生效吗?

–local_config=true 的时候通过 update configs 命令的是不会生效的。

假如你的数据不是实时导入的,是一开始做一次批量导入,后续基本都是查询,那在导入过程中关闭 自动compaction是有用的,这样导入性能会好些。但是你是实时插入又查询的,这个开关还是不建议修改。

java client 1.0的是有做重试的,你那边是重试多次还是失败吗?java client失败的时候有日志打印,你看同一条query失败了多少次。

这个参数的主要作用是什么?

控制要不要自动做compaction的开关。

如果是开启的有什么作用?就是做compaction是什么意思,开启的话内部会做那些操作呢,大概的原理是什么?

你可以去了解下rocksdb的compaction功能

修改了配置文件,重启了storaged,现在每次都失败了:

修改的etc/nebula-storaged.conf这个文件:
–rocksdb_column_family_options={“disable_auto_compactions”:“true”}

你 show hosts截图下

可以也贴下你请求的graphd的日志吗?

E0112 16:25:30.634703 139806 ExecutionPlan.cpp:80] Execute failed: Insert vertex not complete, completeness: 46
E0112 16:25:31.869385 139811 StorageClient.inl:123] Request to [10.196.97.34:44500] failed: N6apache6thrift9transport19TTransportExceptionE: Channel got EOF. Check for server hitting connection limit, server connection idle timeout, and server crashes.
E0112 16:25:31.869714 139811 StorageClient.inl:123] Request to [10.196.97.37:44500] failed: N6apache6thrift9transport19TTransportExceptionE: Channel got EOF. Check for server hitting connection limit, server connection idle timeout, and server crashes.
E0112 16:25:31.869755 139811 StorageClient.inl:123] Request to [10.196.97.139:44500] failed: N6apache6thrift9transport19TTransportExceptionE: Channel got EOF. Check for server hitting connection limit, server connection idle timeout, and server crashes.
E0112 16:25:31.871140 139802 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 16
E0112 16:25:31.871196 139802 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 15
E0112 16:25:31.871223 139802 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 17
E0112 16:25:31.871248 139802 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 3
E0112 16:25:31.871273 139802 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 4
E0112 16:25:31.871305 139802 ExecutionPlan.cpp:80] Execute failed: Insert vertex not complete, completeness: 30
E0112 16:25:32.722247 139812 StorageClient.inl:123] Request to [10.196.98.103:44500] failed: N6apache6thrift9transport19TTransportExceptionE: Channel got EOF. Check for server hitting connection limit, server connection idle timeout, and server crashes.
E0112 16:25:32.722342 139812 StorageClient.inl:123] Request to [10.196.97.34:44500] failed: N6apache6thrift9transport19TTransportExceptionE: Channel got EOF. Check for server hitting connection limit, server connection idle timeout, and server crashes.
E0112 16:25:32.722378 139812 StorageClient.inl:123] Request to [10.196.96.74:44500] failed: N6apache6thrift9transport19TTransportExceptionE: Channel got EOF. Check for server hitting connection limit, server connection idle timeout, and server crashes.
E0112 16:25:32.722419 139812 StorageClient.inl:123] Request to [10.196.97.3:44500] failed: N6apache6thrift9transport19TTransportExceptionE: Channel got EOF. Check for server hitting connection limit, server connection idle timeout, and server crashes.
E0112 16:25:32.722460 139812 StorageClient.inl:123] Request to [10.196.97.39:44500] failed: N6apache6thrift9transport19TTransportExceptionE: Channel got EOF. Check for server hitting connection limit, server connection idle timeout, and server crashes.
E0112 16:25:32.722491 139812 StorageClient.inl:123] Request to [10.196.98.169:44500] failed: N6apache6thrift9transport19TTransportExceptionE: Channel got EOF. Check for server hitting connection limit, server connection idle timeout, and server crashes.
E0112 16:25:32.722589 139812 StorageClient.inl:123] Request to [10.196.97.12:44500] failed: N6apache6thrift9transport19TTransportExceptionE: Channel got EOF. Check for server hitting connection limit, server connection idle timeout, and server crashes.
E0112 16:25:32.722659 139812 StorageClient.inl:123] Request to [10.196.97.107:44500] failed: N6apache6thrift9transport19TTransportExceptionE: Channel got EOF. Check for server hitting connection limit, server connection idle timeout, and server crashes.
E0112 16:25:32.723963 139806 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 13
E0112 16:25:32.724017 139806 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 14
E0112 16:25:32.724043 139806 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 20
E0112 16:25:32.724067 139806 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 9
E0112 16:25:32.724092 139806 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 7
E0112 16:25:32.724115 139806 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 18
E0112 16:25:32.724139 139806 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 11
E0112 16:25:32.724164 139806 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 3
E0112 16:25:32.724197 139806 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 19
E0112 16:25:32.724252 139806 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 6
E0112 16:25:32.724303 139806 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 17
E0112 16:25:32.724336 139806 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 5
E0112 16:25:32.724361 139806 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 1
E0112 16:25:32.724390 139806 ExecutionPlan.cpp:80] Execute failed: Insert vertex not complete, completeness: 28
E0112 16:25:33.413872 139813 StorageClient.inl:123] Request to [10.196.97.37:44500] failed: N6apache6thrift9transport19TTransportExceptionE: Channel got EOF. Check for server hitting connection limit, server connection idle timeout, and server crashes.
E0112 16:25:33.415661 139802 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 5
E0112 16:25:33.415724 139802 ExecutionPlan.cpp:80] Execute failed: Insert vertex not complete, completeness: 46
E0112 16:25:34.185508 139814 StorageClient.inl:123] Request to [10.196.97.40:44500] failed: N6apache6thrift9transport19TTransportExceptionE: Channel got EOF. Check for server hitting connection limit, server connection idle timeout, and server crashes.
E0112 16:25:34.187635 139806 InsertVertexExecutor.cpp:249] Insert vertices failed, error -3, part 5
E0112 16:25:34.187692 139806 ExecutionPlan.cpp:80] Execute failed: Insert vertex not complete, completeness: 92

一部分日志

graphd的日志是哪个?怎么命名的?

贴下 10.196.97.34 storage的日志