SST导入数据失败

nebula 版本:3.3.0
部署方式:k8s
是否为线上版本:N
硬件信息
磁盘 ssd
CPU、内存信息
问题的具体描述
ingest数据失败Ingest Failed: Corruption: Corrupt or unsupported format_version: 67108877

  • 相关的 meta / storage / graph info 日志信息
I20230211 10:26:28.373488    53 AdminTaskManager.cpp:158] enqueue task(74, 0)
I20230211 10:26:28.373507   167 AdminTaskManager.cpp:239] dequeue task(74, 0)
I20230211 10:26:28.393249   167 AdminTaskManager.cpp:282] run task(74, 0), 1 subtasks in 1 thread
I20230211 10:26:28.393321   167 AdminTaskManager.cpp:227] waiting for incoming task
I20230211 10:26:28.397359   333 IngestTask.cpp:38] Ingest files: 28
I20230211 10:26:32.714205   333 EventListener.h:158] Stall conditions changed column family: default, current condition: Delayed, previous condition: Normal
I20230211 10:26:32.714592    94 EventListener.h:21] Rocksdb start compaction column family: default because of LevelL0FilesNum, status: OK, compacted 28 files into 0, base level is 0, output level is 1
I20230211 10:26:32.714769    94 CompactionFilter.h:82] Do full/manual compaction!
I20230211 10:26:32.739295   333 IngestTask.cpp:38] Ingest files: 28
W20230211 10:26:33.461647   333 RocksEngine.cpp:451] Ingest Failed: Corruption: Corrupt or unsupported format_version: 67108877
I20230211 10:26:33.463433   333 AdminTaskManager.cpp:318] subtask of task(74, 0) finished, unfinished task 0
I20230211 10:26:33.463449   333 AdminTask.h:129] task(74, 0) finished, rc=[E_UNKNOWN]
I20230211 10:26:33.463793   168 AdminTaskManager.cpp:92] reportTaskFinish(), job=74, task=0, rc=E_UNKNOWN
I20230211 10:26:33.467463   168 AdminTaskManager.cpp:134] reportTaskFinish(), job=74, task=0, rc=SUCCEEDED
I20230211 10:33:33.346554    94 EventListener.h:35] Rocksdb compaction completed column family: default because of LevelL0FilesNum, status: OK, compacted 28 files into 115, base level is 0, output level is 1
I20230211 10:33:36.416146    94 EventListener.h:158] Stall conditions changed column family: default, current condition: Normal, previous condition: Delayed

求指导

用的 exchange 导入?版本号多少?

exchange版本是3.3.0

你把配置文件贴一下,看看是不是数据和 schema 对不上。

不是,是一模一样的数据,导了几次,有时候成功有时候失败,不太稳定,就想知道这个报错都有哪些原因?

这是rocksdb的错误。
猜一下,你ingest的sst和我们的rocksdb的版本可能不太match,并且你的sst有很多来源,所以才会出现一会儿成功,一会儿失败。它可能是有的文件成功,有的文件失败。

可以去找一下rocksdb处理这种错误的手段

个人建议的话就是保证rocksdb版本一致。。。

此话题已在最后回复的 30 天后被自动关闭。不再允许新回复。