全文索引重建失败问题

  • nebula 版本:2.6.1

  • 部署方式:分布式

  • 安装方式: Docker

  • 是否为线上版本:N

  • 硬件信息

    • SSD
    • 12核48G
  • 全文索引删除后重建,rebuild之后一直running

  • listener日志

E0506 07:51:09.070618    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 11] The given log id 0 is out of the range, the wal firstLogId is 882875
E0506 07:51:09.175349    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 5] The given log id 0 is out of the range, the wal firstLogId is 882681
E0506 07:51:09.307879    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 2] The given log id 0 is out of the range, the wal firstLogId is 882892
E0506 07:51:09.388284    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 14] The given log id 0 is out of the range, the wal firstLogId is 882653
E0506 07:51:09.763123    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 8] The given log id 0 is out of the range, the wal firstLogId is 883593
E0506 07:51:10.071902    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 11] The given log id 0 is out of the range, the wal firstLogId is 882875
E0506 07:51:10.175460    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 5] The given log id 0 is out of the range, the wal firstLogId is 882681
E0506 07:51:10.309094    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 2] The given log id 0 is out of the range, the wal firstLogId is 882892
E0506 07:51:10.388767    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 14] The given log id 0 is out of the range, the wal firstLogId is 882653
E0506 07:51:10.763572    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 8] The given log id 0 is out of the range, the wal firstLogId is 883593
E0506 07:51:11.073329    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 11] The given log id 0 is out of the range, the wal firstLogId is 882875
E0506 07:51:11.175993    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 5] The given log id 0 is out of the range, the wal firstLogId is 882681
E0506 07:51:11.309558    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 2] The given log id 0 is out of the range, the wal firstLogId is 882892
E0506 07:51:11.390130    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 14] The given log id 0 is out of the range, the wal firstLogId is 882653
E0506 07:51:11.763904    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 8] The given log id 0 is out of the range, the wal firstLogId is 883593
E0506 07:51:12.073623    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 11] The given log id 0 is out of the range, the wal firstLogId is 882875
E0506 07:51:12.177021    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 5] The given log id 0 is out of the range, the wal firstLogId is 882681
E0506 07:51:12.309476    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 2] The given log id 0 is out of the range, the wal firstLogId is 882892
E0506 07:51:12.391057    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 14] The given log id 0 is out of the range, the wal firstLogId is 882653
E0506 07:51:12.764941    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 8] The given log id 0 is out of the range, the wal firstLogId is 883593
E0506 07:51:13.074029    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 11] The given log id 0 is out of the range, the wal firstLogId is 882875
E0506 07:51:13.177480    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 5] The given log id 0 is out of the range, the wal firstLogId is 882681
E0506 07:51:26.373857    49 ESListener.cpp:240] A fatal error . Full-text engine is not working.
E0506 07:51:26.373905    49 Listener.cpp:252] [Port: 9790, Space: 1, Part: 8] Failed to apply data while committing snapshot.
E0506 07:51:26.374127    49 RaftPart.cpp:1734] [Port: 9790, Space: 1, Part: 8] Bad snapshot, total rows received 0, total rows sended 2492, total size received 0, total size sended 524307
E0506 07:51:30.292593    48 ESListener.cpp:240] A fatal error . Full-text engine is not working.
E0506 07:51:30.292892    48 Listener.cpp:252] [Port: 9790, Space: 1, Part: 11] Failed to apply data while committing snapshot.
E0506 07:51:30.293092    48 RaftPart.cpp:1734] [Port: 9790, Space: 1, Part: 11] Bad snapshot, total rows received 0, total rows sended 2487, total size received 0, total size sended 524428
E0506 07:51:35.721556    44 FileBasedWal.cpp:451] [Port: 9790, Space: 1, Part: 8] There is a gap in the log id. The last log id is 1074926, and the id being appended is 1074926
E0506 07:51:35.721630    44 FileBasedWal.cpp:527] [Port: 9790, Space: 1, Part: 8] Failed to append log for logId 1074926
E0506 07:51:36.293336    44 FileBasedWal.cpp:451] [Port: 9790, Space: 1, Part: 11] There is a gap in the log id. The last log id is 1074208, and the id being appended is 1074208
E0506 07:51:36.293449    44 FileBasedWal.cpp:527] [Port: 9790, Space: 1, Part: 11] Failed to append log for logId 1074208
E0506 07:51:39.166590    49 ESListener.cpp:240] A fatal error . Full-text engine is not working.
E0506 07:51:39.166723    49 Listener.cpp:252] [Port: 9790, Space: 1, Part: 2] Failed to apply data while committing snapshot.
E0506 07:51:39.167699    49 RaftPart.cpp:1734] [Port: 9790, Space: 1, Part: 2] Bad snapshot, total rows received 7482, total rows sended 10021, total size received 1573141, total size sended 2097515
E0506 07:51:39.168103    44 FileBasedWal.cpp:451] [Port: 9790, Space: 1, Part: 2] There is a gap in the log id. The last log id is 1074253, and the id being appended is 1074253
E0506 07:51:39.168131    44 FileBasedWal.cpp:527] [Port: 9790, Space: 1, Part: 2] Failed to append log for logId 1074253
E0506 07:51:45.290632    48 ESListener.cpp:240] A fatal error . Full-text engine is not working.
E0506 07:51:45.290681    48 Listener.cpp:252] [Port: 9790, Space: 1, Part: 5] Failed to apply data while committing snapshot.
E0506 07:51:45.291175    48 RaftPart.cpp:1734] [Port: 9790, Space: 1, Part: 5] Bad snapshot, total rows received 13236, total rows sended 15956, total size received 2621889, total size sended 3146403
E0506 07:51:47.029347    48 FileBasedWal.cpp:451] [Port: 9790, Space: 1, Part: 5] There is a gap in the log id. The last log id is 1074012, and the id being appended is 1074012
E0506 07:51:47.029395    48 FileBasedWal.cpp:527] [Port: 9790, Space: 1, Part: 5] Failed to append log for logId 1074012
E0506 07:51:48.565232    45 ESListener.cpp:240] A fatal error . Full-text engine is not working.
E0506 07:51:48.565483    45 Listener.cpp:252] [Port: 9790, Space: 1, Part: 14] Failed to apply data while committing snapshot.
E0506 07:51:48.565644    45 RaftPart.cpp:1734] [Port: 9790, Space: 1, Part: 14] Bad snapshot, total rows received 13290, total rows sended 15979, total size received 2622013, total size sended 3146411
E0506 07:51:48.565980    48 FileBasedWal.cpp:451] [Port: 9790, Space: 1, Part: 14] There is a gap in the log id. The last log id is 1073991, and the id being appended is 1073991
E0506 07:51:48.566354    48 FileBasedWal.cpp:527] [Port: 9790, Space: 1, Part: 14] Failed to append log for logId 1073991

问题背景:
开始创建space之后创建了全文索引,之后新增数据可以通过全文索引搜到。然后过了一段时间之后新建的数据通过全文索引就无法搜到了,我怀疑是同步机制的问题,我无法修改这个,所以我选择了删除全文索引并重建,重建索引之后rebuild,job就一直在running状态,看日志有报错。
问题:
1.我理解是新建的数据不需要重建全文索引也可以搜索到,那么后来我新建的数据为什么用全文索引无法搜到呢,是我部署的问题还是同步机制存在问题呢?
2.重建索引之后的日志显示的错误具体是什么意思,有什么解决方法吗?
3.全文索引无法搜索到某些词汇,似乎是全文索引存在问题,这个我之前问过,请问这个在3.0版本有修复吗?

  1. 有无法查询到时候错误日志吗,这个可能帮忙确认为什么读不到索引。可以尝试下有没有复现步骤。
  2. 这个我需要看一下代码逻辑来看。
  3. 已经修复。

我尝试找一下第一个查不到时候的错误日志。

请问怎么样了,是我操作的问题吗?

无法创建全文索引 - #6,来自 alice 参考一下这个?你给的信息只有失败后的,所以我也不知道具体是怎么造成的。如果有能稳定重现的步骤,也应该可以。

浙ICP备20010487号