全文索引重建失败问题

saber · 2022 年5 月 10 日 03:50

nebula 版本：2.6.1
部署方式：分布式
安装方式： Docker
是否为线上版本：N
硬件信息
- SSD
- 12核48G
全文索引删除后重建，rebuild之后一直running
listener日志

E0506 07:51:09.070618    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 11] The given log id 0 is out of the range, the wal firstLogId is 882875
E0506 07:51:09.175349    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 5] The given log id 0 is out of the range, the wal firstLogId is 882681
E0506 07:51:09.307879    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 2] The given log id 0 is out of the range, the wal firstLogId is 882892
E0506 07:51:09.388284    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 14] The given log id 0 is out of the range, the wal firstLogId is 882653
E0506 07:51:09.763123    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 8] The given log id 0 is out of the range, the wal firstLogId is 883593
E0506 07:51:10.071902    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 11] The given log id 0 is out of the range, the wal firstLogId is 882875
E0506 07:51:10.175460    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 5] The given log id 0 is out of the range, the wal firstLogId is 882681
E0506 07:51:10.309094    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 2] The given log id 0 is out of the range, the wal firstLogId is 882892
E0506 07:51:10.388767    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 14] The given log id 0 is out of the range, the wal firstLogId is 882653
E0506 07:51:10.763572    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 8] The given log id 0 is out of the range, the wal firstLogId is 883593
E0506 07:51:11.073329    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 11] The given log id 0 is out of the range, the wal firstLogId is 882875
E0506 07:51:11.175993    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 5] The given log id 0 is out of the range, the wal firstLogId is 882681
E0506 07:51:11.309558    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 2] The given log id 0 is out of the range, the wal firstLogId is 882892
E0506 07:51:11.390130    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 14] The given log id 0 is out of the range, the wal firstLogId is 882653
E0506 07:51:11.763904    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 8] The given log id 0 is out of the range, the wal firstLogId is 883593
E0506 07:51:12.073623    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 11] The given log id 0 is out of the range, the wal firstLogId is 882875
E0506 07:51:12.177021    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 5] The given log id 0 is out of the range, the wal firstLogId is 882681
E0506 07:51:12.309476    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 2] The given log id 0 is out of the range, the wal firstLogId is 882892
E0506 07:51:12.391057    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 14] The given log id 0 is out of the range, the wal firstLogId is 882653
E0506 07:51:12.764941    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 8] The given log id 0 is out of the range, the wal firstLogId is 883593
E0506 07:51:13.074029    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 11] The given log id 0 is out of the range, the wal firstLogId is 882875
E0506 07:51:13.177480    49 WalFileIterator.cpp:31] [Port: 9790, Space: 1, Part: 5] The given log id 0 is out of the range, the wal firstLogId is 882681
E0506 07:51:26.373857    49 ESListener.cpp:240] A fatal error . Full-text engine is not working.
E0506 07:51:26.373905    49 Listener.cpp:252] [Port: 9790, Space: 1, Part: 8] Failed to apply data while committing snapshot.
E0506 07:51:26.374127    49 RaftPart.cpp:1734] [Port: 9790, Space: 1, Part: 8] Bad snapshot, total rows received 0, total rows sended 2492, total size received 0, total size sended 524307
E0506 07:51:30.292593    48 ESListener.cpp:240] A fatal error . Full-text engine is not working.
E0506 07:51:30.292892    48 Listener.cpp:252] [Port: 9790, Space: 1, Part: 11] Failed to apply data while committing snapshot.
E0506 07:51:30.293092    48 RaftPart.cpp:1734] [Port: 9790, Space: 1, Part: 11] Bad snapshot, total rows received 0, total rows sended 2487, total size received 0, total size sended 524428
E0506 07:51:35.721556    44 FileBasedWal.cpp:451] [Port: 9790, Space: 1, Part: 8] There is a gap in the log id. The last log id is 1074926, and the id being appended is 1074926
E0506 07:51:35.721630    44 FileBasedWal.cpp:527] [Port: 9790, Space: 1, Part: 8] Failed to append log for logId 1074926
E0506 07:51:36.293336    44 FileBasedWal.cpp:451] [Port: 9790, Space: 1, Part: 11] There is a gap in the log id. The last log id is 1074208, and the id being appended is 1074208
E0506 07:51:36.293449    44 FileBasedWal.cpp:527] [Port: 9790, Space: 1, Part: 11] Failed to append log for logId 1074208
E0506 07:51:39.166590    49 ESListener.cpp:240] A fatal error . Full-text engine is not working.
E0506 07:51:39.166723    49 Listener.cpp:252] [Port: 9790, Space: 1, Part: 2] Failed to apply data while committing snapshot.
E0506 07:51:39.167699    49 RaftPart.cpp:1734] [Port: 9790, Space: 1, Part: 2] Bad snapshot, total rows received 7482, total rows sended 10021, total size received 1573141, total size sended 2097515
E0506 07:51:39.168103    44 FileBasedWal.cpp:451] [Port: 9790, Space: 1, Part: 2] There is a gap in the log id. The last log id is 1074253, and the id being appended is 1074253
E0506 07:51:39.168131    44 FileBasedWal.cpp:527] [Port: 9790, Space: 1, Part: 2] Failed to append log for logId 1074253
E0506 07:51:45.290632    48 ESListener.cpp:240] A fatal error . Full-text engine is not working.
E0506 07:51:45.290681    48 Listener.cpp:252] [Port: 9790, Space: 1, Part: 5] Failed to apply data while committing snapshot.
E0506 07:51:45.291175    48 RaftPart.cpp:1734] [Port: 9790, Space: 1, Part: 5] Bad snapshot, total rows received 13236, total rows sended 15956, total size received 2621889, total size sended 3146403
E0506 07:51:47.029347    48 FileBasedWal.cpp:451] [Port: 9790, Space: 1, Part: 5] There is a gap in the log id. The last log id is 1074012, and the id being appended is 1074012
E0506 07:51:47.029395    48 FileBasedWal.cpp:527] [Port: 9790, Space: 1, Part: 5] Failed to append log for logId 1074012
E0506 07:51:48.565232    45 ESListener.cpp:240] A fatal error . Full-text engine is not working.
E0506 07:51:48.565483    45 Listener.cpp:252] [Port: 9790, Space: 1, Part: 14] Failed to apply data while committing snapshot.
E0506 07:51:48.565644    45 RaftPart.cpp:1734] [Port: 9790, Space: 1, Part: 14] Bad snapshot, total rows received 13290, total rows sended 15979, total size received 2622013, total size sended 3146411
E0506 07:51:48.565980    48 FileBasedWal.cpp:451] [Port: 9790, Space: 1, Part: 14] There is a gap in the log id. The last log id is 1073991, and the id being appended is 1073991
E0506 07:51:48.566354    48 FileBasedWal.cpp:527] [Port: 9790, Space: 1, Part: 14] Failed to append log for logId 1073991

问题背景：
开始创建space之后创建了全文索引，之后新增数据可以通过全文索引搜到。然后过了一段时间之后新建的数据通过全文索引就无法搜到了，我怀疑是同步机制的问题，我无法修改这个，所以我选择了删除全文索引并重建，重建索引之后rebuild，job就一直在running状态，看日志有报错。
问题：
1.我理解是新建的数据不需要重建全文索引也可以搜索到，那么后来我新建的数据为什么用全文索引无法搜到呢，是我部署的问题还是同步机制存在问题呢？
2.重建索引之后的日志显示的错误具体是什么意思，有什么解决方法吗？
3.全文索引无法搜索到某些词汇，似乎是全文索引存在问题，这个我之前问过，请问这个在3.0版本有修复吗？

SuperYoko · 2022 年5 月 10 日 06:50

有无法查询到时候错误日志吗，这个可能帮忙确认为什么读不到索引。可以尝试下有没有复现步骤。
这个我需要看一下代码逻辑来看。
已经修复。

saber · 2022 年5 月 10 日 07:21

我尝试找一下第一个查不到时候的错误日志。

saber · 2022 年5 月 11 日 10:20

请问怎么样了，是我操作的问题吗？

SuperYoko · 2022 年5 月 11 日 13:07

无法创建全文索引 - #6，来自 alice 参考一下这个？你给的信息只有失败后的，所以我也不知道具体是怎么造成的。如果有能稳定重现的步骤，也应该可以。

system · 2022 年6 月 10 日 13:07

此话题已在最后回复的 30 天后被自动关闭。不再允许新回复。