全文索引部署问题

Steven_Young · 2023 年1 月 3 日 08:33

Nebula Graph版本:3.3.0
ES版本:7.8.1
在按照文档部署的时候，如果nebula-graph、ES、raft listener都在同一个虚拟机里部署，是否有问题？目前在本机测试的时候发现，raft listener这个进程起不起来。查看错误日志如下：
Log file created at: 2023/01/03 16:07:55
Running on machine: localhost.localdomain
Running duration (h:mm:ss): 0:00:00
Log line format: [IWEF]yyyymmdd hh:mm:ss.uuuuuu threadid file:line] msg
F20230103 16:07:55.039707 59189 ESListener.cpp:25] elasticsearch clients error

但是我第一次按文档操作的时候，是启动成功的，并且通过nebula-console，在show listener中能查看到10条记录都是on-line，但是过了一阵子后，就发现raft listener挂了，且重启也无法启动了。想请问这个和我部署在同一台虚拟机是否有关系？如果没关系，到底是其他哪里的问题呢？

cangfengzhs · 2023 年1 月 3 日 08:37

是否有sign in text service？如果没有的话 add Listener之后它会crash。。。

这个问题会在下个版本修复。并且对全文索引进行了比较大的修改，使其更加合理易用。

min.wu · 2023 年1 月 3 日 09:14

期待

Steven_Young · 2023 年1 月 3 日 09:25

感谢回答，我是按文档来的，在add listener之前已经执行过sign in text service了哈。
但是确实还是过了几分钟后，挂了。我找了下第一次启动的日志：

Log file created at: 2023/01/03 15:24:36
Running on machine: localhost.localdomain
Running duration (h:mm:ss): 0:00:00
Log line format: [IWEF]yyyymmdd hh:mm:ss.uuuuuu threadid file:line] msg
I20230103 15:24:36.295717 58095 StorageDaemon.cpp:132] localhost = "192.168.204.129":9789
I20230103 15:24:36.296041 58095 StorageDaemon.cpp:147] data path= /usr/local/nebula/data
I20230103 15:24:36.301739 58095 MetaClient.cpp:80] Create meta client to "192.168.204.129":9559
I20230103 15:24:36.301775 58095 MetaClient.cpp:81] root path: /usr/local/nebula, data path size: 1
I20230103 15:24:36.352694 58095 MetaClient.cpp:3108] Load leader of "192.168.204.129":9779 in 4 space
I20230103 15:24:36.352735 58095 MetaClient.cpp:3114] Load leader ok
I20230103 15:24:36.356492 58095 MetaClient.cpp:162] Register time task for heartbeat!
I20230103 15:24:36.356532 58095 StorageServer.cpp:219] Init schema manager
I20230103 15:24:36.356539 58095 StorageServer.cpp:222] Init index manager
I20230103 15:24:36.356540 58095 StorageServer.cpp:225] Init kvstore
I20230103 15:24:36.356585 58095 NebulaStore.cpp:51] Start the raft service...
I20230103 15:24:36.357985 58095 NebulaSnapshotManager.cpp:25] Send snapshot is rate limited to 10485760 for each part by default
I20230103 15:24:36.367375 58095 RaftexService.cpp:46] Start raft service on 9790
I20230103 15:24:36.367473 58095 NebulaStore.cpp:290] Init listener from partManager for "192.168.204.129":9789
I20230103 15:24:36.367516 58095 NebulaStore.cpp:78] Register handler...
I20230103 15:24:36.367524 58095 StorageServer.cpp:228] Init LogMonitor
I20230103 15:24:36.367637 58095 StorageServer.cpp:96] Starting Storage HTTP Service
I20230103 15:24:36.368052 58095 StorageServer.cpp:100] Http Thread Pool started
I20230103 15:24:36.370764 58169 WebService.cpp:124] Web service started on HTTP[19789]
I20230103 15:24:36.370807 58095 TransactionManager.cpp:24] TransactionManager ctor()
I20230103 15:24:36.381578 58095 RocksEngine.cpp:97] open rocksdb on /usr/local/nebula/data/nebula/0/data
I20230103 15:24:36.381726 58095 AdminTaskManager.cpp:22] max concurrent subtasks: 10
I20230103 15:24:36.381788 58095 AdminTaskManager.cpp:40] exit AdminTaskManager::init()
I20230103 15:24:36.381896 58193 AdminTaskManager.cpp:227] waiting for incoming task
E20230103 15:27:05.190524 58137 HeaderServerChannel.cpp:100] Received invalid request from client: apache::thrift::transport::TTransportException: Header transport frame is too large: 4294246397 (hex 0xfff4fffd) (transport apache::thrift::PreReceivedDataAsyncTransportWrapper, address ::ffff:127.0.0.1, port 56424)
E20230103 15:27:05.191275 58137 PeekingManager.h:262] peekSuccess failed, dropping connection: apache::thrift::transport::TTransportException: Channel is !good()
I20230103 15:28:16.742077 58158 MetaClient.cpp:3108] Load leader of "192.168.204.129":9779 in 4 space
I20230103 15:28:16.742121 58158 MetaClient.cpp:3114] Load leader ok
I20230103 15:28:16.742230 58158 NebulaStore.cpp:399] Create listener space 22
F20230103 15:28:16.742497 58158 ESListener.cpp:25] elasticsearch clients error

后面再重启，就显示我上面刚开始发的那个错误日志了。

然后我又重新sign in text service后，启动raft listener就又好了，日志如下：

Log file created at: 2023/01/03 17:13:47
Running on machine: localhost.localdomain
Running duration (h:mm:ss): 0:00:00
Log line format: [IWEF]yyyymmdd hh:mm:ss.uuuuuu threadid file:line] msg
I20230103 17:13:47.618950 60121 StorageDaemon.cpp:132] localhost = "192.168.204.129":9789
I20230103 17:13:47.619261 60121 StorageDaemon.cpp:147] data path= /usr/local/nebula/data
I20230103 17:13:47.624300 60121 MetaClient.cpp:80] Create meta client to "192.168.204.129":9559
I20230103 17:13:47.624336 60121 MetaClient.cpp:81] root path: /usr/local/nebula, data path size: 1
I20230103 17:13:47.669274 60121 MetaClient.cpp:3108] Load leader of "192.168.204.129":9779 in 4 space
I20230103 17:13:47.669303 60121 MetaClient.cpp:3114] Load leader ok
I20230103 17:13:47.670230 60121 MetaClient.cpp:162] Register time task for heartbeat!
I20230103 17:13:47.670250 60121 StorageServer.cpp:219] Init schema manager
I20230103 17:13:47.670269 60121 StorageServer.cpp:222] Init index manager
I20230103 17:13:47.670270 60121 StorageServer.cpp:225] Init kvstore
I20230103 17:13:47.670302 60121 NebulaStore.cpp:51] Start the raft service...
I20230103 17:13:47.670912 60121 NebulaSnapshotManager.cpp:25] Send snapshot is rate limited to 10485760 for each part by default
I20230103 17:13:47.683257 60121 RaftexService.cpp:46] Start raft service on 9790
I20230103 17:13:47.683333 60121 NebulaStore.cpp:290] Init listener from partManager for "192.168.204.129":9789
I20230103 17:13:47.683440 60121 Listener.cpp:71] [Port: 9790, Space: 22, Part: 10] Listener start, there are 1 peer hosts, lastLogId 0, lastLogTerm 0, committedLogId 0, lastApplyLogId 0, term 0
I20230103 17:13:47.683476 60121 NebulaStore.cpp:607] Listener of type ELASTICSEARCH of [Space: 22, Part: 10] is added
I20230103 17:13:47.683560 60121 Listener.cpp:71] [Port: 9790, Space: 22, Part: 9] Listener start, there are 1 peer hosts, lastLogId 0, lastLogTerm 0, committedLogId 0, lastApplyLogId 0, term 0
I20230103 17:13:47.683579 60121 NebulaStore.cpp:607] Listener of type ELASTICSEARCH of [Space: 22, Part: 9] is added
I20230103 17:13:47.683670 60121 Listener.cpp:71] [Port: 9790, Space: 22, Part: 8] Listener start, there are 1 peer hosts, lastLogId 0, lastLogTerm 0, committedLogId 0, lastApplyLogId 0, term 0
I20230103 17:13:47.683691 60121 NebulaStore.cpp:607] Listener of type ELASTICSEARCH of [Space: 22, Part: 8] is added
I20230103 17:13:47.683759 60121 Listener.cpp:71] [Port: 9790, Space: 22, Part: 7] Listener start, there are 1 peer hosts, lastLogId 0, lastLogTerm 0, committedLogId 0, lastApplyLogId 0, term 0
I20230103 17:13:47.683779 60121 NebulaStore.cpp:607] Listener of type ELASTICSEARCH of [Space: 22, Part: 7] is added
I20230103 17:13:47.683897 60121 Listener.cpp:71] [Port: 9790, Space: 22, Part: 6] Listener start, there are 1 peer hosts, lastLogId 0, lastLogTerm 0, committedLogId 0, lastApplyLogId 0, term 0
I20230103 17:13:47.683930 60121 NebulaStore.cpp:607] Listener of type ELASTICSEARCH of [Space: 22, Part: 6] is added
I20230103 17:13:47.684046 60121 Listener.cpp:71] [Port: 9790, Space: 22, Part: 2] Listener start, there are 1 peer hosts, lastLogId 0, lastLogTerm 0, committedLogId 0, lastApplyLogId 0, term 0
I20230103 17:13:47.684065 60121 NebulaStore.cpp:607] Listener of type ELASTICSEARCH of [Space: 22, Part: 2] is added
I20230103 17:13:47.684123 60121 Listener.cpp:71] [Port: 9790, Space: 22, Part: 1] Listener start, there are 1 peer hosts, lastLogId 0, lastLogTerm 0, committedLogId 0, lastApplyLogId 0, term 0
I20230103 17:13:47.684142 60121 NebulaStore.cpp:607] Listener of type ELASTICSEARCH of [Space: 22, Part: 1] is added
I20230103 17:13:47.684407 60121 Listener.cpp:71] [Port: 9790, Space: 22, Part: 3] Listener start, there are 1 peer hosts, lastLogId 0, lastLogTerm 0, committedLogId 0, lastApplyLogId 0, term 0
I20230103 17:13:47.684437 60121 NebulaStore.cpp:607] Listener of type ELASTICSEARCH of [Space: 22, Part: 3] is added
I20230103 17:13:47.684592 60121 Listener.cpp:71] [Port: 9790, Space: 22, Part: 4] Listener start, there are 1 peer hosts, lastLogId 0, lastLogTerm 0, committedLogId 0, lastApplyLogId 0, term 0
I20230103 17:13:47.684639 60121 NebulaStore.cpp:607] Listener of type ELASTICSEARCH of [Space: 22, Part: 4] is added

真的很奇怪，我确定第一次在add listener之前是执行过sign in text service的

另外，期待新版本，请问新版本大概啥时候可以发布呢？新版本的raft listener兼容3.3.0版本的nebula graph吗？

cangfengzhs · 2023 年1 月 4 日 07:04

新版我们还在开发。发布时间还不确定。

graph/meta/storage/listener这些只能保证同一个版本内相互兼容。