导入数据前可以正常链接, 导入数据后 Create session failed: Unknown error!

chaoyangrunning · 2022 年3 月 23 日 11:00

nebula 版本：3.0.1
部署方式：单机
安装方式：RPM
是否为线上版本：Y

第二次碰到这个问题,导入数据前链接console
./nebula-console-darwin-amd64-v3.0.0 -addr xxx -port 8069 -u root -p nebula
可以正常连接, 然后通过java-client 导入数据 , 再连接console 就报错

2022/03/23 18:35:56 Fail to create a new session from connection pool, fail to authenticate, error: Create session failed: Unknown error!
panic: Fail to create a new session from connection pool, fail to authenticate, error: Create session failed: Unknown error!

goroutine 1 [running]:
log.Panicf(0x136d1c9, 0x35, 0xc0000b1e38, 0x1, 0x1)
        /opt/hostedtoolcache/go/1.16.4/x64/src/log/log.go:361 +0xc5
main.main()
        /home/runner/work/nebula-console/nebula-console/main.go:541 +0x9d9

steam · 2022 年3 月 23 日 11:03

确定下你的账号和密码是否填写正确。

chaoyangrunning · 2022 年3 月 23 日 11:05

请看我的标题,之前可以正常连接的,导入数据后相同的命令就连接失败

chaoyangrunning · 2022 年3 月 23 日 11:08

并且如果restart all之后 , nebula 就启动不起来了 , 第一次的解决方式是卸载所有数据,升级nebula版本为3.0.1 。现在又出现了这个问题 , 不能再让我卸载重新装吧…

chaoyangrunning · 2022 年3 月 23 日 11:11

账号密码都是一样的, 现在老的session还可以用 , 新的session创建失败

chaoyangrunning · 2022 年3 月 23 日 11:12

报错信息

E20220323 19:08:57.121109 93816 GraphSessionManager.cpp:222] Update sessions failed: Unknown error!
E20220323 19:08:57.121158 93834 GraphSessionManager.cpp:246] Update sessions failed: Update sessions failed: Unknown error!
E20220323 19:08:57.288569 93833 MetaClient.cpp:171] Heartbeat failed, status:Unknown error!
E20220323 19:09:07.131706 93818 GraphSessionManager.cpp:222] Update sessions failed: Unknown error!
E20220323 19:09:07.131762 93834 GraphSessionManager.cpp:246] Update sessions failed: Update sessions failed: Unknown error!
E20220323 19:09:07.299022 93833 MetaClient.cpp:171] Heartbeat failed, status:Unknown error!
E20220323 19:09:07.656579 93508 GraphSessionManager.cpp:113] Create session failed:Unknown error!
E20220323 19:09:07.656613 93508 GraphService.cpp:101] Create session for userName: root, ip: 172.22.112.7 failed: Create session failed: Unknown error!
E20220323 19:09:17.142182 93821 GraphSessionManager.cpp:222] Update sessions failed: Unknown error!
E20220323 19:09:17.142225 93834 GraphSessionManager.cpp:246] Update sessions failed: Update sessions failed: Unknown error!
E20220323 19:09:17.309360 93833 MetaClient.cpp:171] Heartbeat failed, status:Unknown error!
E20220323 19:09:27.152621 93823 GraphSessionManager.cpp:222] Update sessions failed: Unknown error!
E20220323 19:09:27.152679 93834 GraphSessionManager.cpp:246] Update sessions failed: Update sessions failed: Unknown error!
E20220323 19:09:27.319674 93833 MetaClient.cpp:171] Heartbeat failed, status:Unknown error!
E20220323 19:09:37.163080 93825 GraphSessionManager.cpp:222] Update sessions failed: Unknown error!
E20220323 19:09:37.163125 93834 GraphSessionManager.cpp:246] Update sessions failed: Update sessions failed: Unknown error!
E20220323 19:09:37.329994 93833 MetaClient.cpp:171] Heartbeat failed, status:Unknown error!
E20220323 19:09:47.173628 93827 GraphSessionManager.cpp:222] Update sessions failed: Unknown error!
E20220323 19:09:47.173697 93834 GraphSessionManager.cpp:246] Update sessions failed: Update sessions failed: Unknown error!
E20220323 19:09:47.340382 93833 MetaClient.cpp:171] Heartbeat failed, status:Unknown error!
E20220323 19:09:57.184171 93829 GraphSessionManager.cpp:222] Update sessions failed: Unknown error!
E20220323 19:09:57.184221 93834 GraphSessionManager.cpp:246] Update sessions failed: Update sessions failed: Unknown error!
E20220323 19:09:57.350754 93833 MetaClient.cpp:171] Heartbeat failed, status:Unknown error!
E20220323 19:10:07.187142 93831 GraphSessionManager.cpp:222] Update sessions failed: Unknown error!
E20220323 19:10:07.187201 93834 GraphSessionManager.cpp:246] Update sessions failed: Update sessions failed: Unknown error!
E20220323 19:10:07.361157 93833 MetaClient.cpp:171] Heartbeat failed, status:Unknown error!
E20220323 19:10:08.103847 93511 GraphSessionManager.cpp:113] Create session failed:Unknown error!

steam · 2022 年3 月 23 日 11:23

那就排除了账号密码不正确，maxConnSize 你的这个设置的多少，会不会是 Session 满了，你之前 release 过 session 吗？

chaoyangrunning · 2022 年3 月 23 日 11:33

确实有点多, 这样该怎么处理

tcp        0      0 127.0.0.1:9559          127.0.0.1:46512         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:41766         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46498         ESTABLISHED 93336/nebula-metad  
tcp        0      0 10.89.108.33:41938      10.88.128.19:4270       ESTABLISHED 95442/java          
tcp        0      0 127.0.0.1:9559          127.0.0.1:46540         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46496         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46540         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46582         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41766         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46590         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9779          127.0.0.1:41904         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46526         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46506         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46598         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9559          127.0.0.1:46562         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9779          127.0.0.1:41754         ESTABLISHED 93532/nebula-storag 
tcp        0      0 10.89.108.33:56128      10.89.108.33:8069       ESTABLISHED 95442/java          
tcp        0      0 127.0.0.1:46604         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46556         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46528         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9778          127.0.0.1:48850         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46500         ESTABLISHED 93336/nebula-metad  
tcp        0      0 10.89.108.33:37322      10.88.128.90:8000       ESTABLISHED 10575/client        
tcp        0      0 127.0.0.1:46508         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46586         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9779          127.0.0.1:41756         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9778          127.0.0.1:48678         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41772         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41874         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46544         ESTABLISHED 93336/nebula-metad  
tcp        0   1280 10.89.108.33:22         10.83.0.118:43082       ESTABLISHED 49305/sshd: lichaoy 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46536         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9559          127.0.0.1:46548         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9559          127.0.0.1:46592         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9559          127.0.0.1:46600         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46548         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46494         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9559          127.0.0.1:46538         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9779          127.0.0.1:41906         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46578         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9779          127.0.0.1:41878         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46524         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46562         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41912         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46584         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:48678         127.0.0.1:9778          ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9779          127.0.0.1:41872         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46546         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41874         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41784         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9778          127.0.0.1:48764         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46518         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46554         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46498         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46516         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46596         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46602         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46490         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46516         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9559          127.0.0.1:46508         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9779          127.0.0.1:41882         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46518         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46592         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41892         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46530         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46542         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46578         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46574         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9779          127.0.0.1:41876         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:48746         127.0.0.1:9778          ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9559          127.0.0.1:46580         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46538         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46546         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9559          127.0.0.1:46520         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9779          127.0.0.1:41796         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:41754         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46494         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46514         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46550         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41870         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46506         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46486         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:41908         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41896         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46486         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9778          127.0.0.1:48830         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46484         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46492         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9779          127.0.0.1:41918         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:41890         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46554         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46504         ESTABLISHED 93336/nebula-metad  
tcp        0      0 10.89.108.33:46450      10.88.128.47:4010       ESTABLISHED 95442/java          
tcp        0      0 127.0.0.1:9779          127.0.0.1:41902         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:41772         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46560         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41870         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41796         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 10.89.108.33:46448      10.88.128.47:4010       ESTABLISHED 95442/java          
tcp        0      0 127.0.0.1:9779          127.0.0.1:41900         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41782         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:41910         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41884         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46590         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41904         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46560         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46598         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 10.89.108.33:22         10.83.0.118:46957       ESTABLISHED 89971/sshd: lichaoy 
tcp        0      0 127.0.0.1:41894         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46490         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9559          127.0.0.1:46584         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9559          127.0.0.1:46596         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9779          127.0.0.1:41894         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46552         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:41902         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41808         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:41888         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41886         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:48788         127.0.0.1:9778          ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46524         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46510         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41806         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:41774         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9778          127.0.0.1:48746         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41774         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:41918         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41920         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46530         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 10.89.108.33:39830      10.89.108.33:8069       TIME_WAIT   -                   
tcp        0      0 127.0.0.1:9559          127.0.0.1:46488         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:41868         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46556         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9559          127.0.0.1:46534         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:41880         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46488         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:41916         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41868         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46502         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41910         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46500         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:48718         127.0.0.1:9778          ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:41898         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41896         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41908         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46594         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:48872         127.0.0.1:9778          ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46558         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46582         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9779          127.0.0.1:41916         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46544         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:48698         127.0.0.1:9778          ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:41882         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41884         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41900         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46526         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41808         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46496         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:48764         127.0.0.1:9778          ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9779          127.0.0.1:41886         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:48850         127.0.0.1:9778          ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:41866         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41876         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41880         ESTABLISHED 93532/nebula-storag 
tcp        0      0 10.89.108.33:8088       172.22.105.248:57780    ESTABLISHED 95442/java          
tcp        0      0 127.0.0.1:41756         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46588         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41912         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:41906         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:48830         127.0.0.1:9778          ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46534         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41764         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46558         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9559          127.0.0.1:46550         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:41798         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46482         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46532         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46542         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:41782         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9778          127.0.0.1:48698         ESTABLISHED 93532/nebula-storag 
tcp        0      0 10.89.108.33:8069       10.89.108.33:56128      ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:48810         127.0.0.1:9778          ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46574         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 10.89.108.33:50618      10.85.128.180:1636      ESTABLISHED 2439/sssd_be        
tcp        0      0 127.0.0.1:9778          127.0.0.1:48810         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46492         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41914         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41764         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46600         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46482         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46512         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46552         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9778          127.0.0.1:48718         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46532         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46586         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41878         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41866         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:41872         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46520         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46522         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9559          127.0.0.1:46588         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:46580         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41892         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46484         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9779          127.0.0.1:41898         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46536         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46514         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:46522         127.0.0.1:9559          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 10.89.108.33:41936      10.88.128.19:4270       ESTABLISHED 95442/java          
tcp        0      0 10.89.108.33:58740      10.88.128.11:10081      ESTABLISHED 2720/sysagentd      
tcp        0      0 127.0.0.1:9559          127.0.0.1:46502         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9559          127.0.0.1:46510         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9778          127.0.0.1:48788         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46602         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9779          127.0.0.1:41890         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9779          127.0.0.1:41798         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:46504         127.0.0.1:9559          ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:9559          127.0.0.1:46604         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:42622         127.0.0.1:2020          ESTABLISHED 10575/client        
tcp        0      0 127.0.0.1:9559          127.0.0.1:46528         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:9559          127.0.0.1:46594         ESTABLISHED 93336/nebula-metad  
tcp        0      0 127.0.0.1:2020          127.0.0.1:42622         ESTABLISHED 10511/client        
tcp        0      0 127.0.0.1:9779          127.0.0.1:41888         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:41806         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:9778          127.0.0.1:48872         ESTABLISHED 93532/nebula-storag 
tcp        0      0 127.0.0.1:41920         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41784         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd 
tcp        0      0 127.0.0.1:41914         127.0.0.1:9779          ESTABLISHED 93447/nebula-graphd

Aiee · 2022 年3 月 24 日 05:58

现在没有主动去关闭的方式, 只能等自动清理了, 为了避免session过多可以在配置里把 --session_idle_timeout_secs 设置小一点, 用客户端导数据的时候不要每个语句都创建一个session去执行, 应该用一个session执行多个语句

chaoyangrunning · 2022 年3 月 24 日 07:07

现在已经好了, 自愈…

steam · 2022 年3 月 24 日 07:47

大概是 session 失效了。你如果后续有问题的话，可以再来开个帖子或者更新帖子（帖子会在 1 个月内自动关闭的）

chaoyangrunning · 2022 年3 月 24 日 10:37

太痛了, 又出现了, 并且我把这个组件封装成spring管理之后出现这个问题项目都起不来

chaoyangrunning · 2022 年3 月 25 日 03:00

HarrisChu · 2022 年3 月 25 日 03:04

meta 的日志是什么样的
还有导入数据是怎么导入的，用的 importer 还是自己写代码导入的

pencher · 2022 年3 月 25 日 03:12

1、meta日志：

E20220325 09:25:41.507702 173128 SessionManagerProcessor.cpp:37] Put data error on meta server, errorCode: E_RAFT_WAL_FAIL
E20220325 09:34:56.864111 173128 SessionManagerProcessor.cpp:37] Put data error on meta server, errorCode: E_RAFT_WAL_FAIL
E20220325 09:34:57.071053 173128 SessionManagerProcessor.cpp:37] Put data error on meta server, errorCode: E_RAFT_WAL_FAIL
E20220325 09:34:57.275041 173128 SessionManagerProcessor.cpp:37] Put data error on meta server, errorCode: E_RAFT_WAL_FAIL
E20220325 09:34:57.472040 173128 SessionManagerProcessor.cpp:37] Put data error on meta server, errorCode: E_RAFT_WAL_FAIL
E20220325 09:52:18.052909 173128 SessionManagerProcessor.cpp:37] Put data error on meta server, errorCode: E_RAFT_WAL_FAIL
E20220325 09:52:18.265867 173128 SessionManagerProcessor.cpp:37] Put data error on meta server, errorCode: E_RAFT_WAL_FAIL
E20220325 10:14:25.814276 173128 SessionManagerProcessor.cpp:37] Put data error on meta server, errorCode: E_RAFT_WAL_FAIL
E20220325 10:54:41.361831 173128 SessionManagerProcessor.cpp:37] Put data error on meta server, errorCode: E_RAFT_WAL_FAIL
E20220325 10:55:50.394062 173128 SessionManagerProcessor.cpp:37] Put data error on meta server, errorCode: E_RAFT_WAL_FAIL

2、导入数据是拿java自实现的，会混合insert和update进行全量导数据

HarrisChu · 2022 年3 月 25 日 03:17

自己实现的话，是用一个池子，还是每个 insert 一个 session？
如果是每个 insert 一个 session，可以改一下，一个线程持有一个 session。

pencher · 2022 年3 月 25 日 03:23

这块逻辑在优化了，那目前meta的错误就是因为session所导致的？而且我们尝试重启后，就发现如下错误

并且console就无法正常连接了。

HarrisChu · 2022 年3 月 25 日 05:40

改一下 ulimit -n
然后像上面说的，session_idle_timeout_secs 改小一点，然后等 meta 里的 session 慢慢过期就应该好了。

如果还是不好，分别发一下 graph 和 meta 的日志

chaoyangrunning · 2022 年3 月 25 日 06:56

graph日志:

I20220325 14:50:20.448336 163859 GraphDaemon.cpp:129] Starting Graph HTTP Service
I20220325 14:50:20.457759 163880 WebService.cpp:128] Web service started on HTTP[19669], HTTP2[19670]
I20220325 14:50:20.457816 163859 GraphDaemon.cpp:143] Number of networking IO threads: 40
I20220325 14:50:20.457834 163859 GraphDaemon.cpp:152] Number of worker threads: 40
I20220325 14:50:20.499397 163859 MetaClient.cpp:84] Create meta client to "127.0.0.1":9559
I20220325 14:50:20.499445 163859 MetaClient.cpp:85] root path: /usr/local/nebula, data path size: 0
E20220325 14:50:22.520723 163859 MetaClient.cpp:102] Heartbeat failed, status:Unknown error!
I20220325 14:50:22.520977 163859 MetaClient.cpp:133] Waiting for the metad to be ready!
E20220325 14:50:32.523074 163859 MetaClient.cpp:102] Heartbeat failed, status:Unknown error!
I20220325 14:50:32.523111 163859 MetaClient.cpp:133] Waiting for the metad to be ready!
E20220325 14:50:42.525195 163859 MetaClient.cpp:102] Heartbeat failed, status:Unknown error!
I20220325 14:50:42.525241 163859 MetaClient.cpp:133] Waiting for the metad to be ready!
E20220325 14:50:52.527305 163859 MetaClient.cpp:102] Heartbeat failed, status:Unknown error!
I20220325 14:50:52.527834 163859 MetaClient.cpp:144] Register time task for heartbeat!
E20220325 14:50:52.527890 163859 GraphService.cpp:51] Failed to wait for meta service ready synchronously.
E20220325 14:50:52.527927 163859 GraphServer.cpp:39] Failed to wait for meta service ready synchronously.
E20220325 14:50:52.531066 163859 GraphDaemon.cpp:163] The graph server start failed

chaoyangrunning · 2022 年3 月 25 日 06:56

meta日志:

Log line format: [IWEF]yyyymmdd hh:mm:ss.uuuuuu threadid file:line] msg
I20220325 14:50:20.369393 163769 MetaDaemon.cpp:138] localhost = "127.0.0.1":9559
I20220325 14:50:20.401501 163769 NebulaStore.cpp:51] Start the raft service...
I20220325 14:50:20.405692 163769 NebulaSnapshotManager.cpp:25] Send snapshot is rate limited to 10485760 for each part by default
I20220325 14:50:20.410236 163769 RaftexService.cpp:63] Init thrift server for raft service, port: 9560
I20220325 14:50:20.410838 163830 RaftexService.cpp:94] Starting the Raftex Service
I20220325 14:50:20.438757 163830 RaftexService.cpp:84] Starting the Raftex Service on 9560
I20220325 14:50:20.438794 163830 RaftexService.cpp:106] Start the Raftex Service successfully
I20220325 14:50:20.438971 163769 NebulaStore.cpp:83] Scan the local path, and init the spaces_
I20220325 14:50:20.439018 163769 NebulaStore.cpp:89] Scan path "/usr/local/nebula/data/meta/nebula/0"
I20220325 14:50:20.449383 163769 RocksEngine.cpp:142] open rocksdb on /usr/local/nebula/data/meta/nebula/0/data
I20220325 14:50:20.449398 163769 NebulaStore.cpp:113] Load space 0 from disk
I20220325 14:50:20.449424 163769 NebulaStore.cpp:141] Need to open 1 parts of space 0
I20220325 14:50:20.465960 163820 FileBasedWal.cpp:66] [Port: 9560, Space: 0, Part: 0] lastLogId in wal is 4677, lastLogTerm is 2, path is /usr/local/nebula/data/meta/nebula/0/wal/0/0000000000000000001.wal
I20220325 14:50:20.466092 163820 RaftPart.cpp:299] [Port: 9560, Space: 0, Part: 0] There are 0 peer hosts, and total 1 copies. The quorum is 1, as learner 0, lastLogId 4677, lastLogTerm 2, committedLogId 4677, committedLogTerm 2, term 2
I20220325 14:50:20.466468 163820 NebulaStore.cpp:145] Load part 0, 0 from disk
I20220325 14:50:20.466491 163769 NebulaStore.cpp:160] Load space 0 complete
I20220325 14:50:20.466511 163769 NebulaStore.cpp:169] Init data from partManager for "127.0.0.1":9559
I20220325 14:50:20.466526 163769 NebulaStore.cpp:264] Data space 0 has existed!
I20220325 14:50:20.466532 163769 NebulaStore.cpp:304] [Space: 0, Part: 0] has existed!
I20220325 14:50:20.466553 163769 NebulaStore.cpp:76] Register handler...
I20220325 14:50:20.466563 163769 MetaDaemonInit.cpp:104] Waiting for the leader elected...
I20220325 14:50:20.466572 163769 MetaDaemonInit.cpp:116] Leader has not been elected, sleep 1s
I20220325 14:50:21.459878 163821 RaftPart.cpp:1018] [Port: 9560, Space: 0, Part: 0] Start leader election, reason: lastMsgDur 1000, term 2
I20220325 14:50:21.459923 163821 RaftPart.cpp:1184] [Port: 9560, Space: 0, Part: 0] Sending out an election request (space = 0, part = 0, term = 3, lastLogId = 4677, lastLogTerm = 2, candidateIP = 127.0.0.1, candidatePort = 9560), isPreVote = 1
I20220325 14:50:21.459934 163821 RaftPart.cpp:1139] [Port: 9560, Space: 0, Part: 0] Partition win prevote of term 3
I20220325 14:50:21.459954 163821 RaftPart.cpp:1184] [Port: 9560, Space: 0, Part: 0] Sending out an election request (space = 0, part = 0, term = 3, lastLogId = 4677, lastLogTerm = 2, candidateIP = 127.0.0.1, candidatePort = 9560), isPreVote = 0
I20220325 14:50:21.459959 163821 RaftPart.cpp:1141] [Port: 9560, Space: 0, Part: 0] Partition is elected as the new leader for term 3
W20220325 14:50:21.460031 163816 FileBasedWal.cpp:519] [Port: 9560, Space: 0, Part: 0] Failed to appendLogs because of no more space
W20220325 14:50:21.460222 163816 RaftPart.cpp:750] [Port: 9560, Space: 0, Part: 0] Failed to write into WAL
W20220325 14:50:21.460237 163816 RaftPart.cpp:765] [Port: 9560, Space: 0, Part: 0] Failed to write wal
I20220325 14:50:21.466733 163769 MetaDaemonInit.cpp:143] Get meta version is 3
I20220325 14:50:21.466747 163769 MetaDaemonInit.cpp:160] Nebula store init succeeded, clusterId 5910483749134832870
I20220325 14:50:21.466754 163769 MetaDaemon.cpp:151] Start http service
I20220325 14:50:21.467327 163769 MetaDaemonInit.cpp:168] Starting Meta HTTP Service
I20220325 14:50:21.478003 164001 WebService.cpp:128] Web service started on HTTP[19559], HTTP2[19560]
I20220325 14:50:21.478130 163769 JobDescription.cpp:57] p = server_1_0
I20220325 14:50:21.478142 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478154 163769 JobDescription.cpp:57] p = server_1_1
I20220325 14:50:21.478159 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478164 163769 JobDescription.cpp:57] p = server_1_2
I20220325 14:50:21.478178 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478183 163769 JobDescription.cpp:57] p = server_2_0
I20220325 14:50:21.478188 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478192 163769 JobDescription.cpp:57] p = server_2_1
I20220325 14:50:21.478196 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478202 163769 JobDescription.cpp:57] p = server_2_2
I20220325 14:50:21.478206 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478211 163769 JobDescription.cpp:57] p = server_2_3
I20220325 14:50:21.478215 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478220 163769 JobDescription.cpp:57] p = server_2_4
I20220325 14:50:21.478224 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478229 163769 JobDescription.cpp:57] p = server_2_5
I20220325 14:50:21.478233 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478238 163769 JobDescription.cpp:57] p = server_3_0
I20220325 14:50:21.478242 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478246 163769 JobDescription.cpp:57] p = server_3_1
I20220325 14:50:21.478250 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478255 163769 JobDescription.cpp:57] p = server_3_2
I20220325 14:50:21.478260 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478266 163769 JobDescription.cpp:57] p = server_3_3
I20220325 14:50:21.478269 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478274 163769 JobDescription.cpp:57] p = server_4_0
I20220325 14:50:21.478277 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478283 163769 JobDescription.cpp:57] p = staff_1_0
I20220325 14:50:21.478287 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478292 163769 JobDescription.cpp:57] p = staff_1_1
I20220325 14:50:21.478296 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478302 163769 JobDescription.cpp:57] p = staff_1_2
I20220325 14:50:21.478305 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478310 163769 JobDescription.cpp:57] p = staff_1_3
I20220325 14:50:21.478314 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478319 163769 JobDescription.cpp:57] p = staff_2_0
I20220325 14:50:21.478323 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478329 163769 JobDescription.cpp:57] p = staff_2_1
I20220325 14:50:21.478333 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478358 163769 JobDescription.cpp:57] p = staff_2_2
I20220325 14:50:21.478364 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478369 163769 JobDescription.cpp:57] p = staff_2_3
I20220325 14:50:21.478374 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478379 163769 JobDescription.cpp:57] p = staff_2_4
I20220325 14:50:21.478382 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478387 163769 JobDescription.cpp:57] p = staff_2_5
I20220325 14:50:21.478391 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478396 163769 JobDescription.cpp:57] p = staff_3_0
I20220325 14:50:21.478406 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478412 163769 JobDescription.cpp:57] p = staff_3_1
I20220325 14:50:21.478416 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478421 163769 JobDescription.cpp:57] p = staff_3_2
I20220325 14:50:21.478425 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478430 163769 JobDescription.cpp:57] p = staff_3_3
I20220325 14:50:21.478435 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478439 163769 JobDescription.cpp:57] p = staff_4_0
I20220325 14:50:21.478443 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478448 163769 JobDescription.cpp:57] p = domain_1_0
I20220325 14:50:21.478451 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478457 163769 JobDescription.cpp:57] p = resolve_of_1_0
I20220325 14:50:21.478461 163769 JobDescription.cpp:57] p = investmentknowledge_2022_03_25
I20220325 14:50:21.478938 163769 JobManager.cpp:61] JobManager initialized
I20220325 14:50:21.478950 163769 MetaDaemon.cpp:181] Check and init root user
I20220325 14:50:21.478950 164007 JobManager.cpp:116] JobManager::runJobBackground() enter
I20220325 14:50:21.478982 163769 RootUserMan.h:28] Root user exists
I20220325 14:50:21.482998 163769 MetaDaemon.cpp:216] The meta daemon start on "127.0.0.1":9559
I20220325 14:50:22.470626 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:50:22.518661 164053 BaseProcessor-inl.h:426] Put data error on meta server
I20220325 14:50:22.520601 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":8069, role = GRAPH
I20220325 14:50:22.606217 164053 BaseProcessor-inl.h:426] Put data error on meta server
I20220325 14:50:22.608455 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:50:32.522954 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":8069, role = GRAPH
I20220325 14:50:32.610767 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:50:42.525076 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":8069, role = GRAPH
I20220325 14:50:42.612767 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:50:52.527179 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":8069, role = GRAPH
I20220325 14:50:52.614807 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:51:02.616951 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:51:12.619520 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:51:22.621595 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:51:32.623659 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:51:42.625839 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:51:52.628034 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:52:02.630247 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:52:12.632400 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:52:22.634516 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:52:32.636912 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:52:42.639061 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
W20220325 14:52:50.707931 163816 FileBasedWal.cpp:519] [Port: 9560, Space: 0, Part: 0] Failed to appendLogs because of no more space
W20220325 14:52:50.707965 163816 RaftPart.cpp:750] [Port: 9560, Space: 0, Part: 0] Failed to write into WAL
W20220325 14:52:50.707980 163816 RaftPart.cpp:765] [Port: 9560, Space: 0, Part: 0] Failed to write wal
I20220325 14:52:52.639523 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:53:02.640024 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:53:12.640460 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE
I20220325 14:53:22.640878 164053 HBProcessor.cpp:33] Receive heartbeat from "127.0.0.1":9779, role = STORAGE