修正了storage的路径,但是出现了新的问题,节点三无法进行负载均衡。
storage2(节点174)日志如下:
Log file created at: 2021/01/05 10:18:11
Running on machine: node174
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
E0105 10:18:11.907562 47 MetaClient.cpp:581] Send request to [192.168.4.172:45500], exceed retry limit
E0105 10:18:11.908147 1 MetaClient.cpp:60] Heartbeat failed, status:RPC failure in MetaClient: N6apache6thrift9transport19TTransportExceptionE: AsyncSocketException: connect failed, type = Socket not open, errno = 111 (Connection refused): Connection refused
E0105 10:18:16.920635 48 MetaClient.cpp:581] Send request to [192.168.4.173:45500], exceed retry limit
E0105 10:18:16.920774 1 MetaClient.cpp:60] Heartbeat failed, status:RPC failure in MetaClient: N6apache6thrift9transport19TTransportExceptionE: AsyncSocketException: connect failed, type = Socket not open, errno = 111 (Connection refused): Connection refused
E0105 10:18:21.930452 49 MetaClient.cpp:581] Send request to [192.168.4.173:45500], exceed retry limit
E0105 10:18:21.930596 1 MetaClient.cpp:60] Heartbeat failed, status:RPC failure in MetaClient: N6apache6thrift9transport19TTransportExceptionE: AsyncSocketException: connect failed, type = Socket not open, errno = 111 (Connection refused): Connection refused
E0105 10:18:26.939930 50 MetaClient.cpp:581] Send request to [192.168.4.173:45500], exceed retry limit
E0105 10:18:26.940073 1 MetaClient.cpp:60] Heartbeat failed, status:RPC failure in MetaClient: N6apache6thrift9transport19TTransportExceptionE: AsyncSocketException: connect failed, type = Socket not open, errno = 111 (Connection refused): Connection refused
E0105 10:18:31.947383 51 MetaClient.cpp:581] Send request to [192.168.4.174:45500], exceed retry limit
E0105 10:18:31.947558 1 MetaClient.cpp:60] Heartbeat failed, status:RPC failure in MetaClient: N6apache6thrift9transport19TTransportExceptionE: AsyncSocketException: connect failed, type = Socket not open, errno = 111 (Connection refused): Connection refused
E0105 10:18:36.953166 52 MetaClient.cpp:581] Send request to [192.168.4.172:45500], exceed retry limit
E0105 10:18:36.953209 1 MetaClient.cpp:60] Heartbeat failed, status:RPC failure in MetaClient: N6apache6thrift9transport19TTransportExceptionE: AsyncSocketException: connect failed, type = Socket not open, errno = 111 (Connection refused): Connection refused
E0105 10:18:41.959241 53 MetaClient.cpp:581] Send request to [192.168.4.174:45500], exceed retry limit
E0105 10:18:41.959386 1 MetaClient.cpp:60] Heartbeat failed, status:RPC failure in MetaClient: N6apache6thrift9transport19TTransportExceptionE: AsyncSocketException: connect failed, type = Socket not open, errno = 111 (Connection refused): Connection refused
E0105 10:18:46.966591 54 MetaClient.cpp:581] Send request to [192.168.4.173:45500], exceed retry limit
E0105 10:18:46.966815 1 MetaClient.cpp:60] Heartbeat failed, status:RPC failure in MetaClient: N6apache6thrift9transport19TTransportExceptionE: AsyncSocketException: connect failed, type = Socket not open, errno = 111 (Connection refused): Connection refused
E0105 10:18:51.973871 55 MetaClient.cpp:581] Send request to [192.168.4.173:45500], exceed retry limit
E0105 10:18:51.974232 1 MetaClient.cpp:60] Heartbeat failed, status:RPC failure in MetaClient: N6apache6thrift9transport19TTransportExceptionE: AsyncSocketException: connect failed, type = Socket not open, errno = 111 (Connection refused): Connection refused
E0105 10:18:56.981074 56 MetaClient.cpp:581] Send request to [192.168.4.172:45500], exceed retry limit
E0105 10:18:56.981233 1 MetaClient.cpp:60] Heartbeat failed, status:RPC failure in MetaClient: N6apache6thrift9transport19TTransportExceptionE: AsyncSocketException: connect failed, type = Socket not open, errno = 111 (Connection refused): Connection refused
E0105 10:19:01.988679 57 MetaClient.cpp:581] Send request to [192.168.4.172:45500], exceed retry limit
E0105 10:19:01.988848 1 MetaClient.cpp:60] Heartbeat failed, status:RPC failure in MetaClient: N6apache6thrift9transport19TTransportExceptionE: AsyncSocketException: connect failed, type = Socket not open, errno = 111 (Connection refused): Connection refused
E0105 10:19:04.036823 1 FileUtils.cpp:384] Failed to read the directory "/data/storage/nebula" (2): No such file or directory
E0105 10:19:14.540446 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:14.545289 72 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:14.709971 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 7] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:14.776453 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 5] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:14.833817 73 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 12] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:14.868283 72 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 1] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:14.894500 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:15.055819 71 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:15.194967 71 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:15.204264 71 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 11] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:15.334497 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 8] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:15.561573 71 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 1] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:15.583844 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 12] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:15.630020 73 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 9] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:15.705348 73 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 2] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:15.738442 73 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:15.787411 72 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 15] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:15.826735 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:15.863909 71 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:15.914476 73 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 5] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:15.952232 72 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 13] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:16.059249 72 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:16.128185 72 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 7] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:16.326520 71 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 11] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:16.341861 71 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:16.401929 73 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 1] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:16.421479 72 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:16.435278 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:16.791077 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 13] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:16.823143 73 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:16.962486 73 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 11] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.020681 72 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 7] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.051853 72 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 8] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.063586 71 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 9] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.138408 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 15] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.152243 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 12] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.166110 73 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.166332 72 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 2] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.352713 71 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.494266 72 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 11] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.529575 72 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.562041 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 13] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.670450 71 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 2] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.773774 73 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 5] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.810989 73 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 7] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.897228 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.921401 71 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.993551 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:17.994771 71 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 1] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:18.381151 73 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 11] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:18.385186 71 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 9] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:18.516472 73 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 5] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:18.580487 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 8] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:18.645769 72 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:18.717994 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 1] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:18.721875 73 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 12] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:18.780156 71 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:18.836540 70 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:18.862300 72 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 15] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:18.985179 73 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from [192.168.4.173:44501], error code is -6
E0105 10:19:19.017736 72 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 2] Receive response about askForVote from [192.168.4.173:44501], error code is -6
console输出如下:
(graph1) lyc@kdhy-X299-WU8:~/nebula-example/nebula-v2.0$ ./nebula-console -addr 192.168.4.172 -port 3699 -u root -p nebula
Welcome to Nebula Graph v2.0.0-alpha!
(root@nebula) [(none)]> show hosts
+-----------------+-------+----------+--------------+----------------------+------------------------+
| Host | Port | Status | Leader count | Leader distribution | Partition distribution |
+-----------------+-------+----------+--------------+----------------------+------------------------+
| "192.168.4.172" | 44500 | "ONLINE" | 0 | "No valid partition" | "stock:15" |
+-----------------+-------+----------+--------------+----------------------+------------------------+
| "192.168.4.173" | 44500 | "ONLINE" | 15 | "stock:15" | "stock:15" |
+-----------------+-------+----------+--------------+----------------------+------------------------+
| "192.168.4.174" | 44500 | "ONLINE" | 0 | "No valid partition" | "stock:15" |
+-----------------+-------+----------+--------------+----------------------+------------------------+
| "Total" | | | 15 | "stock:15" | "stock:45" |
+-----------------+-------+----------+--------------+----------------------+------------------------+
Got 4 rows (time spent 2310/3586 us)
Tue, 05 Jan 2021 18:21:18 CST
(root@nebula) [(none)]> balance leader
Execution succeeded (time spent 35181527/35181034 us)
Tue, 05 Jan 2021 18:21:58 CST
(root@nebula) [(none)]> show hosts
+-----------------+-------+----------+--------------+----------------------+------------------------+
| Host | Port | Status | Leader count | Leader distribution | Partition distribution |
+-----------------+-------+----------+--------------+----------------------+------------------------+
| "192.168.4.172" | 44500 | "ONLINE" | 7 | "stock:7" | "stock:15" |
+-----------------+-------+----------+--------------+----------------------+------------------------+
| "192.168.4.173" | 44500 | "ONLINE" | 8 | "stock:8" | "stock:15" |
+-----------------+-------+----------+--------------+----------------------+------------------------+
| "192.168.4.174" | 44500 | "ONLINE" | 0 | "No valid partition" | "stock:15" |
+-----------------+-------+----------+--------------+----------------------+------------------------+
| "Total" | | | 15 | "stock:15" | "stock:45" |
+-----------------+-------+----------+--------------+----------------------+------------------------+
Got 4 rows (time spent 1543/2545 us)
Tue, 05 Jan 2021 18:22:03 CST
反复删除logs和datas中的文件也无法解决。
日志中仍然报错:无法找到路径"/data/storage/nebula"
,yml文件中映射的路径为"/home/gdelt/nebula/data/storaged2:/data/storage"
, 其中"/home/gdelt/nebula/data/storaged2/nebula/"
真实存在,也可以访问到,不知道为什么会出这个问题。