求助:storaged服务启动不起来,最大文件打开数以设置成130000

总共三台机器,其中一台机器的storaged服务起来后,过一会就挂掉了,报错日志如下:

Log file created at: 2024/02/28 10:52:07
Running on machine: BC-GRAGH-3
Running duration (h:mm:ss): 0:00:00
Log line format: [IWEF]yyyymmdd hh:mm:ss.uuuuuu threadid file:line] msg
E20240228 10:52:07.263463 1111240 Serializer.h:43] Thrift serialization is only defined for structs and unions, not containers thereof. Attemping to deserialize a value of type `nebula::HostAddr`.
F20240228 10:52:15.398181 1111243 FileBasedWal.cpp:305] Failed to open file "/gragh/2/data/nebula/data/storage/nebula/98/wal/145/0000000000021846636.wal" (errno: 24): Too many open files
F20240228 10:52:15.401285 1111240 FileBasedWal.cpp:315] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/7/0000000000021849144.wal" (errno: 24): Too many open files
F20240228 10:52:15.401285 1111240 FileBasedWal.cpp:315] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/7/0000000000021849144.wal" (errno: 24): Too many open filesF20240228 10:52:15.422139 1111248 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21829889 vs. -1) F20240228 10:52:15.422957 1111239 FileBasedWal.cpp:305] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/278/0000000000021849688.wal" (errno: 24): Too many open files
F20240228 10:52:15.401285 1111240 FileBasedWal.cpp:315] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/7/0000000000021849144.wal" (errno: 24): Too many open filesF20240228 10:52:15.422139 1111248 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21829889 vs. -1) F20240228 10:52:15.422957 1111239 FileBasedWal.cpp:305] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/278/0000000000021849688.wal" (errno: 24): Too many open files
F20240228 10:52:15.401285 1111240 FileBasedWal.cpp:315] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/7/0000000000021849144.wal" (errno: 24): Too many open filesF20240228 10:52:15.422139 1111248 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21829889 vs. -1) F20240228 10:52:15.422957 1111239 FileBasedWal.cpp:305] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/278/0000000000021849688.wal" (errno: 24): Too many open filesF20240228 10:52:15.423364 1111252 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21810427 vs. -1) 
F20240228 10:52:15.401285 1111240 FileBasedWal.cpp:315] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/7/0000000000021849144.wal" (errno: 24): Too many open filesF20240228 10:52:15.422139 1111248 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21829889 vs. -1) F20240228 10:52:15.422957 1111239 FileBasedWal.cpp:305] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/278/0000000000021849688.wal" (errno: 24): Too many open filesF20240228 10:52:15.423364 1111252 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21810427 vs. -1) F20240228 10:52:15.589017 1111235 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21876053 vs. -1) 
F20240228 10:52:15.401285 1111240 FileBasedWal.cpp:315] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/7/0000000000021849144.wal" (errno: 24): Too many open filesF20240228 10:52:15.422139 1111248 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21829889 vs. -1) F20240228 10:52:15.422957 1111239 FileBasedWal.cpp:305] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/278/0000000000021849688.wal" (errno: 24): Too many open filesF20240228 10:52:15.423364 1111252 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21810427 vs. -1) F20240228 10:52:15.589017 1111235 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21876053 vs. -1) F20240228 10:52:15.688699 1111244 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21805629 vs. -1) 
F20240228 10:52:15.401285 1111240 FileBasedWal.cpp:315] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/7/0000000000021849144.wal" (errno: 24): Too many open filesF20240228 10:52:15.422139 1111248 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21829889 vs. -1) F20240228 10:52:15.422957 1111239 FileBasedWal.cpp:305] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/278/0000000000021849688.wal" (errno: 24): Too many open filesF20240228 10:52:15.423364 1111252 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21810427 vs. -1) F20240228 10:52:15.589017 1111235 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21876053 vs. -1) F20240228 10:52:15.688699 1111244 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21805629 vs. -1) F20240228 10:52:15.693325 1111245 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21920391 vs. -1) 
F20240228 10:52:15.401285 1111240 FileBasedWal.cpp:315] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/7/0000000000021849144.wal" (errno: 24): Too many open filesF20240228 10:52:15.422139 1111248 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21829889 vs. -1) F20240228 10:52:15.422957 1111239 FileBasedWal.cpp:305] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/278/0000000000021849688.wal" (errno: 24): Too many open filesF20240228 10:52:15.423364 1111252 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21810427 vs. -1) F20240228 10:52:15.589017 1111235 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21876053 vs. -1) F20240228 10:52:15.688699 1111244 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21805629 vs. -1) F20240228 10:52:15.693325 1111245 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21920391 vs. -1) F20240228 10:52:15.706007 1111258 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21884159 vs. -1) 
F20240228 10:52:15.401285 1111240 FileBasedWal.cpp:315] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/7/0000000000021849144.wal" (errno: 24): Too many open filesF20240228 10:52:15.422139 1111248 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21829889 vs. -1) F20240228 10:52:15.422957 1111239 FileBasedWal.cpp:305] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/278/0000000000021849688.wal" (errno: 24): Too many open filesF20240228 10:52:15.423364 1111252 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21810427 vs. -1) F20240228 10:52:15.589017 1111235 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21876053 vs. -1) F20240228 10:52:15.688699 1111244 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21805629 vs. -1) F20240228 10:52:15.693325 1111245 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21920391 vs. -1) F20240228 10:52:15.706007 1111258 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21884159 vs. -1) F20240228 10:52:15.731906 1111259 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21863479 vs. -1) 
F20240228 10:52:15.401285 1111240 FileBasedWal.cpp:315] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/7/0000000000021849144.wal" (errno: 24): Too many open filesF20240228 10:52:15.422139 1111248 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21829889 vs. -1) F20240228 10:52:15.422957 1111239 FileBasedWal.cpp:305] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/278/0000000000021849688.wal" (errno: 24): Too many open filesF20240228 10:52:15.423364 1111252 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21810427 vs. -1) F20240228 10:52:15.589017 1111235 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21876053 vs. -1) F20240228 10:52:15.688699 1111244 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21805629 vs. -1) F20240228 10:52:15.693325 1111245 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21920391 vs. -1) F20240228 10:52:15.706007 1111258 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21884159 vs. -1) F20240228 10:52:15.731906 1111259 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21863479 vs. -1) F20240228 10:52:15.783999 1111242 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21875225 vs. -1) 
F20240228 10:52:15.401285 1111240 FileBasedWal.cpp:315] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/7/0000000000021849144.wal" (errno: 24): Too many open filesF20240228 10:52:15.422139 1111248 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21829889 vs. -1) F20240228 10:52:15.422957 1111239 FileBasedWal.cpp:305] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/278/0000000000021849688.wal" (errno: 24): Too many open filesF20240228 10:52:15.423364 1111252 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21810427 vs. -1) F20240228 10:52:15.589017 1111235 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21876053 vs. -1) F20240228 10:52:15.688699 1111244 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21805629 vs. -1) F20240228 10:52:15.693325 1111245 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21920391 vs. -1) F20240228 10:52:15.706007 1111258 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21884159 vs. -1) F20240228 10:52:15.731906 1111259 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21863479 vs. -1) F20240228 10:52:15.783999 1111242 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21875225 vs. -1) F20240228 10:52:15.802258 1111249 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21837787 vs. -1) 
F20240228 10:52:15.401285 1111240 FileBasedWal.cpp:315] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/7/0000000000021849144.wal" (errno: 24): Too many open filesF20240228 10:52:15.422139 1111248 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21829889 vs. -1) F20240228 10:52:15.422957 1111239 FileBasedWal.cpp:305] Failed to open file "/gragh/3/data/nebula/data/storage/nebula/98/wal/278/0000000000021849688.wal" (errno: 24): Too many open filesF20240228 10:52:15.423364 1111252 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21810427 vs. -1) F20240228 10:52:15.589017 1111235 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21876053 vs. -1) F20240228 10:52:15.688699 1111244 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21805629 vs. -1) F20240228 10:52:15.693325 1111245 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21920391 vs. -1) F20240228 10:52:15.706007 1111258 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21884159 vs. -1) F20240228 10:52:15.731906 1111259 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21863479 vs. -1) F20240228 10:52:15.783999 1111242 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21875225 vs. -1) F20240228 10:52:15.802258 1111249 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21837787 vs. -1) F20240228 10:52:15.960722 1111253 RaftPart.cpp:1801] Check failed: lastLogIdCanCommit == lastCommitId (21872855 vs. -1) 
E20240228 10:52:16.459904 1112087 AsyncServerSocket.cpp:1027] accept failed: out of file descriptors; entering accept back-off state
E20240228 10:52:16.460264 1112084 Acceptor.cpp:455] error accepting on acceptor socket: accept() failed
E20240228 10:52:17.461146 1112087 AsyncServerSocket.cpp:1027] accept failed: out of file descriptors; entering accept back-off state
E20240228 10:52:17.461344 1112085 Acceptor.cpp:455] error accepting on acceptor socket: accept() failed
E20240228 10:52:19.227958 1112087 AsyncServerSocket.cpp:1027] accept failed: out of file descriptors; entering accept back-off state
E20240228 10:52:19.230490 1112086 Acceptor.cpp:455] error accepting on acceptor socket: accept() failed

试试这个,中不中。

我直接调整了linux的配置文件了,一开始配置的1200000,太大了,重启服务器没生效,改成1000000,可以了

1 个赞

优秀的,你可以勾选自己的回复为解决方案哦 :face_holding_back_tears:

此话题已在最后回复的 7 天后被自动关闭。不再允许新回复。