提问参考模版:
- nebula 版本:3.8.0
- 部署方式:分布式
- 安装方式:源码编译
- 是否上生产环境:N
- 硬件信息
- 磁盘SSD
- CPU:4U32G * 3node
- 问题的具体描述
Tag存在但报Storage Error: Tag not found. 执行记录如下,执行多次同一个match语句,有的正常,有的报tag not found.
(root@nebula) [test]> MATCH (source:test_tag) WHERE source.test_tag.`ID` IN ['03zu7'] RETURN source AS `src`
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| src
|
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| ("test_tag_03zu7" :test_tag{CreateTime: __NULL__, Creator: ""}) |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
Got 1 rows (time spent 317.182ms/368.8913ms)
Tue, 03 Feb 2026 16:11:18 CST
(root@nebula) [test]> MATCH (source:test_tag) WHERE source.test_tag.`ID` IN ['03zu7'] RETURN source AS `src`
[ERROR (-1005)]: Storage Error: Tag not found.
Tue, 03 Feb 2026 16:12:06 CST
(root@nebula) [test]> MATCH (source:test_tag) WHERE source.test_tag.`ID` IN ['03zu7'] RETURN source AS `src`
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| src |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| ("test_tag_03zu7" :test_tag{CreateTime: __NULL__, Creator: ""}) |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
Got 1 rows (time spent 569.785ms/622.6662ms)
Tue, 03 Feb 2026 16:12:10 CST
(root@nebula) [test]> MATCH (source:test_tag) WHERE source.test_tag.`ID` IN ['03zu7'] RETURN source AS `src`
[ERROR (-1005)]: Storage Error: Tag not found.
Tue, 03 Feb 2026 16:12:11 CST
(root@nebula) [test]> MATCH (source:test_tag) WHERE source.test_tag.`ID` IN ['03zu7'] RETURN source AS `src`
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| src |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| ("test_tag_03zu7" :test_tag{CreateTime: __NULL__, Creator: ""}) |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
Got 1 rows (time spent 143.476ms/188.1436ms)
Tue, 03 Feb 2026 16:12:15 CST
(root@nebula) [test]> MATCH (source:test_tag) WHERE source.test_tag.`ID` IN ['03zu7'] RETURN source AS `src`
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| src |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| ("test_tag_03zu7" :test_tag{CreateTime: __NULL__, Creator: ""}) |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
Got 1 rows (time spent 1.074277s/1.117341s)
Tue, 03 Feb 2026 16:12:17 CST
(root@nebula) [test]> MATCH (source:test_tag) WHERE source.test_tag.`ID` IN ['03zu7'] RETURN source AS `src`
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| src |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| ("test_tag_03zu7" :test_tag{CreateTime: __NULL__, Creator: ""}) |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
Got 1 rows (time spent 327.628ms/369.9306ms)
Tue, 03 Feb 2026 16:12:18 CST
(root@nebula) [test]> MATCH (source:test_tag) WHERE source.test_tag.`ID` IN ['03zu7'] RETURN source AS `src`
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| src |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| ("test_tag_03zu7" :test_tag{CreateTime: __NULL__, Creator: ""}) |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
Got 1 rows (time spent 437.077ms/485.6049ms)
Tue, 03 Feb 2026 16:12:20 CST
(root@nebula) [test]> MATCH (source:test_tag) WHERE source.test_tag.`ID` IN ['03zu7'] RETURN source AS `src`
[ERROR (-1005)]: Storage Error: Tag not found.
Tue, 03 Feb 2026 16:12:21 CST
观察storage进程跑满CPU,怀疑是这个原因导致的。主要是reader-pool-pri这个线程占用高,且一直降不下去。
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
461 tester1 20 0 9180032 4.0g 34812 R 21.1 12.9 177:59.92 reader-pool-pri
457 tester1 20 0 9180032 4.0g 34812 R 20.1 12.9 177:59.45 reader-pool-pri
455 tester1 20 0 9180032 4.0g 34812 R 19.1 12.9 177:58.06 reader-pool-pri
474 tester1 20 0 9180032 4.0g 34812 R 18.4 12.9 178:19.83 reader-pool-pri
481 tester1 20 0 9180032 4.0g 34812 R 18.4 12.9 178:33.00 reader-pool-pri
463 tester1 20 0 9180032 4.0g 34812 R 12.8 12.9 178:07.71 reader-pool-pri
469 tester1 20 0 9180032 4.0g 34812 R 12.8 12.9 178:55.01 reader-pool-pri
462 tester1 20 0 9180032 4.0g 34812 R 12.5 12.9 178:41.17 reader-pool-pri
467 tester1 20 0 9180032 4.0g 34812 R 12.5 12.9 177:48.26 reader-pool-pri
475 tester1 20 0 9180032 4.0g 34812 R 12.5 12.9 178:49.47 reader-pool-pri
453 tester1 20 0 9180032 4.0g 34812 R 12.2 12.9 178:12.86 reader-pool-pri
468 tester1 20 0 9180032 4.0g 34812 R 12.2 12.9 178:51.53 reader-pool-pri
472 tester1 20 0 9180032 4.0g 34812 R 11.5 12.9 178:05.11 reader-pool-pri
470 tester1 20 0 9180032 4.0g 34812 R 11.2 12.9 178:24.49 reader-pool-pri
476 tester1 20 0 9180032 4.0g 34812 R 10.9 12.9 178:06.49 reader-pool-pri
452 tester1 20 0 9180032 4.0g 34812 R 10.5 12.9 178:12.92 reader-pool-pri
460 tester1 20 0 9180032 4.0g 34812 R 10.5 12.9 178:13.60 reader-pool-pri
471 tester1 20 0 9180032 4.0g 34812 R 10.5 12.9 178:16.19 reader-pool-pri
478 tester1 20 0 9180032 4.0g 34812 R 10.5 12.9 178:35.62 reader-pool-pri
454 tester1 20 0 9180032 4.0g 34812 R 9.2 12.9 177:37.13 reader-pool-pri
465 tester1 20 0 9180032 4.0g 34812 R 9.2 12.9 179:12.18 reader-pool-pri
483 tester1 20 0 9180032 4.0g 34812 R 9.2 12.9 178:31.96 reader-pool-pri
456 tester1 20 0 9180032 4.0g 34812 R 8.9 12.9 178:09.81 reader-pool-pri
473 tester1 20 0 9180032 4.0g 34812 R 8.9 12.9 178:33.39 reader-pool-pri
477 tester1 20 0 9180032 4.0g 34812 R 8.9 12.9 178:18.53 reader-pool-pri
459 tester1 20 0 9180032 4.0g 34812 R 8.6 12.9 178:02.83 reader-pool-pri
479 tester1 20 0 9180032 4.0g 34812 R 8.6 12.9 178:37.71 reader-pool-pri
464 tester1 20 0 9180032 4.0g 34812 R 8.2 12.9 177:36.79 reader-pool-pri
482 tester1 20 0 9180032 4.0g 34812 R 8.2 12.9 177:47.58 reader-pool-pri
458 tester1 20 0 9180032 4.0g 34812 R 7.9 12.9 178:51.41 reader-pool-pri
480 tester1 20 0 9180032 4.0g 34812 R 7.9 12.9 178:10.38 reader-pool-pri
466 tester1 20 0 9180032 4.0g 34812 R 7.6 12.9 177:58.90 reader-pool-pri
这种情况经常会偶现,出现这种情况时CPU都是跑满的,一般重启后会解决。