关于如何横向扩展磁盘

提问题·用户问答 使用问题
1
  • nebula 版本：3.4.0
  • 部署方式： 分布式
  • 安装方式： RPM
  • 是否上生产环境：N

目前在测试环境中进行Nebula运维相关的测试，进行到横向拓展的时候，测试拓展磁盘。
我自己试了下改了nebula-storaged.conf配置，追加了一个新磁盘路径之后，重启storaged 服务，新路径是有写入文件的。
但在帖子Nebula集群新增磁盘后 里面看到说这样操作会有以下问题：“只有新建的space才会用上所有盘，已经建的space只会用当时的data_path”
在群里问了得到回复：“需要把 storeaged 移除，然后重新加回来的时候增加 data_path，这得把数据 part 迁移走，再迁移回来”
我想问下有没有相关的文档介绍详细操作步骤。另外在横向扩容里面增加机器节点是不是也会有同样的问题呢。

2

“需要把 storeaged 移除，然后重新加回来的时候增加 data_path，这得把数据 part 迁移走，再迁移回来”

先 balance data remove，把数据迁走到别的 storage host，再 drop host 删掉待加硬盘的 host，定义新的 data_path，再 add host。

4

如果是每个节点都要加一块磁盘呢，需要这样反复一个节点一个节点操作吗，还是说有什么别的方法可以？

5

没有，这种事情用企业版的话，在 dashboard 里做比较方便，另外企业版的 data balance 的实现和社区版不同，企业版不是实验性的，是生产级别实现哈

6

企业版才支持balance data remove操作吧。

7

可以的，我刚才试了一下


(root@nebula) [(none)]> show hosts
+-------------+------+----------+--------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+---------+
| Host        | Port | Status   | Leader count | Leader distribution                                                                                                   | Partition distribution                                                                                                | Version |
+-------------+------+----------+--------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+---------+
| "storaged0" | 9779 | "ONLINE" | 12           | "basketballplayer:3, demo_basketballplayer:3, demo_data_lineage:1, demo_fifa_2022:1, demo_openstack:1, livejournal:3" | "basketballplayer:3, demo_basketballplayer:3, demo_data_lineage:1, demo_fifa_2022:1, demo_openstack:1, livejournal:3" | "3.5.0" |
| "storaged1" | 9779 | "ONLINE" | 12           | "basketballplayer:3, demo_basketballplayer:3, demo_data_lineage:1, demo_fifa_2022:1, demo_openstack:1, livejournal:3" | "basketballplayer:3, demo_basketballplayer:3, demo_data_lineage:1, demo_fifa_2022:1, demo_openstack:1, livejournal:3" | "3.5.0" |
| "storaged2" | 9779 | "ONLINE" | 14           | "basketballplayer:4, demo_basketballplayer:4, demo_data_lineage:1, demo_fifa_2022:1, demo_openstack:1, livejournal:3" | "basketballplayer:4, demo_basketballplayer:4, demo_data_lineage:1, demo_fifa_2022:1, demo_openstack:1, livejournal:3" | "3.5.0" |
| "storaged4" | 9779 | "ONLINE" | 0            | "No valid partition"                                                                                                  | "No valid partition"                                                                                                  | "3.5.0" |
+-------------+------+----------+--------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+---------+

(root@nebula) [demo_fifa_2022]> BALANCE DATA REMOVE "storaged2":9779
+------------+
| New Job Id |
+------------+
| 14         |
+------------+
(root@nebula) [demo_fifa_2022]> show jobs
+--------+----------------+------------+----------------------------+----------------------------+
| Job Id | Command        | Status     | Start Time                 | Stop Time                  |
+--------+----------------+------------+----------------------------+----------------------------+
| 14     | "DATA_BALANCE" | "RUNNING"  | 2023-05-30T09:55:34.000000 |                            |
| 13     | "DATA_BALANCE" | "STOPPED"  | 2023-05-30T09:54:34.000000 | 2023-05-30T09:55:22.000000 |
| 12     | "STATS"        | "FINISHED" | 2023-05-30T08:17:42.000000 | 2023-05-30T08:17:42.000000 |
| 11     | "STATS"        | "FINISHED" | 2023-05-30T08:16:23.000000 | 2023-05-30T08:16:23.000000 |
+--------+----------------+------------+----------------------------+----------------------------+
Got 4 rows (time spent 2.694ms/4.537792ms)

Tue, 30 May 2023 17:56:01 CST

(root@nebula) [demo_fifa_2022]> show jobs
+--------+----------------+------------+----------------------------+----------------------------+
| Job Id | Command        | Status     | Start Time                 | Stop Time                  |
+--------+----------------+------------+----------------------------+----------------------------+
| 14     | "DATA_BALANCE" | "FINISHED" | 2023-05-30T09:55:34.000000 | 2023-05-30T09:56:04.000000 |
| 13     | "DATA_BALANCE" | "STOPPED"  | 2023-05-30T09:54:34.000000 | 2023-05-30T09:55:22.000000 |
| 12     | "STATS"        | "FINISHED" | 2023-05-30T08:17:42.000000 | 2023-05-30T08:17:42.000000 |
| 11     | "STATS"        | "FINISHED" | 2023-05-30T08:16:23.000000 | 2023-05-30T08:16:23.000000 |
+--------+----------------+------------+----------------------------+----------------------------+
(root@nebula) [demo_fifa_2022]> show hosts
+-------------+------+----------+--------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+---------+
| Host        | Port | Status   | Leader count | Leader distribution                                                                                                   | Partition distribution                                                                                                | Version |
+-------------+------+----------+--------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+---------+
| "storaged0" | 9779 | "ONLINE" | 12           | "basketballplayer:3, demo_basketballplayer:3, demo_data_lineage:1, demo_fifa_2022:1, demo_openstack:1, livejournal:3" | "basketballplayer:3, demo_basketballplayer:3, demo_data_lineage:1, demo_fifa_2022:1, demo_openstack:1, livejournal:3" | "3.5.0" |
| "storaged1" | 9779 | "ONLINE" | 12           | "basketballplayer:3, demo_basketballplayer:3, demo_data_lineage:1, demo_fifa_2022:1, demo_openstack:1, livejournal:3" | "basketballplayer:3, demo_basketballplayer:3, demo_data_lineage:1, demo_fifa_2022:1, demo_openstack:1, livejournal:3" | "3.5.0" |
| "storaged2" | 9779 | "ONLINE" | 13           | "basketballplayer:4, demo_basketballplayer:4, demo_data_lineage:1, demo_openstack:1, livejournal:3"                   | "basketballplayer:4, demo_basketballplayer:4, demo_data_lineage:1, demo_openstack:1, livejournal:3"                   | "3.5.0" |
| "storaged4" | 9779 | "ONLINE" | 1            | "demo_fifa_2022:1"                                                                                                    | "demo_fifa_2022:1"                                                                                                    | "3.5.0" |
+-------------+------+----------+--------------+-----------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------+---------+
8

@Sophie 现在社区版的balance是啥情况？还是不太稳定的实验功能吗？

9

是的，未正式发布和维护。

10

@abby-cyber-fairy 写了文档介绍如何 scale-up scale-down storaged 硬盘 :rocket:

1 个赞