提问参考模版:
- nebula 版本:3.4.1
- 部署方式:分布式
- 安装方式: RPM
- 是否上生产环境:Y
- 问题的具体描述
- 相关的 meta / storage / graph info 日志信息(尽量使用文本形式方便检索)
采用社区版的 br 和 agent 做数据备份,目前 agent 已经启动,并且注册在服务上。
但是执行本地备份的时候,报错,具体日志如下。
[work@bdbl-inf-bce436-768ec.bdbl.baidu.com nebula-all]$ ./br backup full --meta "10.122.107.172:8559" --storage "local:///home/work/bakcup"
{"level":"info","meta address":"10.122.107.172:8559","msg":"Try to connect meta service.","time":"2023-03-20T11:44:31.096Z"}
{"level":"info","meta address":"10.122.107.172:8559","msg":"Connect meta server successfully.","time":"2023-03-20T11:44:31.096Z"}
{"level":"info","meta address":"10.161.85.24:8559","msg":"Try to connect meta service.","time":"2023-03-20T11:44:31.096Z"}
{"level":"info","meta address":"10.161.85.24:8559","msg":"Connect meta server successfully.","time":"2023-03-20T11:44:31.097Z"}
{"level":"info","meta address":"10.122.108.171:8559","msg":"Try to connect meta service.","time":"2023-03-20T11:44:31.097Z"}
{"level":"info","meta address":"10.122.108.171:8559","msg":"Connect meta server successfully.","time":"2023-03-20T11:44:31.100Z"}
{"level":"info","meta address":"10.161.85.24:8559","msg":"Try to connect meta service.","time":"2023-03-20T11:44:31.100Z"}
{"level":"info","meta address":"10.161.85.24:8559","msg":"Connect meta server successfully.","time":"2023-03-20T11:44:31.100Z"}
{"level":"info","meta address":"10.122.107.172:8559","msg":"Try to connect meta service.","time":"2023-03-20T11:44:31.101Z"}
{"level":"info","meta address":"10.122.107.172:8559","msg":"Connect meta server successfully.","time":"2023-03-20T11:44:31.101Z"}
{"host info":"map[10.122.107.172:10.122.107.172:8779[STORAGE]: (data: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/storage, root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) | 10.122.107.172:8346[AGENT]: (data: , root: ) | 10.122.107.172:8669[GRAPH]: (data: , root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) | 10.122.107.172:8559[META]: (data: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta, root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) 10.122.108.171:10.122.108.171:8779[STORAGE]: (data: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/storage, root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) | 10.122.108.171:8346[AGENT]: (data: , root: ) | 10.122.108.171:8669[GRAPH]: (data: , root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) | 10.122.108.171:8559[META]: (data: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta, root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) 10.161.85.24:10.161.85.24:8779[STORAGE]: (data: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/storage, root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) | 10.161.85.24:8346[AGENT]: (data: , root: ) | 10.161.85.24:8669[GRAPH]: (data: , root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) | 10.161.85.24:8559[META]: (data: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta, root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64)]","level":"info","msg":"Get cluster topology from the nebula.","time":"2023-03-20T11:44:31.101Z"}
Start to backup cluster...
{"backup info":"map[all spaces:true backup name:BACKUP_2023_03_20_11_44_31 backups:demo_shareholding: space-id 4, hosts: 3;test: space-id 74, hosts: 3;test_space: space-id 188, hosts: 3;demo_basketballplayer: space-id 1, hosts: 3 created time:2023-03-20 11:47:37 +0800 CST full backup:true meta files:/home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta/nebula/0/checkpoints/BACKUP_2023_03_20_11_44_31/__disk_parts__.sst,/home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta/nebula/0/checkpoints/BACKUP_2023_03_20_11_44_31/__local_id__.sst,/home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta/nebula/0/checkpoints/BACKUP_2023_03_20_11_44_31/__stats__.sst,/home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta/nebula/0/checkpoints/BACKUP_2023_03_20_11_44_31/__indexes__.sst,/home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta/nebula/0/checkpoints/BACKUP_2023_03_20_11_44_31/__edges__.sst,/home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta/nebula/0/checkpoints/BACKUP_2023_03_20_11_44_31/__tags__.sst,/home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta/nebula/0/checkpoints/BACKUP_2023_03_20_11_44_31/__parts__.sst,/home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta/nebula/0/checkpoints/BACKUP_2023_03_20_11_44_31/__spaces__.sst,/home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta/nebula/0/checkpoints/BACKUP_2023_03_20_11_44_31/__sessions__.sst,/home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta/nebula/0/checkpoints/BACKUP_2023_03_20_11_44_31/__machines__.sst,/home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta/nebula/0/checkpoints/BACKUP_2023_03_20_11_44_31/__zones__.sst,/home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta/nebula/0/checkpoints/BACKUP_2023_03_20_11_44_31/__users__.sst,/home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta/nebula/0/checkpoints/BACKUP_2023_03_20_11_44_31/__last_update_time__.sst,/home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta/nebula/0/checkpoints/BACKUP_2023_03_20_11_44_31/__id__.sst,/home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta/nebula/0/checkpoints/BACKUP_2023_03_20_11_44_31/__index__.sst]","level":"info","msg":"Create backup in nebula machine's local.","name":"BACKUP_2023_03_20_11_44_31","time":"2023-03-20T11:44:31.171Z"}
Backup failed, will try to clean the remaining garbage...
{"level":"info","meta address":"10.122.107.172:8559","msg":"Try to connect meta service.","time":"2023-03-20T11:44:31.172Z"}
{"level":"info","meta address":"10.122.107.172:8559","msg":"Connect meta server successfully.","time":"2023-03-20T11:44:31.172Z"}
{"level":"info","meta address":"10.161.85.24:8559","msg":"Try to connect meta service.","time":"2023-03-20T11:44:31.172Z"}
{"level":"info","meta address":"10.161.85.24:8559","msg":"Connect meta server successfully.","time":"2023-03-20T11:44:31.172Z"}
{"level":"info","meta address":"10.122.108.171:8559","msg":"Try to connect meta service.","time":"2023-03-20T11:44:31.173Z"}
{"level":"info","meta address":"10.122.108.171:8559","msg":"Connect meta server successfully.","time":"2023-03-20T11:44:31.173Z"}
{"level":"info","meta address":"10.161.85.24:8559","msg":"Try to connect meta service.","time":"2023-03-20T11:44:31.173Z"}
{"level":"info","meta address":"10.161.85.24:8559","msg":"Connect meta server successfully.","time":"2023-03-20T11:44:31.174Z"}
{"level":"info","meta address":"10.122.107.172:8559","msg":"Try to connect meta service.","time":"2023-03-20T11:44:31.175Z"}
{"level":"info","meta address":"10.122.107.172:8559","msg":"Connect meta server successfully.","time":"2023-03-20T11:44:31.175Z"}
{"host info":"map[10.122.107.172:10.122.107.172:8779[STORAGE]: (data: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/storage, root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) | 10.122.107.172:8346[AGENT]: (data: , root: ) | 10.122.107.172:8669[GRAPH]: (data: , root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) | 10.122.107.172:8559[META]: (data: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta, root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) 10.122.108.171:10.122.108.171:8779[STORAGE]: (data: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/storage, root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) | 10.122.108.171:8346[AGENT]: (data: , root: ) | 10.122.108.171:8669[GRAPH]: (data: , root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) | 10.122.108.171:8559[META]: (data: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta, root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) 10.161.85.24:10.161.85.24:8779[STORAGE]: (data: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/storage, root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) | 10.161.85.24:8346[AGENT]: (data: , root: ) | 10.161.85.24:8669[GRAPH]: (data: , root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64) | 10.161.85.24:8559[META]: (data: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64/data/meta, root: /home/work/nebula-all/nebula-graph-3.4.1.el7.x86_64)]","level":"info","msg":"Get cluster topology from the nebula.","time":"2023-03-20T11:44:31.175Z"}
{"backup name":"BACKUP_2023_03_20_11_44_31","level":"info","msg":"Start to cleanup data in nebula cluster.","time":"2023-03-20T11:44:31.175Z"}
{"backup name":"BACKUP_2023_03_20_11_44_31","level":"info","msg":"Start cleanup data in external storage.","time":"2023-03-20T11:44:31.206Z"}
Error: cleanup BACKUP_2023_03_20_11_44_31 failed when backup failed: clean external storage data failed: remove local:///home/work/bakcup/BACKUP_2023_03_20_11_44_31 in external storage failed: local:///home/work/bakcup/BACKUP_2023_03_20_11_44_31 not found
Usage:
br backup full [flags]
Flags:
-h, --help help for full
Global Flags:
--debug Output log in debug level or not
--log string Specify br detail log path (default "br.log")
--meta string Specify meta server
--s3.access_key string S3 Option: set access key id
--s3.endpoint string S3 Option: set the S3 endpoint URL, please specify the http or https scheme explicitly
--s3.region string S3 Option: set region or location to upload or download backup
--s3.secret_key string S3 Option: set secret key for access id
--spaces stringArray (EXPERIMENTAL)space names.
By this option, user can specify which spaces to backup. Now this feature is still experimental.
If not specified, will backup all spaces.
--storage string backup target url, format: <SCHEME>://<PATH>.
<SCHEME>: a string indicating which backend type. optional: local, s3.
now only s3-compatible is supported.
example:
for local - "local:///the/local/path/to/backup"
for s3 - "s3://example/url/to/the/backup"
{"level":"fatal","msg":"cleanup BACKUP_2023_03_20_11_44_31 failed when backup failed: clean external storage data failed: remove local:///home/work/bakcup/BACKUP_2023_03_20_11_44_31 in external storage failed: local:///home/work/bakcup/BACKUP_2023_03_20_11_44_31 not found","time":"2023-03-20T11:44:31.207Z"}
辛苦相关同学看一下




