INGEST导入SST报错

问答 问题
,
1

INGEST导入sst文件报错 Failed to get SST unique id for file

image
image2094×462 177 KB

2 
2024/02/06-10:23:15.209177 140325997762304 [db/db_impl/db_impl.cc:1069] ------- DUMPING STATS -------
2024/02/06-10:23:15.209265 140325997762304 [db/db_impl/db_impl.cc:1071] 
** DB Stats **
Uptime(secs): 69015.1 total, 600.0 interval
Cumulative writes: 404K writes, 404K keys, 403K commit groups, 1.0 writes per commit group, ingest: 0.01 GB, 0.00 MB/s
Cumulative WAL: 404K writes, 0 syncs, 404028.00 writes per sync, written: 0.01 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 3509 writes, 3509 keys, 3449 commit groups, 1.0 writes per commit group, ingest: 0.13 MB, 0.00 MB/s
Interval WAL: 3509 writes, 0 syncs, 3509.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent

** Compaction Stats [default] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  L0   7500/0   318.20 GB 1875.0      0.0     0.0      0.0     318.2    318.2       0.0   1.0      0.0      1.3 257142.93              0.00      7500   34.286       0      0       0.0       0.0
 Sum   7500/0   318.20 GB   0.0      0.0     0.0      0.0     318.2    318.2       0.0   1.0      0.0      1.3 257142.93              0.00      7500   34.286       0      0       0.0       0.0
 Int      0/0    0.00 KB   0.0      0.0     0.0      0.0      47.2     47.2       0.0   1.0      0.0      1.2  41861.56              0.00      1125   37.210       0      0       0.0       0.0

** Compaction Stats [default] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
User      0/0    0.00 KB   0.0      0.0     0.0      0.0     318.2    318.2       0.0   0.0      0.0      1.3 257142.93              0.00      7500   34.286       0      0       0.0       0.0

Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0

Uptime(secs): 69015.1 total, 600.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 318.196, interval 47.160
AddFile(Total Files): cumulative 7500, interval 1125
AddFile(L0 Files): cumulative 7500, interval 1125
AddFile(Keys): cumulative 3061805651, interval 453035583
Cumulative compaction: 318.20 GB write, 4.72 MB/s write, 0.00 GB read, 0.00 MB/s read, 257142.9 seconds
Interval compaction: 47.16 GB write, 80.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 41861.6 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7fa057e1e1f0#1466634 capacity: 100.00 GB collections: 380 last_copies: 0 last_secs: 0.02783 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(80,1.38 MB,0.00134301%) FilterBlock(2930,11.32 MB,0.011054%) FilterMetaBlock(86,69.53 KB,6.63102e-05%) IndexBlock(10631,109.15 GB,109.149%) Misc(1,0.00 KB,0%)

这是导完的其中一个storage的LOG统计

3

另外想问下 Block cache entry stats 的 IndexBlock 是指 bloom index 在内存占的大小吗

4

你的文件可能有些问题。

5

此话题已在最后回复的 30 天后被自动关闭。不再允许新回复。