milvus-backup-0.2.2无法正常备份milvus，仅能备份meta

Question

求赐教

milvus-backup-0.2.2无法正常备份milvus，仅能备份meta
版本：milvus:v2.2.5

[root@iZbp1c72s0nbgk2huouosaZ milvus-backup-0.2.2]# ./milvus-backup create --colls product -n product_backup
config:backup.yaml
[2024/06/27 23:39:38.265 +08:00] [INFO] [logutil/logutil.go:165] ["Log directory"] [configDir=]
[2024/06/27 23:39:38.265 +08:00] [INFO] [logutil/logutil.go:166] ["Set log file to "] [path=logs/backup.log]
[2024/06/27 23:39:38.266 +08:00] [INFO] [core/backup_context.go:154] ["receive CreateBackupRequest"] [requestId=7664abe1-349b-11ef-8559-00163e1d6f67] [backupName=product_backup] [collections="[product]"] [async=false]
[2024/06/27 23:39:38.303 +08:00] [INFO] [storage/minio_chunk_manager.go:112] ["minio chunk manager init success."] [bucketname=a-bucket] [root=files]
[2024/06/27 23:39:38.320 +08:00] [INFO] [core/backup_context.go:321] ["collections to backup"] [collections="[{\"ID\":440461822551988970,\"Name\":\"product\",\"Schema\":{\"CollectionName\":\"product\",\"Description\":\"\",\"AutoID\":false,\"Fields\":[{\"ID\":100,\"Name\":\"id\",\"PrimaryKey\":true,\"AutoID\":true,\"Description\":\"product_id\",\"DataType\":5,\"TypeParams\":{},\"IndexParams\":{}},{\"ID\":101,\"Name\":\"name\",\"PrimaryKey\":false,\"AutoID\":false,\"Description\":\"product_name\",\"DataType\":101,\"TypeParams\":{\"dim\":\"128\"},\"IndexParams\":{}}]},\"PhysicalChannels\":[\"by-dev-rootcoord-dml_0\",\"by-dev-rootcoord-dml_1\"],\"VirtualChannels\":[\"by-dev-rootcoord-dml_0_440461822551988970v0\",\"by-dev-rootcoord-dml_1_440461822551988970v1\"],\"Loaded\":false,\"ConsistencyLevel\":1,\"ShardNum\":2}]"]
[2024/06/27 23:39:38.321 +08:00] [INFO] [core/backup_context.go:355] ["try to get index"] [collection_name=product]
[2024/06/27 23:39:38.325 +08:00] [INFO] [core/backup_context.go:375] ["field index"] [collection_name=product] [field_name=id] ["index info"="[{}]"]
[2024/06/27 23:39:38.329 +08:00] [INFO] [core/backup_context.go:375] ["field index"] [collection_name=product] [field_name=name] ["index info"="[{}]"]
[2024/06/27 23:39:38.333 +08:00] [INFO] [core/backup_context.go:468] ["GetPersistentSegmentInfo before flush from milvus"] [collectionName=product] [segmentNumBeforeFlush=2]
[2024/06/27 23:39:38.336 +08:00] [INFO] [core/backup_context.go:477] ["flush segments"] [collectionName=product] [newSealedSegmentIDs="[]"] [flushedSegmentIDs="[440461822552193303,440461822552193304]"] [timeOfSeal=1719502778]
[2024/06/27 23:39:38.338 +08:00] [INFO] [core/backup_context.go:490] ["GetPersistentSegmentInfo after flush from milvus"] [collectionName=product] [segmentNumBeforeFlush=2] [segmentNumAfterFlush=2]
[2024/06/27 23:39:38.338 +08:00] [WARN] [core/backup_context.go:513] ["this may be old segments before flush, skip it"] [id=440461822552193303]
[2024/06/27 23:39:38.338 +08:00] [WARN] [core/backup_context.go:513] ["this may be old segments before flush, skip it"] [id=440461822552193304]
[2024/06/27 23:39:38.338 +08:00] [INFO] [core/backup_context.go:527] ["Finished fill segment"] [collectionName=product]
[2024/06/27 23:39:38.362 +08:00] [WARN] [core/backup_context.go:538] ["this segment has no insert binlog"] [id=440461822552193303]
[2024/06/27 23:39:38.386 +08:00] [WARN] [core/backup_context.go:538] ["this segment has no insert binlog"] [id=440461822552193304]
[2024/06/27 23:39:38.386 +08:00] [INFO] [core/backup_context.go:544] ["readSegmentInfo from storage"] [collectionName=product] [segmentNum=2]
[2024/06/27 23:39:38.386 +08:00] [INFO] [core/backup_context.go:576] ["finish build partition info"] [collectionName=product] [partitionNum=2]
[2024/06/27 23:39:38.386 +08:00] [INFO] [core/backup_context.go:580] ["Begin copy data"] [collectionName=product] [segmentNum=2]
[2024/06/27 23:39:38.386 +08:00] [INFO] [core/backup_context.go:610] ["partition size is smaller than MaxSegmentGroupSize, won't separate segments into groups in backup files"] [collectionId=440461822551988970] [partitionId=440461822551988971] [partitionSize=0] [MaxSegmentGroupSize=2147483648]
[2024/06/27 23:39:38.386 +08:00] [INFO] [core/backup_context.go:610] ["partition size is smaller than MaxSegmentGroupSize, won't separate segments into groups in backup files"] [collectionId=440461822551988970] [partitionId=440461822551992604] [partitionSize=0] [MaxSegmentGroupSize=2147483648]
[2024/06/27 23:39:38.476 +08:00] [INFO] [core/backup_context.go:779] ["finish executeCreateBackup"] [requestId=7664abe1-349b-11ef-8559-00163e1d6f67] [backupName=product_backup] [collections="[product]"] [async=false] ["backup meta"="{\"id\":\"766c46a2-349b-11ef-8559-00163e1d6f67\",\"state_code\":2,\"start_time\":1719502778317,\"end_time\":1719502778386,\"name\":\"product_backup\",\"backup_timestamp\":1719502778317,\"size\":0,\"milvus_version\":\"v2.2.5\"}"]
Success 
 success

保存到MinIO的结果如图：

无法看到备份的真实数据；

使用attu看到数据中的数据是这样的

Answer 1

引自免费微信小程序：皆我百晓生

从你给出的日志和描述来看，milvus-backup-0.2.2在备份milvus时只能备份meta数据，而无法备份实际的数据。这可能是由以下几个原因导致的：

1. 版本不兼容：你使用的milvus-backup-0.2.2版本可能与milvus:v2.2.5版本不兼容。请确保你使用的备份工具与milvus版本相匹配。
2. 配置问题：你的备份配置可能存在一些问题，导致备份过程无法正确进行。请检查你的备份配置，确保它符合milvus的备份要求。
3. 数据问题：可能有一些数据在milvus中无法正确备份。你可以尝试使用其他工具或方法来验证数据的完整性。

针对这些问题，你可以尝试以下解决方案：

1. 检查并更新你的备份工具版本，确保它与milvus版本兼容。
2. 重新检查你的备份配置，确保没有遗漏或错误的配置。
3. 使用其他工具或方法来验证数据的完整性，并尝试重新备份。

另外，从你的描述中看到，你提到了MinIO存储桶的结构和Attu工具的数据预览。你可以检查MinIO中的备份文件是否完整，并使用其他工具（如Python的milvus-client库）来读取和验证备份数据。这可以帮助你进一步确定问题所在。

如果你需要更具体的帮助，例如代码示例或更详细的指导，请提供更多信息或详细描述你的问题。我会尽力帮助你解决问题。