selected20_songid_eval.md
3.14 KB
Selected 20 Songs 实战检索评测
完整入库/查询主链操作手册见 song-ingest-query-delivery.md;本页只负责
selected20文件级实战评测摘要。
- 数据目录:
/root/hikoon_song_files/output/selected_20_songs/downloads - reference:
type_11 - queries:
type_1, type_7, type_12, type_16 - 当前方案:
chromaprint_matcher + mert-v1-95m - 语义截断时长:
8.0s - reference 文件数:
24 - query 文件数:
123
1. 总体结果
| lane | count | top1 | top3 |
|---|---|---|---|
| exact | 123 | 0.6016 | 0.8130 |
| semantic | 123 | 0.4715 | 0.6016 |
| fused | 123 | 0.6341 | 0.8537 |
2. 分 query type 结果
| query_type | lane | count | top1 | top3 |
|---|---|---|---|---|
| type_1 | exact | 21 | 1.0000 | 1.0000 |
| type_1 | semantic | 21 | 1.0000 | 1.0000 |
| type_1 | fused | 21 | 1.0000 | 1.0000 |
| type_7 | exact | 41 | 0.4146 | 0.7073 |
| type_7 | semantic | 41 | 0.1707 | 0.3902 |
| type_7 | fused | 41 | 0.4390 | 0.7561 |
| type_12 | exact | 23 | 0.8261 | 0.9130 |
| type_12 | semantic | 23 | 1.0000 | 1.0000 |
| type_12 | fused | 23 | 0.9130 | 1.0000 |
| type_16 | exact | 38 | 0.4474 | 0.7632 |
| type_16 | semantic | 38 | 0.1842 | 0.3684 |
| type_16 | fused | 38 | 0.4737 | 0.7895 |
3. 失败样例(fused rank != 1)
-
type_7/ true=572816/ fused_rank=2/ file=/root/hikoon_song_files/output/selected_20_songs/downloads/572816/type_7/三军令(副歌版).mp3/ top1=614397 -
type_7/ true=604814/ fused_rank=2/ file=/root/hikoon_song_files/output/selected_20_songs/downloads/604814/type_7/偏差(剪辑版2)-吉鹏泽.wav/ top1=614397 -
type_7/ true=604814/ fused_rank=2/ file=/root/hikoon_song_files/output/selected_20_songs/downloads/604814/type_7/偏差(剪辑版3)-吉鹏泽.wav/ top1=614397 -
type_7/ true=643015/ fused_rank=2/ file=/root/hikoon_song_files/output/selected_20_songs/downloads/643015/type_7/置念 抖音推广音频.wav/ top1=637559 -
type_7/ true=656394/ fused_rank=2/ file=/root/hikoon_song_files/output/selected_20_songs/downloads/656394/type_7/把你宠坏-推广片段.wav/ top1=614740 -
type_7/ true=657848/ fused_rank=2/ file=/root/hikoon_song_files/output/selected_20_songs/downloads/657848/type_7/小神仙 主歌剪-1.mp3/ top1=614397 -
type_7/ true=659300/ fused_rank=2/ file=/root/hikoon_song_files/output/selected_20_songs/downloads/659300/type_7/推广片段2.WAV/ top1=614397 -
type_7/ true=675118/ fused_rank=2/ file=/root/hikoon_song_files/output/selected_20_songs/downloads/675118/type_7/敲冰求火片段1.1x.wav/ top1=614397 -
type_7/ true=675118/ fused_rank=2/ file=/root/hikoon_song_files/output/selected_20_songs/downloads/675118/type_7/敲冰求火片段_2.wav/ top1=614397 -
type_7/ true=675406/ fused_rank=2/ file=/root/hikoon_song_files/output/selected_20_songs/downloads/675406/type_7/2.mp3/ top1=614397
4. 结论
-
exact代表当前指纹链路单独表现。 -
semantic代表当前 MERT 单独表现。 -
fused代表当前版权保护场景里更接近实战的合并结果。