selected20_songid_eval_report_fresh.md 2.97 KB

Raw Blame History Permalink



Selected 20 Songs 实战检索评测


数据目录：/root/hikoon_song_files/output/selected_20_songs/downloads

reference：type_11

queries：type_1, type_7, type_12, type_16

当前方案：chromaprint_matcher + mert-v1-95m

语义截断时长：8.0s

reference 文件数：24

query 文件数：123


1. 总体结果


lane
count
top1
top3


exact
123
0.6016
0.8130


semantic
123
0.4715
0.6016


fused
123
0.6341
0.8537


2. 分 query type 结果


query_type
lane
count
top1
top3


type_1
exact
21
1.0000
1.0000


type_1
semantic
21
1.0000
1.0000


type_1
fused
21
1.0000
1.0000


type_7
exact
41
0.4146
0.7073


type_7
semantic
41
0.1707
0.3902


type_7
fused
41
0.4390
0.7561


type_12
exact
23
0.8261
0.9130


type_12
semantic
23
1.0000
1.0000


type_12
fused
23
0.9130
1.0000


type_16
exact
38
0.4474
0.7632


type_16
semantic
38
0.1842
0.3684


type_16
fused
38
0.4737
0.7895


3. 失败样例（fused rank != 1）


type_7 / true=572816 / fused_rank=2 / file=/root/hikoon_song_files/output/selected_20_songs/downloads/572816/type_7/三军令（副歌版）.mp3 / top1=614397


type_7 / true=604814 / fused_rank=2 / file=/root/hikoon_song_files/output/selected_20_songs/downloads/604814/type_7/偏差（剪辑版2）-吉鹏泽.wav / top1=614397


type_7 / true=604814 / fused_rank=2 / file=/root/hikoon_song_files/output/selected_20_songs/downloads/604814/type_7/偏差（剪辑版3）-吉鹏泽.wav / top1=614397


type_7 / true=643015 / fused_rank=2 / file=/root/hikoon_song_files/output/selected_20_songs/downloads/643015/type_7/置念 抖音推广音频.wav / top1=637559


type_7 / true=656394 / fused_rank=2 / file=/root/hikoon_song_files/output/selected_20_songs/downloads/656394/type_7/把你宠坏-推广片段.wav / top1=614740


type_7 / true=657848 / fused_rank=2 / file=/root/hikoon_song_files/output/selected_20_songs/downloads/657848/type_7/小神仙 主歌剪-1.mp3 / top1=614397


type_7 / true=659300 / fused_rank=2 / file=/root/hikoon_song_files/output/selected_20_songs/downloads/659300/type_7/推广片段2.WAV / top1=614397


type_7 / true=675118 / fused_rank=2 / file=/root/hikoon_song_files/output/selected_20_songs/downloads/675118/type_7/敲冰求火片段1.1x.wav / top1=614397


type_7 / true=675118 / fused_rank=2 / file=/root/hikoon_song_files/output/selected_20_songs/downloads/675118/type_7/敲冰求火片段_2.wav / top1=614397


type_7 / true=675406 / fused_rank=2 / file=/root/hikoon_song_files/output/selected_20_songs/downloads/675406/type_7/2.mp3 / top1=614397


4. 结论


exact 代表当前指纹链路单独表现。

semantic 代表当前 MERT 单独表现。

fused 代表当前版权保护场景里更接近实战的合并结果。