Skip to content

wanghai-tech / hikoon-ACR

Go to a project
Toggle navigation
Toggle navigation pinning
Commit a0ceb991 a0ceb99163204d4f7cf57634c2319a8aa613335d by cnb.bofCdSsphPA
Options

Extend the business-corpus voice correctness baseline to type8 and type16 

Constraint: we need a complete hard-query picture before claiming the workspace_music20 voice lane is usable or deciding where pgvector work should start
Rejected: extrapolating from type_7 alone | the type_8 and type_16 lanes can fail differently and need their own measured baselines
Confidence: high
Scope-risk: narrow
Directive: keep all future business-corpus voice evaluations split by query type so we can see exactly which hard lanes fail and why
Tested: /usr/local/miniconda3/bin/python -m unittest discover -s acr-engine/tests -v; generated voice_workspace20_type8_eval.json (top1=0.0, top3=0.0) and voice_workspace20_type16_eval.json (top1=0.0, top3=0.0)
Not-tested: improved business-corpus voice correctness after moving to embedding/pgvector retrieval
1 parent 5a01ab7f
Inline Side-by-side
Showing 5 changed files with 699 additions and 1 deletions
{
"summary": {
"num_queries": 12,
"top1": 0.0,
"top3": 0.0
},
"items": [
{
"song_id": "569681",
"query_type": 16,
"query_path": "/workspace/downloads/569681/type_16/失去的总是太珍贵（DJ版）_15秒.wav",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "115",
"confidence": 0.9811056852340698,
"reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
},
{
"song_id": "116",
"confidence": 0.9798094630241394,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
},
{
"song_id": "103",
"confidence": 0.9763965606689453,
"reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "569738",
"query_type": 16,
"query_path": "/workspace/downloads/569738/type_16/孤单被写成歌 (DJ阿卓版)-剪辑版.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "116",
"confidence": 0.959204912185669,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
},
{
"song_id": "114",
"confidence": 0.9554344415664673,
"reference_path": "/workspace/downloads/114/type_11/0238ecbf-b234-470e-82e4-f3b80a267d771650256906.wav"
},
{
"song_id": "105",
"confidence": 0.9521631002426147,
"reference_path": "/workspace/downloads/105/type_11/57e61cde-4410-4751-93e9-d7a4ecece5791650256910.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "569748",
"query_type": 16,
"query_path": "/workspace/downloads/569748/type_16/49a1d25ec19ace09e80b81187ebb0d0b.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "116",
"confidence": 0.9791994094848633,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
},
{
"song_id": "109",
"confidence": 0.9777094125747681,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
},
{
"song_id": "103",
"confidence": 0.9743528366088867,
"reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "569787",
"query_type": 16,
"query_path": "/workspace/downloads/569787/type_16/九块九爱情-副歌剪辑.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "116",
"confidence": 0.9737908244132996,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
},
{
"song_id": "103",
"confidence": 0.972736120223999,
"reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
},
{
"song_id": "101",
"confidence": 0.9667743444442749,
"reference_path": "/workspace/downloads/101/type_11/83c0c07f-4f96-4ff4-998c-58db910f3cfa1650256915.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "569855",
"query_type": 16,
"query_path": "/workspace/downloads/569855/type_16/2604aa1e31c47097c27ef92e7993aa5e.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "115",
"confidence": 0.9648096561431885,
"reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
},
{
"song_id": "119",
"confidence": 0.9647560715675354,
"reference_path": "/workspace/downloads/119/type_11/180dfa7d-836a-449c-990f-a3bf39c11da11650256898.wav"
},
{
"song_id": "109",
"confidence": 0.9611845016479492,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "570124",
"query_type": 16,
"query_path": "/workspace/downloads/570124/type_16/朋友的礼貌 推广音频_01.wav",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "119",
"confidence": 0.958089292049408,
"reference_path": "/workspace/downloads/119/type_11/180dfa7d-836a-449c-990f-a3bf39c11da11650256898.wav"
},
{
"song_id": "115",
"confidence": 0.9525090456008911,
"reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
},
{
"song_id": "118",
"confidence": 0.9480559229850769,
"reference_path": "/workspace/downloads/118/type_11/db64461e-d752-4cf3-ab1d-56ff9232823d1650256901.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "570345",
"query_type": 16,
"query_path": "/workspace/downloads/570345/type_16/痴情小丑-副歌剪辑.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "105",
"confidence": 0.9752437472343445,
"reference_path": "/workspace/downloads/105/type_11/57e61cde-4410-4751-93e9-d7a4ecece5791650256910.wav"
},
{
"song_id": "109",
"confidence": 0.9603044986724854,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
},
{
"song_id": "106",
"confidence": 0.9536592364311218,
"reference_path": "/workspace/downloads/106/type_11/bf61426c-67b7-4cf1-a9e7-f78cf519a0021650256910.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "570386",
"query_type": 16,
"query_path": "/workspace/downloads/570386/type_16/eda281acb45e7ee372120854feae9949.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "109",
"confidence": 0.9693921804428101,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
},
{
"song_id": "103",
"confidence": 0.9671289920806885,
"reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
},
{
"song_id": "116",
"confidence": 0.9624252915382385,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "570612",
"query_type": 16,
"query_path": "/workspace/downloads/570612/type_16/刘彧轩-怕-推广片段.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "103",
"confidence": 0.9613455533981323,
"reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
},
{
"song_id": "116",
"confidence": 0.9500769972801208,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
},
{
"song_id": "101",
"confidence": 0.9408313632011414,
"reference_path": "/workspace/downloads/101/type_11/83c0c07f-4f96-4ff4-998c-58db910f3cfa1650256915.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "570615",
"query_type": 16,
"query_path": "/workspace/downloads/570615/type_16/故事打烊 片段.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "105",
"confidence": 0.9693310260772705,
"reference_path": "/workspace/downloads/105/type_11/57e61cde-4410-4751-93e9-d7a4ecece5791650256910.wav"
},
{
"song_id": "116",
"confidence": 0.9566618204116821,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
},
{
"song_id": "108",
"confidence": 0.9463282823562622,
"reference_path": "/workspace/downloads/108/type_11/d7e28fe6-4ad6-4243-b66b-d90ff5ca1e491650256909.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "570690",
"query_type": 16,
"query_path": "/workspace/downloads/570690/type_16/ca8e0c234e560d89d98b52eefc50728b.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "116",
"confidence": 0.9909243583679199,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
},
{
"song_id": "109",
"confidence": 0.9871202111244202,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
},
{
"song_id": "118",
"confidence": 0.9806916117668152,
"reference_path": "/workspace/downloads/118/type_11/db64461e-d752-4cf3-ab1d-56ff9232823d1650256901.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "571113",
"query_type": 16,
"query_path": "/workspace/downloads/571113/type_16/杨小壮-《痴情小丑》伯格DJ版-副歌.wav",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "109",
"confidence": 0.9725576639175415,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
},
{
"song_id": "115",
"confidence": 0.9698269367218018,
"reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
},
{
"song_id": "116",
"confidence": 0.9657437205314636,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
}
],
"top1_correct": false,
"top3_hit": false
}
]
}
\ No newline at end of file
{
"summary": {
"num_queries": 15,
"top1": 0.0,
"top3": 0.0
},
"items": [
{
"song_id": "567134",
"query_type": 8,
"query_path": "/workspace/downloads/567134/type_8/忘记自己 第一段副歌剪辑.wav",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "109",
"confidence": 0.9756905436515808,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
},
{
"song_id": "119",
"confidence": 0.9698718786239624,
"reference_path": "/workspace/downloads/119/type_11/180dfa7d-836a-449c-990f-a3bf39c11da11650256898.wav"
},
{
"song_id": "115",
"confidence": 0.9499492645263672,
"reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "567138",
"query_type": 8,
"query_path": "/workspace/downloads/567138/type_8/小宝贝推广片段.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "116",
"confidence": 0.9818915724754333,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
},
{
"song_id": "109",
"confidence": 0.9744742512702942,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
},
{
"song_id": "101",
"confidence": 0.960013210773468,
"reference_path": "/workspace/downloads/101/type_11/83c0c07f-4f96-4ff4-998c-58db910f3cfa1650256915.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "567165",
"query_type": 8,
"query_path": "/workspace/downloads/567165/type_8/送你一片夏天的海（副歌版）.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "109",
"confidence": 0.9571341276168823,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
},
{
"song_id": "118",
"confidence": 0.9519829750061035,
"reference_path": "/workspace/downloads/118/type_11/db64461e-d752-4cf3-ab1d-56ff9232823d1650256901.wav"
},
{
"song_id": "116",
"confidence": 0.9495424032211304,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "567179",
"query_type": 8,
"query_path": "/workspace/downloads/567179/type_8/要多久-剪辑版2.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "115",
"confidence": 0.9662755131721497,
"reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
},
{
"song_id": "109",
"confidence": 0.964158296585083,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
},
{
"song_id": "114",
"confidence": 0.955880880355835,
"reference_path": "/workspace/downloads/114/type_11/0238ecbf-b234-470e-82e4-f3b80a267d771650256906.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "567189",
"query_type": 8,
"query_path": "/workspace/downloads/567189/type_8/晚风的颜色（主歌）.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "107",
"confidence": 0.9600265026092529,
"reference_path": "/workspace/downloads/107/type_11/296bbc25-617c-4368-9a69-357aeec394381650256910.wav"
},
{
"song_id": "103",
"confidence": 0.9526097178459167,
"reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
},
{
"song_id": "116",
"confidence": 0.9504658579826355,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "567201",
"query_type": 8,
"query_path": "/workspace/downloads/567201/type_8/勇敢 副歌2 (3).wav",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "112",
"confidence": 0.9862581491470337,
"reference_path": "/workspace/downloads/112/type_11/34acd523-3c01-443d-ac3d-4ad7b9e2246f1650256907.wav"
},
{
"song_id": "118",
"confidence": 0.9766209125518799,
"reference_path": "/workspace/downloads/118/type_11/db64461e-d752-4cf3-ab1d-56ff9232823d1650256901.wav"
},
{
"song_id": "101",
"confidence": 0.9553667306900024,
"reference_path": "/workspace/downloads/101/type_11/83c0c07f-4f96-4ff4-998c-58db910f3cfa1650256915.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "567239",
"query_type": 8,
"query_path": "/workspace/downloads/567239/type_8/这个夏天怎么可以没有你 推广片段2（开头主歌）.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "116",
"confidence": 0.974159836769104,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
},
{
"song_id": "117",
"confidence": 0.9686521887779236,
"reference_path": "/workspace/downloads/117/type_11/1e1599e6-ebbd-4ceb-a81d-a320331ef6e31650256901.wav"
},
{
"song_id": "101",
"confidence": 0.9684320092201233,
"reference_path": "/workspace/downloads/101/type_11/83c0c07f-4f96-4ff4-998c-58db910f3cfa1650256915.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "567259",
"query_type": 8,
"query_path": "/workspace/downloads/567259/type_8/天宫一日游 推广片段2.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "109",
"confidence": 0.9701132774353027,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
},
{
"song_id": "116",
"confidence": 0.9624565839767456,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
},
{
"song_id": "103",
"confidence": 0.9617894887924194,
"reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "567263",
"query_type": 8,
"query_path": "/workspace/downloads/567263/type_8/如果我们不能在一起（主歌2）.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "108",
"confidence": 0.9555953741073608,
"reference_path": "/workspace/downloads/108/type_11/d7e28fe6-4ad6-4243-b66b-d90ff5ca1e491650256909.wav"
},
{
"song_id": "109",
"confidence": 0.93790602684021,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
},
{
"song_id": "105",
"confidence": 0.9331773519515991,
"reference_path": "/workspace/downloads/105/type_11/57e61cde-4410-4751-93e9-d7a4ecece5791650256910.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "567264",
"query_type": 8,
"query_path": "/workspace/downloads/567264/type_8/如果我们不能在一起（DJheap九天版）副歌.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "116",
"confidence": 0.974779486656189,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
},
{
"song_id": "109",
"confidence": 0.9744417667388916,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
},
{
"song_id": "115",
"confidence": 0.9711195230484009,
"reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "567271",
"query_type": 8,
"query_path": "/workspace/downloads/567271/type_8/时光寄语（带前缀进副）.wav",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "105",
"confidence": 0.9698833227157593,
"reference_path": "/workspace/downloads/105/type_11/57e61cde-4410-4751-93e9-d7a4ecece5791650256910.wav"
},
{
"song_id": "116",
"confidence": 0.9657000303268433,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
},
{
"song_id": "109",
"confidence": 0.9625085592269897,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "567281",
"query_type": 8,
"query_path": "/workspace/downloads/567281/type_8/赵乾景-野火春风（剪辑版2）.wav",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "119",
"confidence": 0.9805784225463867,
"reference_path": "/workspace/downloads/119/type_11/180dfa7d-836a-449c-990f-a3bf39c11da11650256898.wav"
},
{
"song_id": "109",
"confidence": 0.9570527076721191,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
},
{
"song_id": "115",
"confidence": 0.9284474849700928,
"reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "567415",
"query_type": 8,
"query_path": "/workspace/downloads/567415/type_8/将相（主歌版）.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "101",
"confidence": 0.9687893986701965,
"reference_path": "/workspace/downloads/101/type_11/83c0c07f-4f96-4ff4-998c-58db910f3cfa1650256915.wav"
},
{
"song_id": "116",
"confidence": 0.9682439565658569,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
},
{
"song_id": "118",
"confidence": 0.948961079120636,
"reference_path": "/workspace/downloads/118/type_11/db64461e-d752-4cf3-ab1d-56ff9232823d1650256901.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "567418",
"query_type": 8,
"query_path": "/workspace/downloads/567418/type_8/寒鸦 副歌片段.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "116",
"confidence": 0.9729928970336914,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
},
{
"song_id": "101",
"confidence": 0.9692196846008301,
"reference_path": "/workspace/downloads/101/type_11/83c0c07f-4f96-4ff4-998c-58db910f3cfa1650256915.wav"
},
{
"song_id": "109",
"confidence": 0.9640683531761169,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
}
],
"top1_correct": false,
"top3_hit": false
},
{
"song_id": "567916",
"query_type": 8,
"query_path": "/workspace/downloads/567916/type_8/梁祝 2022【长片段】.mp3",
"chunk_count": 1,
"top_candidates": [
{
"song_id": "103",
"confidence": 0.9734272956848145,
"reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
},
{
"song_id": "116",
"confidence": 0.9696248769760132,
"reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
},
{
"song_id": "109",
"confidence": 0.9599570035934448,
"reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
}
],
"top1_correct": false,
"top3_hit": false
}
]
}
\ No newline at end of file
- 新增 `acr-engine/data/local_eval/voice_workspace20_type7_eval.json`，对当前 `workspace_music20` 语义做了 20 条 `type_7` 批量验证：`top1=0.0`、`top3=0.05`，说明业务 song_id 正确性仍明显不足。
- 新增 `acr-engine/data/local_eval/voice_workspace20_type8_eval.json` 与 `voice_workspace20_type16_eval.json`，补充 business-corpus voice correctness 基线：`type_8 top1=0.0/top3=0.0`，`type_16 top1=0.0/top3=0.0`。
- architect review 当前结论：`APPROVED (WATCH)`，允许继续沿当前架构推进，但不能把当前 business-corpus 结果视作完成。
- `docs/session-handoff.md` 已刷新为最新 voice service runtime 状态，明确 `/health` 可用、`/recognize/voice` 仍超时，以及下一步最短排查路径
......
......@@ -24,7 +24,7 @@ flowchart TD
| benchmark report 已生成 | |
| model card 已生成 | |
| license registry 已更新 | |
| service smoke test 通过 | partial: `/health` OK, `/recognize/voice` payload returns against `workspace_music20`, but batch validation is currently poor (`type_7 top1=0.0`, `top3=0.05`) |
| service smoke test 通过 | partial: `/health` OK, `/recognize/voice` payload returns against `workspace_music20`, but batch validation is currently poor (`type_7 top1=0.0/top3=0.05`, `type_8 top1=0.0/top3=0.0`, `type_16 top1=0.0/top3=0.0`) |
| dataset whitelist 已确认 | |
| changelog 已更新 | yes |
| architect review completed | yes (approved with watch) |
......
......@@ -51,6 +51,10 @@
- `top1=0.0`
- `top3=0.05`
- 说明当前 business sample 语义虽然已通路，但 song_id 正确性还很差，必须继续优化，不可直接当成可用识别能力。
- 当前已继续补齐 `type_8 / type_16` 的 business-corpus voice correctness 基线：
- `voice_workspace20_type8_eval.json`: `num_queries=15`, `top1=0.0`, `top3=0.0`
- `voice_workspace20_type16_eval.json`: `num_queries=12`, `top1=0.0`, `top3=0.0`
- 说明当前基于 `/workspace` 的本地 chroma+FAISS voice lane 在 hard query 上几乎不可用，后续应优先切向更接近生产的 embedding/pgvector 评测路径。
- architect review 当前结论：`APPROVED (WATCH)`，允许继续沿当前架构推进，但需要明确区分“链路通”与“业务正确”。
### 最新补充（2026-06-03 voice service runtime）
......