Skip to content

wanghai-tech / hikoon-ACR

Go to a project
Toggle navigation
Toggle navigation pinning
Commit a0ceb991 a0ceb99163204d4f7cf57634c2319a8aa613335d by cnb.bofCdSsphPA
Options

Extend the business-corpus voice correctness baseline to type8 and type16 

Constraint: we need a complete hard-query picture before claiming the workspace_music20 voice lane is usable or deciding where pgvector work should start
Rejected: extrapolating from type_7 alone | the type_8 and type_16 lanes can fail differently and need their own measured baselines
Confidence: high
Scope-risk: narrow
Directive: keep all future business-corpus voice evaluations split by query type so we can see exactly which hard lanes fail and why
Tested: /usr/local/miniconda3/bin/python -m unittest discover -s acr-engine/tests -v; generated voice_workspace20_type8_eval.json (top1=0.0, top3=0.0) and voice_workspace20_type16_eval.json (top1=0.0, top3=0.0)
Not-tested: improved business-corpus voice correctness after moving to embedding/pgvector retrieval
1 parent 5a01ab7f
Inline Side-by-side
Showing 5 changed files with 699 additions and 1 deletions
1 {
2 "summary": {
3 "num_queries": 12,
4 "top1": 0.0,
5 "top3": 0.0
6 },
7 "items": [
8 {
9 "song_id": "569681",
10 "query_type": 16,
11 "query_path": "/workspace/downloads/569681/type_16/失去的总是太珍贵（DJ版）_15秒.wav",
12 "chunk_count": 1,
13 "top_candidates": [
14 {
15 "song_id": "115",
16 "confidence": 0.9811056852340698,
17 "reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
18 },
19 {
20 "song_id": "116",
21 "confidence": 0.9798094630241394,
22 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
23 },
24 {
25 "song_id": "103",
26 "confidence": 0.9763965606689453,
27 "reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
28 }
29 ],
30 "top1_correct": false,
31 "top3_hit": false
32 },
33 {
34 "song_id": "569738",
35 "query_type": 16,
36 "query_path": "/workspace/downloads/569738/type_16/孤单被写成歌 (DJ阿卓版)-剪辑版.mp3",
37 "chunk_count": 1,
38 "top_candidates": [
39 {
40 "song_id": "116",
41 "confidence": 0.959204912185669,
42 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
43 },
44 {
45 "song_id": "114",
46 "confidence": 0.9554344415664673,
47 "reference_path": "/workspace/downloads/114/type_11/0238ecbf-b234-470e-82e4-f3b80a267d771650256906.wav"
48 },
49 {
50 "song_id": "105",
51 "confidence": 0.9521631002426147,
52 "reference_path": "/workspace/downloads/105/type_11/57e61cde-4410-4751-93e9-d7a4ecece5791650256910.wav"
53 }
54 ],
55 "top1_correct": false,
56 "top3_hit": false
57 },
58 {
59 "song_id": "569748",
60 "query_type": 16,
61 "query_path": "/workspace/downloads/569748/type_16/49a1d25ec19ace09e80b81187ebb0d0b.mp3",
62 "chunk_count": 1,
63 "top_candidates": [
64 {
65 "song_id": "116",
66 "confidence": 0.9791994094848633,
67 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
68 },
69 {
70 "song_id": "109",
71 "confidence": 0.9777094125747681,
72 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
73 },
74 {
75 "song_id": "103",
76 "confidence": 0.9743528366088867,
77 "reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
78 }
79 ],
80 "top1_correct": false,
81 "top3_hit": false
82 },
83 {
84 "song_id": "569787",
85 "query_type": 16,
86 "query_path": "/workspace/downloads/569787/type_16/九块九爱情-副歌剪辑.mp3",
87 "chunk_count": 1,
88 "top_candidates": [
89 {
90 "song_id": "116",
91 "confidence": 0.9737908244132996,
92 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
93 },
94 {
95 "song_id": "103",
96 "confidence": 0.972736120223999,
97 "reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
98 },
99 {
100 "song_id": "101",
101 "confidence": 0.9667743444442749,
102 "reference_path": "/workspace/downloads/101/type_11/83c0c07f-4f96-4ff4-998c-58db910f3cfa1650256915.wav"
103 }
104 ],
105 "top1_correct": false,
106 "top3_hit": false
107 },
108 {
109 "song_id": "569855",
110 "query_type": 16,
111 "query_path": "/workspace/downloads/569855/type_16/2604aa1e31c47097c27ef92e7993aa5e.mp3",
112 "chunk_count": 1,
113 "top_candidates": [
114 {
115 "song_id": "115",
116 "confidence": 0.9648096561431885,
117 "reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
118 },
119 {
120 "song_id": "119",
121 "confidence": 0.9647560715675354,
122 "reference_path": "/workspace/downloads/119/type_11/180dfa7d-836a-449c-990f-a3bf39c11da11650256898.wav"
123 },
124 {
125 "song_id": "109",
126 "confidence": 0.9611845016479492,
127 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
128 }
129 ],
130 "top1_correct": false,
131 "top3_hit": false
132 },
133 {
134 "song_id": "570124",
135 "query_type": 16,
136 "query_path": "/workspace/downloads/570124/type_16/朋友的礼貌 推广音频_01.wav",
137 "chunk_count": 1,
138 "top_candidates": [
139 {
140 "song_id": "119",
141 "confidence": 0.958089292049408,
142 "reference_path": "/workspace/downloads/119/type_11/180dfa7d-836a-449c-990f-a3bf39c11da11650256898.wav"
143 },
144 {
145 "song_id": "115",
146 "confidence": 0.9525090456008911,
147 "reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
148 },
149 {
150 "song_id": "118",
151 "confidence": 0.9480559229850769,
152 "reference_path": "/workspace/downloads/118/type_11/db64461e-d752-4cf3-ab1d-56ff9232823d1650256901.wav"
153 }
154 ],
155 "top1_correct": false,
156 "top3_hit": false
157 },
158 {
159 "song_id": "570345",
160 "query_type": 16,
161 "query_path": "/workspace/downloads/570345/type_16/痴情小丑-副歌剪辑.mp3",
162 "chunk_count": 1,
163 "top_candidates": [
164 {
165 "song_id": "105",
166 "confidence": 0.9752437472343445,
167 "reference_path": "/workspace/downloads/105/type_11/57e61cde-4410-4751-93e9-d7a4ecece5791650256910.wav"
168 },
169 {
170 "song_id": "109",
171 "confidence": 0.9603044986724854,
172 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
173 },
174 {
175 "song_id": "106",
176 "confidence": 0.9536592364311218,
177 "reference_path": "/workspace/downloads/106/type_11/bf61426c-67b7-4cf1-a9e7-f78cf519a0021650256910.wav"
178 }
179 ],
180 "top1_correct": false,
181 "top3_hit": false
182 },
183 {
184 "song_id": "570386",
185 "query_type": 16,
186 "query_path": "/workspace/downloads/570386/type_16/eda281acb45e7ee372120854feae9949.mp3",
187 "chunk_count": 1,
188 "top_candidates": [
189 {
190 "song_id": "109",
191 "confidence": 0.9693921804428101,
192 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
193 },
194 {
195 "song_id": "103",
196 "confidence": 0.9671289920806885,
197 "reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
198 },
199 {
200 "song_id": "116",
201 "confidence": 0.9624252915382385,
202 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
203 }
204 ],
205 "top1_correct": false,
206 "top3_hit": false
207 },
208 {
209 "song_id": "570612",
210 "query_type": 16,
211 "query_path": "/workspace/downloads/570612/type_16/刘彧轩-怕-推广片段.mp3",
212 "chunk_count": 1,
213 "top_candidates": [
214 {
215 "song_id": "103",
216 "confidence": 0.9613455533981323,
217 "reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
218 },
219 {
220 "song_id": "116",
221 "confidence": 0.9500769972801208,
222 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
223 },
224 {
225 "song_id": "101",
226 "confidence": 0.9408313632011414,
227 "reference_path": "/workspace/downloads/101/type_11/83c0c07f-4f96-4ff4-998c-58db910f3cfa1650256915.wav"
228 }
229 ],
230 "top1_correct": false,
231 "top3_hit": false
232 },
233 {
234 "song_id": "570615",
235 "query_type": 16,
236 "query_path": "/workspace/downloads/570615/type_16/故事打烊 片段.mp3",
237 "chunk_count": 1,
238 "top_candidates": [
239 {
240 "song_id": "105",
241 "confidence": 0.9693310260772705,
242 "reference_path": "/workspace/downloads/105/type_11/57e61cde-4410-4751-93e9-d7a4ecece5791650256910.wav"
243 },
244 {
245 "song_id": "116",
246 "confidence": 0.9566618204116821,
247 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
248 },
249 {
250 "song_id": "108",
251 "confidence": 0.9463282823562622,
252 "reference_path": "/workspace/downloads/108/type_11/d7e28fe6-4ad6-4243-b66b-d90ff5ca1e491650256909.wav"
253 }
254 ],
255 "top1_correct": false,
256 "top3_hit": false
257 },
258 {
259 "song_id": "570690",
260 "query_type": 16,
261 "query_path": "/workspace/downloads/570690/type_16/ca8e0c234e560d89d98b52eefc50728b.mp3",
262 "chunk_count": 1,
263 "top_candidates": [
264 {
265 "song_id": "116",
266 "confidence": 0.9909243583679199,
267 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
268 },
269 {
270 "song_id": "109",
271 "confidence": 0.9871202111244202,
272 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
273 },
274 {
275 "song_id": "118",
276 "confidence": 0.9806916117668152,
277 "reference_path": "/workspace/downloads/118/type_11/db64461e-d752-4cf3-ab1d-56ff9232823d1650256901.wav"
278 }
279 ],
280 "top1_correct": false,
281 "top3_hit": false
282 },
283 {
284 "song_id": "571113",
285 "query_type": 16,
286 "query_path": "/workspace/downloads/571113/type_16/杨小壮-《痴情小丑》伯格DJ版-副歌.wav",
287 "chunk_count": 1,
288 "top_candidates": [
289 {
290 "song_id": "109",
291 "confidence": 0.9725576639175415,
292 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
293 },
294 {
295 "song_id": "115",
296 "confidence": 0.9698269367218018,
297 "reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
298 },
299 {
300 "song_id": "116",
301 "confidence": 0.9657437205314636,
302 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
303 }
304 ],
305 "top1_correct": false,
306 "top3_hit": false
307 }
308 ]
309 }
...\ No newline at end of file ...\ No newline at end of file
1 {
2 "summary": {
3 "num_queries": 15,
4 "top1": 0.0,
5 "top3": 0.0
6 },
7 "items": [
8 {
9 "song_id": "567134",
10 "query_type": 8,
11 "query_path": "/workspace/downloads/567134/type_8/忘记自己 第一段副歌剪辑.wav",
12 "chunk_count": 1,
13 "top_candidates": [
14 {
15 "song_id": "109",
16 "confidence": 0.9756905436515808,
17 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
18 },
19 {
20 "song_id": "119",
21 "confidence": 0.9698718786239624,
22 "reference_path": "/workspace/downloads/119/type_11/180dfa7d-836a-449c-990f-a3bf39c11da11650256898.wav"
23 },
24 {
25 "song_id": "115",
26 "confidence": 0.9499492645263672,
27 "reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
28 }
29 ],
30 "top1_correct": false,
31 "top3_hit": false
32 },
33 {
34 "song_id": "567138",
35 "query_type": 8,
36 "query_path": "/workspace/downloads/567138/type_8/小宝贝推广片段.mp3",
37 "chunk_count": 1,
38 "top_candidates": [
39 {
40 "song_id": "116",
41 "confidence": 0.9818915724754333,
42 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
43 },
44 {
45 "song_id": "109",
46 "confidence": 0.9744742512702942,
47 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
48 },
49 {
50 "song_id": "101",
51 "confidence": 0.960013210773468,
52 "reference_path": "/workspace/downloads/101/type_11/83c0c07f-4f96-4ff4-998c-58db910f3cfa1650256915.wav"
53 }
54 ],
55 "top1_correct": false,
56 "top3_hit": false
57 },
58 {
59 "song_id": "567165",
60 "query_type": 8,
61 "query_path": "/workspace/downloads/567165/type_8/送你一片夏天的海（副歌版）.mp3",
62 "chunk_count": 1,
63 "top_candidates": [
64 {
65 "song_id": "109",
66 "confidence": 0.9571341276168823,
67 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
68 },
69 {
70 "song_id": "118",
71 "confidence": 0.9519829750061035,
72 "reference_path": "/workspace/downloads/118/type_11/db64461e-d752-4cf3-ab1d-56ff9232823d1650256901.wav"
73 },
74 {
75 "song_id": "116",
76 "confidence": 0.9495424032211304,
77 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
78 }
79 ],
80 "top1_correct": false,
81 "top3_hit": false
82 },
83 {
84 "song_id": "567179",
85 "query_type": 8,
86 "query_path": "/workspace/downloads/567179/type_8/要多久-剪辑版2.mp3",
87 "chunk_count": 1,
88 "top_candidates": [
89 {
90 "song_id": "115",
91 "confidence": 0.9662755131721497,
92 "reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
93 },
94 {
95 "song_id": "109",
96 "confidence": 0.964158296585083,
97 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
98 },
99 {
100 "song_id": "114",
101 "confidence": 0.955880880355835,
102 "reference_path": "/workspace/downloads/114/type_11/0238ecbf-b234-470e-82e4-f3b80a267d771650256906.wav"
103 }
104 ],
105 "top1_correct": false,
106 "top3_hit": false
107 },
108 {
109 "song_id": "567189",
110 "query_type": 8,
111 "query_path": "/workspace/downloads/567189/type_8/晚风的颜色（主歌）.mp3",
112 "chunk_count": 1,
113 "top_candidates": [
114 {
115 "song_id": "107",
116 "confidence": 0.9600265026092529,
117 "reference_path": "/workspace/downloads/107/type_11/296bbc25-617c-4368-9a69-357aeec394381650256910.wav"
118 },
119 {
120 "song_id": "103",
121 "confidence": 0.9526097178459167,
122 "reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
123 },
124 {
125 "song_id": "116",
126 "confidence": 0.9504658579826355,
127 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
128 }
129 ],
130 "top1_correct": false,
131 "top3_hit": false
132 },
133 {
134 "song_id": "567201",
135 "query_type": 8,
136 "query_path": "/workspace/downloads/567201/type_8/勇敢 副歌2 (3).wav",
137 "chunk_count": 1,
138 "top_candidates": [
139 {
140 "song_id": "112",
141 "confidence": 0.9862581491470337,
142 "reference_path": "/workspace/downloads/112/type_11/34acd523-3c01-443d-ac3d-4ad7b9e2246f1650256907.wav"
143 },
144 {
145 "song_id": "118",
146 "confidence": 0.9766209125518799,
147 "reference_path": "/workspace/downloads/118/type_11/db64461e-d752-4cf3-ab1d-56ff9232823d1650256901.wav"
148 },
149 {
150 "song_id": "101",
151 "confidence": 0.9553667306900024,
152 "reference_path": "/workspace/downloads/101/type_11/83c0c07f-4f96-4ff4-998c-58db910f3cfa1650256915.wav"
153 }
154 ],
155 "top1_correct": false,
156 "top3_hit": false
157 },
158 {
159 "song_id": "567239",
160 "query_type": 8,
161 "query_path": "/workspace/downloads/567239/type_8/这个夏天怎么可以没有你 推广片段2（开头主歌）.mp3",
162 "chunk_count": 1,
163 "top_candidates": [
164 {
165 "song_id": "116",
166 "confidence": 0.974159836769104,
167 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
168 },
169 {
170 "song_id": "117",
171 "confidence": 0.9686521887779236,
172 "reference_path": "/workspace/downloads/117/type_11/1e1599e6-ebbd-4ceb-a81d-a320331ef6e31650256901.wav"
173 },
174 {
175 "song_id": "101",
176 "confidence": 0.9684320092201233,
177 "reference_path": "/workspace/downloads/101/type_11/83c0c07f-4f96-4ff4-998c-58db910f3cfa1650256915.wav"
178 }
179 ],
180 "top1_correct": false,
181 "top3_hit": false
182 },
183 {
184 "song_id": "567259",
185 "query_type": 8,
186 "query_path": "/workspace/downloads/567259/type_8/天宫一日游 推广片段2.mp3",
187 "chunk_count": 1,
188 "top_candidates": [
189 {
190 "song_id": "109",
191 "confidence": 0.9701132774353027,
192 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
193 },
194 {
195 "song_id": "116",
196 "confidence": 0.9624565839767456,
197 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
198 },
199 {
200 "song_id": "103",
201 "confidence": 0.9617894887924194,
202 "reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
203 }
204 ],
205 "top1_correct": false,
206 "top3_hit": false
207 },
208 {
209 "song_id": "567263",
210 "query_type": 8,
211 "query_path": "/workspace/downloads/567263/type_8/如果我们不能在一起（主歌2）.mp3",
212 "chunk_count": 1,
213 "top_candidates": [
214 {
215 "song_id": "108",
216 "confidence": 0.9555953741073608,
217 "reference_path": "/workspace/downloads/108/type_11/d7e28fe6-4ad6-4243-b66b-d90ff5ca1e491650256909.wav"
218 },
219 {
220 "song_id": "109",
221 "confidence": 0.93790602684021,
222 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
223 },
224 {
225 "song_id": "105",
226 "confidence": 0.9331773519515991,
227 "reference_path": "/workspace/downloads/105/type_11/57e61cde-4410-4751-93e9-d7a4ecece5791650256910.wav"
228 }
229 ],
230 "top1_correct": false,
231 "top3_hit": false
232 },
233 {
234 "song_id": "567264",
235 "query_type": 8,
236 "query_path": "/workspace/downloads/567264/type_8/如果我们不能在一起（DJheap九天版）副歌.mp3",
237 "chunk_count": 1,
238 "top_candidates": [
239 {
240 "song_id": "116",
241 "confidence": 0.974779486656189,
242 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
243 },
244 {
245 "song_id": "109",
246 "confidence": 0.9744417667388916,
247 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
248 },
249 {
250 "song_id": "115",
251 "confidence": 0.9711195230484009,
252 "reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
253 }
254 ],
255 "top1_correct": false,
256 "top3_hit": false
257 },
258 {
259 "song_id": "567271",
260 "query_type": 8,
261 "query_path": "/workspace/downloads/567271/type_8/时光寄语（带前缀进副）.wav",
262 "chunk_count": 1,
263 "top_candidates": [
264 {
265 "song_id": "105",
266 "confidence": 0.9698833227157593,
267 "reference_path": "/workspace/downloads/105/type_11/57e61cde-4410-4751-93e9-d7a4ecece5791650256910.wav"
268 },
269 {
270 "song_id": "116",
271 "confidence": 0.9657000303268433,
272 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
273 },
274 {
275 "song_id": "109",
276 "confidence": 0.9625085592269897,
277 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
278 }
279 ],
280 "top1_correct": false,
281 "top3_hit": false
282 },
283 {
284 "song_id": "567281",
285 "query_type": 8,
286 "query_path": "/workspace/downloads/567281/type_8/赵乾景-野火春风（剪辑版2）.wav",
287 "chunk_count": 1,
288 "top_candidates": [
289 {
290 "song_id": "119",
291 "confidence": 0.9805784225463867,
292 "reference_path": "/workspace/downloads/119/type_11/180dfa7d-836a-449c-990f-a3bf39c11da11650256898.wav"
293 },
294 {
295 "song_id": "109",
296 "confidence": 0.9570527076721191,
297 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
298 },
299 {
300 "song_id": "115",
301 "confidence": 0.9284474849700928,
302 "reference_path": "/workspace/downloads/115/type_11/aabad0ff-13de-4786-aa9c-40e1f957ed9f1650256906.wav"
303 }
304 ],
305 "top1_correct": false,
306 "top3_hit": false
307 },
308 {
309 "song_id": "567415",
310 "query_type": 8,
311 "query_path": "/workspace/downloads/567415/type_8/将相（主歌版）.mp3",
312 "chunk_count": 1,
313 "top_candidates": [
314 {
315 "song_id": "101",
316 "confidence": 0.9687893986701965,
317 "reference_path": "/workspace/downloads/101/type_11/83c0c07f-4f96-4ff4-998c-58db910f3cfa1650256915.wav"
318 },
319 {
320 "song_id": "116",
321 "confidence": 0.9682439565658569,
322 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
323 },
324 {
325 "song_id": "118",
326 "confidence": 0.948961079120636,
327 "reference_path": "/workspace/downloads/118/type_11/db64461e-d752-4cf3-ab1d-56ff9232823d1650256901.wav"
328 }
329 ],
330 "top1_correct": false,
331 "top3_hit": false
332 },
333 {
334 "song_id": "567418",
335 "query_type": 8,
336 "query_path": "/workspace/downloads/567418/type_8/寒鸦 副歌片段.mp3",
337 "chunk_count": 1,
338 "top_candidates": [
339 {
340 "song_id": "116",
341 "confidence": 0.9729928970336914,
342 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
343 },
344 {
345 "song_id": "101",
346 "confidence": 0.9692196846008301,
347 "reference_path": "/workspace/downloads/101/type_11/83c0c07f-4f96-4ff4-998c-58db910f3cfa1650256915.wav"
348 },
349 {
350 "song_id": "109",
351 "confidence": 0.9640683531761169,
352 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
353 }
354 ],
355 "top1_correct": false,
356 "top3_hit": false
357 },
358 {
359 "song_id": "567916",
360 "query_type": 8,
361 "query_path": "/workspace/downloads/567916/type_8/梁祝 2022【长片段】.mp3",
362 "chunk_count": 1,
363 "top_candidates": [
364 {
365 "song_id": "103",
366 "confidence": 0.9734272956848145,
367 "reference_path": "/workspace/downloads/103/type_11/19876dbb-fffc-40f8-9530-9322c9ed77681650256912.wav"
368 },
369 {
370 "song_id": "116",
371 "confidence": 0.9696248769760132,
372 "reference_path": "/workspace/downloads/116/type_11/da34f6ff-39e7-4dde-8265-e1bb01b6263e1650256901.wav"
373 },
374 {
375 "song_id": "109",
376 "confidence": 0.9599570035934448,
377 "reference_path": "/workspace/downloads/109/type_11/84acef9b-2a74-44bc-9eff-5ca7969ac9b61650256909.wav"
378 }
379 ],
380 "top1_correct": false,
381 "top3_hit": false
382 }
383 ]
384 }
...\ No newline at end of file ...\ No newline at end of file
1 - 新增 `acr-engine/data/local_eval/voice_workspace20_type7_eval.json`，对当前 `workspace_music20` 语义做了 20 条 `type_7` 批量验证：`top1=0.0`、`top3=0.05`，说明业务 song_id 正确性仍明显不足。 1 - 新增 `acr-engine/data/local_eval/voice_workspace20_type7_eval.json`，对当前 `workspace_music20` 语义做了 20 条 `type_7` 批量验证：`top1=0.0`、`top3=0.05`，说明业务 song_id 正确性仍明显不足。
2 - 新增 `acr-engine/data/local_eval/voice_workspace20_type8_eval.json` 与 `voice_workspace20_type16_eval.json`，补充 business-corpus voice correctness 基线：`type_8 top1=0.0/top3=0.0`，`type_16 top1=0.0/top3=0.0`。
2 - architect review 当前结论：`APPROVED (WATCH)`，允许继续沿当前架构推进，但不能把当前 business-corpus 结果视作完成。 3 - architect review 当前结论：`APPROVED (WATCH)`，允许继续沿当前架构推进，但不能把当前 business-corpus 结果视作完成。
3 - `docs/session-handoff.md` 已刷新为最新 voice service runtime 状态，明确 `/health` 可用、`/recognize/voice` 仍超时，以及下一步最短排查路径 4 - `docs/session-handoff.md` 已刷新为最新 voice service runtime 状态，明确 `/health` 可用、`/recognize/voice` 仍超时，以及下一步最短排查路径
4 5
......
...@@ -24,7 +24,7 @@ flowchart TD ...@@ -24,7 +24,7 @@ flowchart TD
24 | benchmark report 已生成 | | 24 | benchmark report 已生成 | |
25 | model card 已生成 | | 25 | model card 已生成 | |
26 | license registry 已更新 | | 26 | license registry 已更新 | |
27 | service smoke test 通过 | partial: `/health` OK, `/recognize/voice` payload returns against `workspace_music20`, but batch validation is currently poor (`type_7 top1=0.0`, `top3=0.05`) | 27 | service smoke test 通过 | partial: `/health` OK, `/recognize/voice` payload returns against `workspace_music20`, but batch validation is currently poor (`type_7 top1=0.0/top3=0.05`, `type_8 top1=0.0/top3=0.0`, `type_16 top1=0.0/top3=0.0`) |
28 | dataset whitelist 已确认 | | 28 | dataset whitelist 已确认 | |
29 | changelog 已更新 | yes | 29 | changelog 已更新 | yes |
30 | architect review completed | yes (approved with watch) | 30 | architect review completed | yes (approved with watch) |
......
...@@ -51,6 +51,10 @@ ...@@ -51,6 +51,10 @@
51 - `top1=0.0` 51 - `top1=0.0`
52 - `top3=0.05` 52 - `top3=0.05`
53 - 说明当前 business sample 语义虽然已通路，但 song_id 正确性还很差，必须继续优化，不可直接当成可用识别能力。 53 - 说明当前 business sample 语义虽然已通路，但 song_id 正确性还很差，必须继续优化，不可直接当成可用识别能力。
54 - 当前已继续补齐 `type_8 / type_16` 的 business-corpus voice correctness 基线：
55 - `voice_workspace20_type8_eval.json`: `num_queries=15`, `top1=0.0`, `top3=0.0`
56 - `voice_workspace20_type16_eval.json`: `num_queries=12`, `top1=0.0`, `top3=0.0`
57 - 说明当前基于 `/workspace` 的本地 chroma+FAISS voice lane 在 hard query 上几乎不可用，后续应优先切向更接近生产的 embedding/pgvector 评测路径。
54 - architect review 当前结论：`APPROVED (WATCH)`，允许继续沿当前架构推进，但需要明确区分“链路通”与“业务正确”。 58 - architect review 当前结论：`APPROVED (WATCH)`，允许继续沿当前架构推进，但需要明确区分“链路通”与“业务正确”。
55 59
56 ### 最新补充（2026-06-03 voice service runtime） 60 ### 最新补充（2026-06-03 voice service runtime）
......