标注质量分析报告 · project 8

QC 数据 2026-10-20 19:52:14 · 每 5 分钟自动刷新 · 基于 12 位标注员的已完成 clip

发现的问题

not_hand 口径不一致:zhouxinwen、caipeijia、liwenpan 的 not_hand 数远低于其他人(不到全员中位数的 30%),疑似没把模型假阳框改成 not_hand(直接删掉或漏改)。这会让 GT 里「模型误检」的标注在不同人之间不可比。
occlusion 遮挡比例漏标:annotator08 的遮挡标注率不到全员中位数一半,基本没在标遮挡程度(几乎全部默认 0-25%)。
glove 手套属性全员为 0:没有任何一帧标了戴手套 —— 要么数据里确实没手套,要么根本没人标(与已知的「glove 中途变化标不了」限制相关)。

⚠️ 待补标 not_hand(模型误检被直接删掉)

模型高置信框(score≥0.7)在该关键帧既没被保留成手、也没标 not_hand —— 逐帧核实为「脚/物体被误检成手」被直接删掉了。按 SOP 应标 not_hand 而非删(否则丢失难负样本)。共 353 个 clip;仅统计 score≥0.7,实际更多。
标注员问题 clip 数问题框数(≥0.7)
lijiaxi861189
shenzhaogeng861174
jiangxingling35370
tianyu61303
guoyang55106
annotator06461
annotator071931
annotator0944
annotator0811
caipeijia11
zhouxinwen11
问题最多的 clip(点「打开」跳到 CVAT 首个问题帧)
标注员框数命中帧clip链接
lijiaxi18217362625c67__t00568.85s__d0088.5s打开→
shenzhaogeng128743d90e3ac__t01868.22s__d0031.2s打开→
jiangxingling1181049fd3c2da__t05961.72s__d0064.0s打开→
shenzhaogeng111883b144287__t01755.03s__d0060.0s打开→
lijiaxi1089154bc4213__t00000.57s__d0062.2s打开→
tianyu9372241c8696__t01029.71s__d0047.5s打开→
lijiaxi75675a4757d4__t00142.38s__d0055.0s打开→
shenzhaogeng6746465a6408__t03162.93s__d0028.7s打开→
shenzhaogeng65633b144287__t00135.65s__d0031.0s打开→
shenzhaogeng534940c0b8f8__t00315.92s__d0068.9s打开→
jiangxingling5042a8578934__t00030.27s__d0057.0s打开→
shenzhaogeng4639317462d8__t03699.94s__d0036.1s打开→
lijiaxi44364d04fa50__t02556.45s__d0031.5s打开→
lijiaxi44386658fa87__t02482.92s__d0018.8s打开→
shenzhaogeng433446b1abf7__t01902.12s__d0045.8s打开→
lijiaxi414152b8fafb__t02725.96s__d0024.8s打开→
lijiaxi413469795e19__t02512.57s__d0057.6s打开→
shenzhaogeng36332a34342a__t01085.51s__d0088.1s打开→
shenzhaogeng36313a787a7e__t01869.25s__d0037.7s打开→
shenzhaogeng353142130852__t00212.48s__d0024.4s打开→
shenzhaogeng33322cf7358b__t01502.92s__d0086.0s打开→
lijiaxi302860655878__t00000.00s__d0070.9s打开→
annotator062915122b57ab__t00000.00s__d0041.9s打开→
shenzhaogeng27243311fcf9__t01654.37s__d0031.1s打开→
shenzhaogeng272433bf6a7a__t00610.78s__d0051.8s打开→
jiangxingling2725ba392739__t00077.07s__d0070.7s打开→
tianyu2724136681d3__t00000.00s__d0049.3s打开→
shenzhaogeng262249ecc932__t00081.07s__d0037.2s打开→
lijiaxi26215ca5054b__t00271.23s__d0027.7s打开→
lijiaxi262568db36e2__t00531.41s__d0050.9s打开→

每人标注特征

occlusion 标注率 = 设了非默认遮挡比例的 ego 关键帧占比;红色 = 明显低于全员中位数,疑似漏标
标注员完成clipego关键帧occlusion标注率gloveother手not_hand
guoyang2102208526.4%
0204241779
shenzhaogeng2072125119.7%
0169341132
lijiaxi2002364832.9%
0213741583
tianyu1982183011.1%
0226401131
jiangxingling1872178614.3%
0189332174
annotator071551511825.4%
06576604
annotator061501375721.2%
05492495
zhouxinwen122987124.5%
034223
caipeijia97792723.7%
08410
liwenpan86679020.2%
01717
annotator0924270921.3%
02445265
annotator081213999.6%
0795147
说明:表中是「标注特征」而非逐框对错。红色标记的是跨人差异过大、疑似没按同一口径执行的项,需结合 SOP 要求判定谁要补标。
参考中位数:occlusion 标注率 ≈ 21% · not_hand/clip ≈ 5.6 · 完成 clip 合计 1648