# corrupt-hivetrace - ru / pii (1810 rows, 1667 spans, 378 negatives)

Main metric: **missed** - gold spans no predicted character touched. Score threshold 0.5; spans without a score always count. `hidden` - gold spans every character of which is covered: touching one character counts as detection, not as hiding. `hidden` is counted over normalized predictions - a prediction is stretched to whole words before it is compared, so it is what a masker that repeats the same normalization would hide; a masker that masks the raw offsets of the model hides no more than this. Char P / R / F1 are reference only. Trivial baseline, mask everything: 0 missed, 100% hidden, char P 0.196 (80.4% of the text over-masked). `rows touched` / `chars masked` count rows the source left without annotations where a mask touched something, and the characters masked in them; that absence of annotations is not evidence that those rows hold nothing sensitive, so this is not a false-alarm rate. The exact CSVs keep the technical column names `fp_rows` and `fp_chars`.

| model | missed | missed % [95% CI] | hidden | char F1 [95% CI] | P | R | entity exact | entity overlap | typed F1 | rows touched | chars masked | dropped spans | ms/row | params | train |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| nym-base+homoglyph | **44** | 2.6% [1.9%, 3.4%] | 71.3% | 0.934 [0.926, 0.941] | 0.974 | 0.896 | 0.584 | 0.962 | 0.364 | 18/378 | 134 | 0 | 2 | 308M |  |
| nym-base | **47** | 2.8% [2.0%, 3.6%] | 71.5% | 0.931 [0.924, 0.939] | 0.973 | 0.893 | 0.587 | 0.959 | 0.365 | 22/378 | 166 | 0 | 2 | 308M |  |
| pplx+homoglyph | **58** | 3.5% [2.6%, 4.3%] | 93.8% | 0.905 [0.896, 0.913] | 0.844 | 0.975 | 0.679 | 0.889 | 0.846 | 48/378 | 493 | 0 | 50 | 596M |  |
| pplx | **58** | 3.5% [2.6%, 4.3%] | 93.7% | 0.904 [0.895, 0.912] | 0.842 | 0.975 | 0.678 | 0.888 | 0.844 | 51/378 | 513 | 0 | 49 | 596M |  |
| nym-small | **82** | 4.9% [3.9%, 6.0%] | 62.9% | 0.901 [0.891, 0.911] | 0.952 | 0.855 | 0.498 | 0.931 | 0.321 | 40/378 | 569 | 0 | 34 | - |  |
| mmbert32k | **83** | 5.0% [4.0%, 6.1%] | 61.8% | 0.853 [0.840, 0.865] | 0.843 | 0.864 | 0.410 | 0.833 | 0.411 | 70/378 | 1383 | 0 | 3 | 308M |  |
| opf-ru | **146** | 8.8% [7.4%, 10.3%] | 63.5% | 0.829 [0.813, 0.843] | 0.844 | 0.815 | 0.467 | 0.811 | 0.734 | 172/378 | 3214 | 0 | 30 | 1.4B |  |
| apararti | **164** | 9.8% [8.4%, 11.3%] | 80.4% | 0.862 [0.848, 0.875] | 0.831 | 0.896 | 0.591 | 0.848 | 0.734 | 75/378 | 1650 | 0 | 54 | 1.4B |  |
| traciora | **182** | 10.9% [9.4%, 12.5%] | 74.2% | 0.823 [0.808, 0.838] | 0.763 | 0.893 | 0.524 | 0.791 | 0.757 | 162/378 | 3787 | 0 | 42 | 1.4B |  |
| ru-pii-ner | **186** | 11.2% [9.6%, 12.8%] | 83.3% | 0.854 [0.829, 0.879] | 0.969 | 0.764 | 0.811 | 0.920 | 0.393 | 26/378 | 242 | 0 | 42 | 358M |  |
| ru-legal-ner | **191** | 11.5% [9.9%, 13.0%] | 68.9% | 0.747 [0.728, 0.767] | 0.680 | 0.830 | 0.489 | 0.721 | 0.503 | 217/378 | 7584 | 0 | 1 | 29M |  |
| ru-legal-ner+homoglyph | **195** | 11.7% [10.2%, 13.3%] | 68.6% | 0.756 [0.736, 0.776] | 0.699 | 0.824 | 0.502 | 0.742 | 0.508 | 170/378 | 6326 | 0 | 1 | 29M |  |
| pii-shield-onnx | **202** | 12.1% [10.6%, 13.7%] | 71.3% | 0.825 [0.805, 0.843] | 0.795 | 0.857 | 0.542 | 0.815 | 0.722 | 162/378 | 5178 | 0 | 943 | - |  |
| opf-ru-v2 | **213** | 12.8% [11.3%, 14.5%] | 68.3% | 0.874 [0.860, 0.887] | 0.920 | 0.832 | 0.569 | 0.872 | 0.823 | 45/378 | 559 | 0 | 207 | 1.4B |  |
| opf-ru-v2+homoglyph | **215** | 12.9% [11.3%, 14.6%] | 68.7% | 0.873 [0.860, 0.887] | 0.920 | 0.831 | 0.575 | 0.874 | 0.827 | 39/378 | 489 | 0 | 64 | 1.4B |  |
| opf-kz-ru | **216** | 13.0% [11.3%, 14.7%] | 73.2% | 0.833 [0.818, 0.847] | 0.838 | 0.828 | 0.471 | 0.849 | 0.753 | 49/378 | 854 | 0 | 49 | 1.4B |  |
| gliner2-fastino-ru | **237** | 14.2% [12.6%, 16.0%] | 79.7% | 0.788 [0.760, 0.815] | 0.982 | 0.658 | 0.830 | 0.913 | 0.718 | 12/378 | 91 | 0 | 13 | 307M |  |
| nuner-zero | **262** | 15.7% [14.1%, 17.5%] | 67.2% | 0.771 [0.751, 0.790] | 0.783 | 0.759 | 0.406 | 0.738 | 0.732 | 73/378 | 703 | 0 | 4 | 449M |  |
| gliner-nvidia-ru | **263** | 15.8% [14.0%, 17.7%] | 71.1% | 0.811 [0.792, 0.831] | 0.893 | 0.743 | 0.675 | 0.838 | 0.743 | 63/378 | 638 | 0 | 26 | 445M |  |
| openmed-multilingual | **266** | 16.0% [14.3%, 17.8%] | 53.7% | 0.783 [0.765, 0.800] | 0.869 | 0.713 | 0.444 | 0.797 | 0.656 | 118/378 | 1253 | 0 | 26 | 1.4B |  |
| gliner2-hivetrace-omni-ru | **304** | 18.2% [16.5%, 20.3%] | 73.8% | 0.741 [0.714, 0.768] | 0.945 | 0.610 | 0.756 | 0.863 | 0.704 | 40/378 | 426 | 0 | 11 | 307M |  |
| bardsai-eu | **329** | 19.7% [17.8%, 21.9%] | 59.5% | 0.851 [0.836, 0.865] | 0.955 | 0.767 | 0.563 | 0.864 | 0.272 | 10/378 | 84 | 0 | 414 | - |  |
| gliner-nvidia+homoglyph | **345** | 20.7% [18.8%, 22.8%] | 68.7% | 0.733 [0.710, 0.752] | 0.725 | 0.741 | 0.497 | 0.699 | 0.681 | 118/378 | 2110 | 0 | 8 | 445M |  |
| gliner-nvidia | **356** | 21.4% [19.4%, 23.5%] | 68.4% | 0.728 [0.706, 0.747] | 0.723 | 0.733 | 0.496 | 0.696 | 0.675 | 115/378 | 2020 | 0 | 4 | 445M |  |
| openai-base | **375** | 22.5% [20.3%, 24.7%] | 68.6% | 0.822 [0.805, 0.839] | 0.851 | 0.795 | 0.545 | 0.819 | 0.732 | 38/378 | 840 | 0 | 66 | 1.4B |  |
| gravitee-small | **418** | 25.1% [23.1%, 27.1%] | 62.6% | 0.543 [0.524, 0.561] | 0.462 | 0.658 | 0.261 | 0.608 | 0.407 | 170/378 | 3906 | 0 | 2 | 29M |  |
| gliner-pii-edge | **423** | 25.4% [23.3%, 27.6%] | 63.2% | 0.650 [0.623, 0.676] | 0.760 | 0.567 | 0.557 | 0.714 | 0.475 | 151/378 | 2440 | 0 | 14 | 45M |  |
| gliner2-vladlinv-ru | **448** | 26.9% [24.6%, 29.1%] | 68.3% | 0.765 [0.738, 0.793] | 0.982 | 0.627 | 0.762 | 0.836 | 0.751 | 16/378 | 157 | 0 | 6 | 287M |  |
| gliner-urchade-ru | **452** | 27.1% [25.0%, 29.2%] | 69.2% | 0.733 [0.705, 0.762] | 0.961 | 0.593 | 0.762 | 0.821 | 0.729 | 18/378 | 181 | 0 | 8 | 289M |  |
| gliner-stream-pii | **486** | 29.2% [26.8%, 31.5%] | 41.8% | 0.677 [0.649, 0.703] | 0.913 | 0.537 | 0.412 | 0.759 | 0.595 | 83/378 | 551 | 0 | 31 | 677M |  |
| gliner2-fastino | **505** | 30.3% [28.2%, 32.4%] | 64.4% | 0.692 [0.666, 0.719] | 0.923 | 0.553 | 0.682 | 0.785 | 0.631 | 36/378 | 323 | 0 | 3 | 307M |  |
| gliner25-fastino-ru | **517** | 31.0% [28.7%, 33.4%] | 62.1% | 0.717 [0.688, 0.745] | 0.956 | 0.574 | 0.651 | 0.803 | 0.704 | 14/378 | 147 | 1 | 7 | 287M |  |
| gliner-urchade | **555** | 33.3% [31.0%, 35.6%] | 62.6% | 0.687 [0.660, 0.714] | 0.838 | 0.583 | 0.578 | 0.707 | 0.669 | 65/378 | 680 | 0 | 3 | 289M |  |
| kalyan-ettin | **560** | 33.6% [31.2%, 35.9%] | 37.7% | 0.725 [0.701, 0.747] | 0.908 | 0.603 | 0.359 | 0.735 | 0.520 | 68/378 | 718 | 0 | 2 | 68M |  |
| gliner2-vladlinv+homoglyph | **575** | 34.5% [32.0%, 37.0%] | 60.8% | 0.723 [0.693, 0.752] | 0.978 | 0.573 | 0.704 | 0.779 | 0.710 | 20/378 | 149 | 0 | 4 | 287M |  |
| gliner2-vladlinv | **579** | 34.7% [32.2%, 37.3%] | 60.6% | 0.721 [0.690, 0.749] | 0.978 | 0.571 | 0.704 | 0.779 | 0.707 | 17/378 | 156 | 0 | 2 | 287M |  |
| gliner2-hivetrace-uni | **588** | 35.3% [33.0%, 37.6%] | 50.7% | 0.576 [0.548, 0.603] | 0.855 | 0.435 | 0.549 | 0.724 | 0.449 | 103/378 | 1421 | 0 | 14 | 147M |  |
| gliner2-hivetrace-omni | **613** | 36.8% [34.5%, 39.1%] | 57.7% | 0.684 [0.653, 0.710] | 0.936 | 0.538 | 0.662 | 0.738 | 0.643 | 39/378 | 382 | 0 | 3 | 307M |  |
| openmed-nemotron | **626** | 37.6% [35.1%, 40.0%] | 32.1% | 0.594 [0.569, 0.618] | 0.584 | 0.605 | 0.234 | 0.530 | 0.482 | 184/378 | 3929 | 0 | 27 | 1.4B |  |
| gliner2-large | **668** | 40.1% [37.6%, 42.3%] | 49.9% | 0.588 [0.561, 0.615] | 0.776 | 0.474 | 0.441 | 0.630 | 0.527 | 98/378 | 847 | 0 | 4 | 486M |  |
| fef2-secret-ru | **669** | 40.1% [37.6%, 42.7%] | 45.5% | 0.683 [0.656, 0.706] | 0.848 | 0.571 | 0.372 | 0.678 | 0.151 | 24/378 | 302 | 0 | 2 | 177M |  |
| gliner25-fastino | **775** | 46.5% [43.9%, 49.1%] | 47.2% | 0.636 [0.604, 0.665] | 0.910 | 0.489 | 0.537 | 0.662 | 0.605 | 33/378 | 333 | 1 | 2 | 287M |  |
| gliner-multi-v21-ru | **872** | 52.3% [50.1%, 54.8%] | 31.4% | 0.490 [0.464, 0.516] | 0.792 | 0.355 | 0.293 | 0.531 | 0.451 | 22/378 | 241 | 0 | 10 | 289M |  |
| rules-ru | **904** | 54.2% [51.9%, 56.6%] | 41.6% | 0.564 [0.532, 0.599] | 0.989 | 0.395 | 0.561 | 0.625 | 0.535 | 0/378 | 0 | 0 | 0 | - |  |
| gliner-multi-v21 | **931** | 55.8% [53.4%, 58.4%] | 28.0% | 0.454 [0.427, 0.481] | 0.740 | 0.328 | 0.268 | 0.505 | 0.380 | 58/378 | 928 | 0 | 2 | 289M |  |
| ner-ru-yqelz | **1113** | 66.8% [64.6%, 68.9%] | 19.6% | 0.352 [0.325, 0.379] | 0.551 | 0.259 | 0.190 | 0.379 | 0.113 | 121/378 | 1759 | 0 | 2 | 559M |  |
| stanza-ru | **1121** | 67.2% [65.0%, 69.4%] | 21.3% | 0.322 [0.297, 0.347] | 0.370 | 0.285 | 0.138 | 0.323 | 0.090 | 185/378 | 4595 | 0 | 18 | - |  |
| gliner-pii-base | **1136** | 68.1% [65.9%, 70.4%] | 29.6% | 0.477 [0.447, 0.508] | 0.904 | 0.324 | 0.406 | 0.458 | 0.471 | 29/378 | 265 | 0 | 2 | 166M |  |
| ner-ru-gherman+homoglyph | **1193** | 71.6% [69.4%, 73.8%] | 1.4% | 0.386 [0.355, 0.417] | 0.928 | 0.243 | 0.015 | 0.427 | 0.112 | 18/378 | 127 | 0 | 2 | 177M |  |
| ner-ru-gherman | **1206** | 72.3% [70.1%, 74.5%] | 1.4% | 0.376 [0.345, 0.407] | 0.925 | 0.236 | 0.016 | 0.418 | 0.109 | 19/378 | 128 | 0 | 2 | 177M |  |
| gliner2-hivetrace-uni-ru | **1232** | 73.9% [71.8%, 76.0%] | 21.5% | 0.279 [0.253, 0.306] | 0.837 | 0.167 | 0.308 | 0.392 | 0.216 | 53/378 | 621 | 0 | 12 | 147M |  |
| davlan-xlmr | **1288** | 77.3% [75.2%, 79.2%] | 12.5% | 0.320 [0.292, 0.345] | 0.886 | 0.195 | 0.183 | 0.347 | 0.149 | 13/378 | 256 | 0 | 2 | 277M |  |
| davlan-mbert | **1293** | 77.6% [75.4%, 79.7%] | 11.6% | 0.291 [0.265, 0.318] | 0.793 | 0.179 | 0.161 | 0.327 | 0.132 | 28/378 | 192 | 0 | 2 | 177M |  |
| spacy-ru-lg | **1315** | 78.9% [77.0%, 80.9%] | 12.4% | 0.235 [0.209, 0.260] | 0.429 | 0.162 | 0.128 | 0.267 | 0.071 | 146/378 | 2767 | 0 | 2 | - |  |
| natasha | **1387** | 83.2% [81.4%, 85.1%] | 9.1% | 0.185 [0.164, 0.207] | 0.562 | 0.111 | 0.121 | 0.258 | 0.084 | 33/378 | 715 | 0 | 1 | - |  |
| spacy-alrosait | **1460** | 87.6% [86.0%, 89.4%] | 6.8% | 0.219 [0.186, 0.250] | 0.919 | 0.125 | 0.112 | 0.217 | 0.155 | 8/378 | 73 | 0 | 2 | - |  |

Neighbours by rank a paired bootstrap cannot tell apart (95%, missed %) - pairs, not a transitive chain, so `a ≈ b` and `b ≈ c` do not make `a ≈ c`: nym-base+homoglyph ≈ nym-base; nym-base ≈ pplx+homoglyph; pplx+homoglyph ≈ pplx; nym-small ≈ mmbert32k; opf-ru ≈ apararti; apararti ≈ traciora; traciora ≈ ru-pii-ner; ru-pii-ner ≈ ru-legal-ner; ru-legal-ner ≈ ru-legal-ner+homoglyph; ru-legal-ner+homoglyph ≈ pii-shield-onnx; pii-shield-onnx ≈ opf-ru-v2; opf-ru-v2 ≈ opf-ru-v2+homoglyph; opf-ru-v2+homoglyph ≈ opf-kz-ru; opf-kz-ru ≈ gliner2-fastino-ru; gliner2-fastino-ru ≈ nuner-zero; nuner-zero ≈ gliner-nvidia-ru; gliner-nvidia-ru ≈ openmed-multilingual; openmed-multilingual ≈ gliner2-hivetrace-omni-ru; gliner2-hivetrace-omni-ru ≈ bardsai-eu; bardsai-eu ≈ gliner-nvidia+homoglyph; gliner-nvidia ≈ openai-base; openai-base ≈ gravitee-small; gravitee-small ≈ gliner-pii-edge; gliner-pii-edge ≈ gliner2-vladlinv-ru; gliner2-vladlinv-ru ≈ gliner-urchade-ru; gliner-urchade-ru ≈ gliner-stream-pii; gliner-stream-pii ≈ gliner2-fastino; gliner2-fastino ≈ gliner25-fastino-ru; gliner25-fastino-ru ≈ gliner-urchade; gliner-urchade ≈ kalyan-ettin; kalyan-ettin ≈ gliner2-vladlinv+homoglyph; gliner2-vladlinv+homoglyph ≈ gliner2-vladlinv; gliner2-vladlinv ≈ gliner2-hivetrace-uni; gliner2-hivetrace-uni ≈ gliner2-hivetrace-omni; gliner2-hivetrace-omni ≈ openmed-nemotron; openmed-nemotron ≈ gliner2-large; gliner2-large ≈ fef2-secret-ru; gliner-multi-v21-ru ≈ rules-ru; rules-ru ≈ gliner-multi-v21; ner-ru-yqelz ≈ stanza-ru; stanza-ru ≈ gliner-pii-base; ner-ru-gherman ≈ gliner2-hivetrace-uni-ru; davlan-xlmr ≈ davlan-mbert; davlan-mbert ≈ spacy-ru-lg

## Missed by group

| model | PERSON | ADDRESS | CONTACT | ID | SECRET |
|---|---|---|---|---|---|
| spans in gold | 228 | 176 | 390 | 778 | 95 |
| nym-base+homoglyph | 6 (2.6%) | 5 (2.8%) | 15 (3.8%) | 17 (2.2%) | 1 (1.1%) |
| nym-base | 10 (4.4%) | 5 (2.8%) | 14 (3.6%) | 17 (2.2%) | 1 (1.1%) |
| pplx+homoglyph | 10 (4.4%) | 3 (1.7%) | 2 (0.5%) | 41 (5.3%) | 2 (2.1%) |
| pplx | 9 (3.9%) | 3 (1.7%) | 2 (0.5%) | 42 (5.4%) | 2 (2.1%) |
| nym-small | 23 (10.1%) | 2 (1.1%) | 8 (2.1%) | 48 (6.2%) | 1 (1.1%) |
| mmbert32k | 20 (8.8%) | 3 (1.7%) | 2 (0.5%) | 56 (7.2%) | 2 (2.1%) |
| opf-ru | 29 (12.7%) | 17 (9.7%) | 15 (3.8%) | 82 (10.5%) | 3 (3.2%) |
| apararti | 53 (23.2%) | 25 (14.2%) | 5 (1.3%) | 81 (10.4%) | 0 (0.0%) |
| traciora | 28 (12.3%) | 15 (8.5%) | 15 (3.8%) | 120 (15.4%) | 4 (4.2%) |
| ru-pii-ner | 1 (0.4%) | 20 (11.4%) | 5 (1.3%) | 90 (11.6%) | 70 (73.7%) |
| ru-legal-ner | 15 (6.6%) | 22 (12.5%) | 36 (9.2%) | 114 (14.7%) | 4 (4.2%) |
| ru-legal-ner+homoglyph | 16 (7.0%) | 26 (14.8%) | 35 (9.0%) | 114 (14.7%) | 4 (4.2%) |
| pii-shield-onnx | 24 (10.5%) | 28 (15.9%) | 5 (1.3%) | 143 (18.4%) | 2 (2.1%) |
| opf-ru-v2 | 55 (24.1%) | 33 (18.8%) | 34 (8.7%) | 87 (11.2%) | 4 (4.2%) |
| opf-ru-v2+homoglyph | 52 (22.8%) | 38 (21.6%) | 35 (9.0%) | 86 (11.1%) | 4 (4.2%) |
| opf-kz-ru | 61 (26.8%) | 49 (27.8%) | 13 (3.3%) | 89 (11.4%) | 4 (4.2%) |
| gliner2-fastino-ru | 36 (15.8%) | 113 (64.2%) | 24 (6.2%) | 20 (2.6%) | 44 (46.3%) |
| nuner-zero | 26 (11.4%) | 5 (2.8%) | 17 (4.4%) | 170 (21.9%) | 44 (46.3%) |
| gliner-nvidia-ru | 25 (11.0%) | 57 (32.4%) | 31 (7.9%) | 117 (15.0%) | 33 (34.7%) |
| openmed-multilingual | 80 (35.1%) | 33 (18.8%) | 22 (5.6%) | 125 (16.1%) | 6 (6.3%) |
| gliner2-hivetrace-omni-ru | 13 (5.7%) | 39 (22.2%) | 60 (15.4%) | 110 (14.1%) | 82 (86.3%) |
| bardsai-eu | 33 (14.5%) | 22 (12.5%) | 44 (11.3%) | 219 (28.1%) | 11 (11.6%) |
| gliner-nvidia+homoglyph | 31 (13.6%) | 58 (33.0%) | 44 (11.3%) | 200 (25.7%) | 12 (12.6%) |
| gliner-nvidia | 35 (15.4%) | 63 (35.8%) | 44 (11.3%) | 202 (26.0%) | 12 (12.6%) |
| openai-base | 70 (30.7%) | 41 (23.3%) | 31 (7.9%) | 225 (28.9%) | 8 (8.4%) |
| gravitee-small | 87 (38.2%) | 17 (9.7%) | 49 (12.6%) | 202 (26.0%) | 63 (66.3%) |
| gliner-pii-edge | 71 (31.1%) | 85 (48.3%) | 63 (16.2%) | 144 (18.5%) | 60 (63.2%) |
| gliner2-vladlinv-ru | 19 (8.3%) | 48 (27.3%) | 45 (11.5%) | 275 (35.3%) | 61 (64.2%) |
| gliner-urchade-ru | 139 (61.0%) | 58 (33.0%) | 72 (18.5%) | 114 (14.7%) | 69 (72.6%) |
| gliner-stream-pii | 82 (36.0%) | 76 (43.2%) | 144 (36.9%) | 164 (21.1%) | 20 (21.1%) |
| gliner2-fastino | 34 (14.9%) | 122 (69.3%) | 26 (6.7%) | 267 (34.3%) | 56 (58.9%) |
| gliner25-fastino-ru | 32 (14.0%) | 19 (10.8%) | 35 (9.0%) | 338 (43.4%) | 93 (97.9%) |
| gliner-urchade | 7 (3.1%) | 61 (34.7%) | 40 (10.3%) | 386 (49.6%) | 61 (64.2%) |
| kalyan-ettin | 54 (23.7%) | 76 (43.2%) | 53 (13.6%) | 375 (48.2%) | 2 (2.1%) |
| gliner2-vladlinv+homoglyph | 15 (6.6%) | 50 (28.4%) | 43 (11.0%) | 400 (51.4%) | 67 (70.5%) |
| gliner2-vladlinv | 15 (6.6%) | 52 (29.5%) | 45 (11.5%) | 400 (51.4%) | 67 (70.5%) |
| gliner2-hivetrace-uni | 36 (15.8%) | 109 (61.9%) | 77 (19.7%) | 280 (36.0%) | 86 (90.5%) |
| gliner2-hivetrace-omni | 17 (7.5%) | 59 (33.5%) | 43 (11.0%) | 444 (57.1%) | 50 (52.6%) |
| openmed-nemotron | 50 (21.9%) | 25 (14.2%) | 83 (21.3%) | 457 (58.7%) | 11 (11.6%) |
| gliner2-large | 82 (36.0%) | 36 (20.5%) | 55 (14.1%) | 410 (52.7%) | 85 (89.5%) |
| fef2-secret-ru | 22 (9.6%) | 29 (16.5%) | 182 (46.7%) | 391 (50.3%) | 45 (47.4%) |
| gliner25-fastino | 30 (13.2%) | 20 (11.4%) | 30 (7.7%) | 602 (77.4%) | 93 (97.9%) |
| gliner-multi-v21-ru | 32 (14.0%) | 16 (9.1%) | 196 (50.3%) | 536 (68.9%) | 92 (96.8%) |
| rules-ru | 228 (100.0%) | 176 (100.0%) | 62 (15.9%) | 356 (45.8%) | 82 (86.3%) |
| gliner-multi-v21 | 28 (12.3%) | 23 (13.1%) | 177 (45.4%) | 609 (78.3%) | 94 (98.9%) |
| ner-ru-yqelz | 34 (14.9%) | 16 (9.1%) | 353 (90.5%) | 665 (85.5%) | 45 (47.4%) |
| stanza-ru | 19 (8.3%) | 17 (9.7%) | 342 (87.7%) | 680 (87.4%) | 63 (66.3%) |
| gliner-pii-base | 123 (53.9%) | 146 (83.0%) | 133 (34.1%) | 682 (87.7%) | 52 (54.7%) |
| ner-ru-gherman+homoglyph | 18 (7.9%) | 11 (6.2%) | 292 (74.9%) | 777 (99.9%) | 95 (100.0%) |
| ner-ru-gherman | 21 (9.2%) | 17 (9.7%) | 296 (75.9%) | 777 (99.9%) | 95 (100.0%) |
| gliner2-hivetrace-uni-ru | 121 (53.1%) | 162 (92.0%) | 341 (87.4%) | 532 (68.4%) | 76 (80.0%) |
| davlan-xlmr | 17 (7.5%) | 17 (9.7%) | 381 (97.7%) | 778 (100.0%) | 95 (100.0%) |
| davlan-mbert | 36 (15.8%) | 26 (14.8%) | 358 (91.8%) | 778 (100.0%) | 95 (100.0%) |
| spacy-ru-lg | 74 (32.5%) | 43 (24.4%) | 363 (93.1%) | 746 (95.9%) | 89 (93.7%) |
| natasha | 86 (37.7%) | 77 (43.8%) | 362 (92.8%) | 767 (98.6%) | 95 (100.0%) |
| spacy-alrosait | 126 (55.3%) | 74 (42.0%) | 388 (99.5%) | 777 (99.9%) | 95 (100.0%) |

## Char recall by gold type

| type | group | nym-base+homoglyph | nym-base | pplx+homoglyph | pplx | nym-small | mmbert32k | opf-ru | apararti | traciora | ru-pii-ner | ru-legal-ner | ru-legal-ner+homoglyph | pii-shield-onnx | opf-ru-v2 | opf-ru-v2+homoglyph | opf-kz-ru | gliner2-fastino-ru | nuner-zero | gliner-nvidia-ru | openmed-multilingual | gliner2-hivetrace-omni-ru | bardsai-eu | gliner-nvidia+homoglyph | gliner-nvidia | openai-base | gravitee-small | gliner-pii-edge | gliner2-vladlinv-ru | gliner-urchade-ru | gliner-stream-pii | gliner2-fastino | gliner25-fastino-ru | gliner-urchade | kalyan-ettin | gliner2-vladlinv+homoglyph | gliner2-vladlinv | gliner2-hivetrace-uni | gliner2-hivetrace-omni | openmed-nemotron | gliner2-large | fef2-secret-ru | gliner25-fastino | gliner-multi-v21-ru | rules-ru | gliner-multi-v21 | ner-ru-yqelz | stanza-ru | gliner-pii-base | ner-ru-gherman+homoglyph | ner-ru-gherman | gliner2-hivetrace-uni-ru | davlan-xlmr | davlan-mbert | spacy-ru-lg | natasha | spacy-alrosait |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ADDRESS | ADDRESS | 0.720 | 0.712 | 0.985 | 0.981 | 0.678 | 0.719 | 0.532 | 0.747 | 0.839 | 0.866 | 0.670 | 0.621 | 0.591 | 0.687 | 0.677 | 0.508 | 0.216 | 0.867 | 0.462 | 0.332 | 0.435 | 0.698 | 0.510 | 0.479 | 0.706 | 0.859 | 0.313 | 0.742 | 0.534 | 0.303 | 0.191 | 0.794 | 0.536 | 0.291 | 0.727 | 0.722 | 0.134 | 0.414 | 0.555 | 0.506 | 0.451 | 0.836 | 0.555 | 0.000 | 0.530 | 0.353 | 0.475 | 0.115 | 0.691 | 0.666 | 0.023 | 0.541 | 0.449 | 0.303 | 0.209 | 0.494 |
| BANK_CARD_NUMBER | ID | 1.000 | 1.000 | 0.982 | 0.982 | 0.962 | 0.927 | 0.828 | 0.950 | 0.848 | 0.952 | 0.959 | 0.969 | 0.956 | 0.819 | 0.821 | 0.905 | 0.919 | 0.783 | 0.820 | 0.868 | 0.752 | 0.681 | 0.799 | 0.799 | 0.737 | 0.868 | 0.943 | 0.744 | 0.364 | 0.750 | 0.920 | 0.148 | 0.284 | 0.680 | 0.630 | 0.630 | 0.484 | 0.694 | 0.632 | 0.498 | 0.260 | 0.129 | 0.000 | 0.609 | 0.000 | 0.080 | 0.079 | 0.248 | 0.000 | 0.000 | 0.237 | 0.000 | 0.000 | 0.048 | 0.000 | 0.000 |
| CVC | ID | 0.781 | 0.781 | 0.482 | 0.471 | 0.608 | 0.385 | 0.327 | 0.388 | 0.133 | 0.676 | 0.115 | 0.115 | 0.241 | 0.237 | 0.259 | 0.180 | 1.000 | 0.327 | 0.464 | 0.561 | 0.896 | 0.097 | 0.496 | 0.496 | 0.144 | 0.583 | 0.356 | 0.856 | 0.730 | 0.597 | 0.727 | 0.129 | 0.277 | 0.158 | 0.432 | 0.432 | 0.435 | 0.500 | 0.158 | 0.356 | 0.094 | 0.011 | 0.054 | 0.000 | 0.076 | 0.338 | 0.097 | 0.140 | 0.011 | 0.011 | 0.435 | 0.000 | 0.000 | 0.054 | 0.032 | 0.011 |
| EMAIL | CONTACT | 0.868 | 0.882 | 0.981 | 0.986 | 0.920 | 0.901 | 0.866 | 0.964 | 0.969 | 0.965 | 0.649 | 0.641 | 0.997 | 0.818 | 0.816 | 0.912 | 0.815 | 0.981 | 0.944 | 0.841 | 0.834 | 0.635 | 0.932 | 0.932 | 0.892 | 0.746 | 0.645 | 0.807 | 0.861 | 0.640 | 0.823 | 0.852 | 0.906 | 0.857 | 0.816 | 0.801 | 0.642 | 0.823 | 0.764 | 0.790 | 0.847 | 0.856 | 0.342 | 0.832 | 0.350 | 0.025 | 0.200 | 0.739 | 0.258 | 0.253 | 0.126 | 0.014 | 0.090 | 0.135 | 0.053 | 0.000 |
| INN | ID | 0.962 | 0.962 | 1.000 | 1.000 | 0.912 | 0.951 | 0.903 | 0.969 | 0.900 | 0.941 | 0.947 | 0.947 | 0.914 | 0.930 | 0.930 | 0.973 | 0.999 | 0.771 | 0.891 | 0.821 | 0.969 | 0.797 | 0.788 | 0.788 | 0.800 | 0.564 | 0.658 | 0.712 | 0.971 | 0.616 | 0.929 | 0.827 | 0.712 | 0.393 | 0.329 | 0.329 | 0.522 | 0.198 | 0.313 | 0.207 | 0.564 | 0.114 | 0.181 | 0.679 | 0.274 | 0.157 | 0.247 | 0.041 | 0.000 | 0.000 | 0.140 | 0.000 | 0.000 | 0.073 | 0.017 | 0.000 |
| KPP | ID | 0.924 | 0.924 | 1.000 | 1.000 | 0.804 | 0.872 | 0.823 | 0.870 | 0.768 | 0.701 | 0.782 | 0.782 | 0.631 | 0.833 | 0.833 | 0.897 | 0.917 | 0.922 | 0.902 | 0.766 | 0.935 | 0.734 | 0.700 | 0.700 | 0.594 | 0.714 | 0.770 | 0.019 | 0.938 | 0.559 | 0.193 | 0.951 | 0.070 | 0.402 | 0.000 | 0.000 | 0.405 | 0.295 | 0.275 | 0.514 | 0.543 | 0.072 | 0.886 | 0.680 | 0.381 | 0.006 | 0.330 | 0.190 | 0.000 | 0.000 | 0.232 | 0.000 | 0.000 | 0.044 | 0.010 | 0.000 |
| NAME | PERSON | 0.899 | 0.879 | 0.918 | 0.922 | 0.813 | 0.785 | 0.746 | 0.752 | 0.840 | 0.988 | 0.902 | 0.905 | 0.821 | 0.713 | 0.731 | 0.691 | 0.814 | 0.843 | 0.705 | 0.501 | 0.907 | 0.840 | 0.716 | 0.697 | 0.686 | 0.587 | 0.630 | 0.873 | 0.380 | 0.577 | 0.814 | 0.813 | 0.936 | 0.600 | 0.879 | 0.879 | 0.796 | 0.894 | 0.641 | 0.589 | 0.865 | 0.814 | 0.824 | 0.000 | 0.849 | 0.820 | 0.913 | 0.440 | 0.831 | 0.806 | 0.438 | 0.901 | 0.817 | 0.620 | 0.588 | 0.333 |
| OGRN | ID | 0.977 | 0.977 | 0.988 | 0.988 | 0.890 | 0.924 | 0.901 | 0.913 | 0.892 | 0.708 | 0.979 | 0.979 | 0.927 | 0.950 | 0.950 | 0.934 | 0.969 | 0.744 | 0.890 | 0.711 | 0.857 | 0.834 | 0.686 | 0.686 | 0.700 | 0.685 | 0.860 | 0.021 | 0.852 | 0.625 | 0.477 | 0.115 | 0.672 | 0.408 | 0.106 | 0.106 | 0.703 | 0.330 | 0.185 | 0.374 | 0.552 | 0.051 | 0.461 | 0.711 | 0.209 | 0.306 | 0.044 | 0.032 | 0.000 | 0.000 | 0.237 | 0.000 | 0.000 | 0.106 | 0.052 | 0.000 |
| OGRNIP | ID | 0.970 | 0.970 | 0.999 | 0.999 | 0.898 | 0.981 | 0.955 | 0.978 | 0.944 | 0.994 | 0.988 | 0.988 | 0.927 | 0.921 | 0.929 | 0.996 | 0.965 | 0.774 | 0.787 | 0.736 | 0.645 | 0.890 | 0.733 | 0.733 | 0.808 | 0.905 | 0.895 | 0.791 | 0.922 | 0.597 | 0.233 | 0.081 | 0.756 | 0.581 | 0.661 | 0.661 | 0.641 | 0.114 | 0.541 | 0.281 | 0.483 | 0.016 | 0.624 | 0.707 | 0.130 | 0.010 | 0.027 | 0.046 | 0.000 | 0.000 | 0.240 | 0.000 | 0.000 | 0.012 | 0.000 | 0.000 |
| PASSPORT_NUMBER | ID | 0.901 | 0.898 | 0.909 | 0.916 | 0.787 | 0.769 | 0.758 | 0.896 | 0.780 | 0.909 | 0.825 | 0.840 | 0.677 | 0.768 | 0.754 | 0.921 | 0.876 | 0.748 | 0.776 | 0.691 | 0.729 | 0.619 | 0.832 | 0.817 | 0.807 | 0.685 | 0.776 | 0.852 | 0.811 | 0.440 | 0.844 | 0.815 | 0.805 | 0.324 | 0.876 | 0.880 | 0.554 | 0.797 | 0.398 | 0.757 | 0.549 | 0.828 | 0.038 | 0.226 | 0.234 | 0.061 | 0.037 | 0.225 | 0.000 | 0.000 | 0.466 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 |
| PHONE_NUMBER | CONTACT | 0.991 | 0.991 | 0.998 | 0.998 | 0.975 | 0.935 | 0.950 | 0.990 | 0.918 | 1.000 | 0.948 | 0.951 | 0.979 | 0.906 | 0.907 | 0.967 | 0.950 | 0.912 | 0.831 | 0.857 | 0.779 | 0.809 | 0.789 | 0.789 | 0.909 | 0.875 | 0.915 | 0.913 | 0.778 | 0.446 | 0.938 | 0.889 | 0.867 | 0.595 | 0.916 | 0.916 | 0.786 | 0.883 | 0.586 | 0.848 | 0.212 | 0.902 | 0.403 | 0.700 | 0.455 | 0.106 | 0.017 | 0.583 | 0.010 | 0.010 | 0.068 | 0.010 | 0.010 | 0.016 | 0.023 | 0.001 |
| SNILS | ID | 1.000 | 1.000 | 1.000 | 1.000 | 0.914 | 0.925 | 0.827 | 0.926 | 0.868 | 0.909 | 0.933 | 0.931 | 0.919 | 0.912 | 0.912 | 0.900 | 0.957 | 0.669 | 0.840 | 0.649 | 0.865 | 0.671 | 0.433 | 0.433 | 0.743 | 0.807 | 0.783 | 0.933 | 0.964 | 0.612 | 0.666 | 0.942 | 0.153 | 0.382 | 0.554 | 0.554 | 0.750 | 0.336 | 0.197 | 0.588 | 0.561 | 0.232 | 0.137 | 0.467 | 0.221 | 0.022 | 0.036 | 0.043 | 0.000 | 0.000 | 0.234 | 0.000 | 0.000 | 0.010 | 0.000 | 0.000 |
| TOKEN | SECRET | 0.933 | 0.925 | 0.993 | 0.993 | 0.910 | 0.937 | 0.975 | 0.992 | 0.994 | 0.148 | 0.884 | 0.891 | 0.998 | 0.961 | 0.961 | 0.946 | 0.304 | 0.424 | 0.725 | 0.978 | 0.084 | 0.916 | 0.875 | 0.875 | 0.918 | 0.232 | 0.198 | 0.145 | 0.177 | 0.611 | 0.262 | 0.013 | 0.238 | 0.976 | 0.105 | 0.105 | 0.010 | 0.322 | 0.907 | 0.044 | 0.663 | 0.013 | 0.019 | 0.314 | 0.007 | 0.330 | 0.233 | 0.399 | 0.000 | 0.000 | 0.080 | 0.000 | 0.000 | 0.059 | 0.000 | 0.000 |

## char F1 by domain

| domain | n | nym-base+homoglyph | nym-base | pplx+homoglyph | pplx | nym-small | mmbert32k | opf-ru | apararti | traciora | ru-pii-ner | ru-legal-ner | ru-legal-ner+homoglyph | pii-shield-onnx | opf-ru-v2 | opf-ru-v2+homoglyph | opf-kz-ru | gliner2-fastino-ru | nuner-zero | gliner-nvidia-ru | openmed-multilingual | gliner2-hivetrace-omni-ru | bardsai-eu | gliner-nvidia+homoglyph | gliner-nvidia | openai-base | gravitee-small | gliner-pii-edge | gliner2-vladlinv-ru | gliner-urchade-ru | gliner-stream-pii | gliner2-fastino | gliner25-fastino-ru | gliner-urchade | kalyan-ettin | gliner2-vladlinv+homoglyph | gliner2-vladlinv | gliner2-hivetrace-uni | gliner2-hivetrace-omni | openmed-nemotron | gliner2-large | fef2-secret-ru | gliner25-fastino | gliner-multi-v21-ru | rules-ru | gliner-multi-v21 | ner-ru-yqelz | stanza-ru | gliner-pii-base | ner-ru-gherman+homoglyph | ner-ru-gherman | gliner2-hivetrace-uni-ru | davlan-xlmr | davlan-mbert | spacy-ru-lg | natasha | spacy-alrosait |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ADDRESS | 70 | 0.784 | 0.788 | 0.869 | 0.869 | 0.753 | 0.836 | 0.664 | 0.858 | 0.884 | 0.921 | 0.804 | 0.773 | 0.745 | 0.828 | 0.828 | 0.722 | 0.246 | 0.892 | 0.542 | 0.473 | 0.507 | 0.780 | 0.577 | 0.541 | 0.821 | 0.812 | 0.595 | 0.874 | 0.641 | 0.490 | 0.200 | 0.860 | 0.675 | 0.520 | 0.866 | 0.874 | 0.211 | 0.489 | 0.708 | 0.677 | 0.635 | 0.899 | 0.713 | 0.000 | 0.698 | 0.452 | 0.603 | 0.075 | 0.848 | 0.832 | 0.051 | 0.644 | 0.600 | 0.502 | 0.382 | 0.624 |
| BANK_CARD_NUMBER | 70 | 1.000 | 1.000 | 0.930 | 0.930 | 0.972 | 0.944 | 0.913 | 0.893 | 0.896 | 0.994 | 0.931 | 0.931 | 0.988 | 0.866 | 0.866 | 0.881 | 0.948 | 0.841 | 0.884 | 0.931 | 0.810 | 0.776 | 0.869 | 0.869 | 0.762 | 0.596 | 0.924 | 0.880 | 0.320 | 0.903 | 0.953 | 0.262 | 0.191 | 0.899 | 0.814 | 0.814 | 0.725 | 0.788 | 0.636 | 0.630 | 0.398 | 0.101 | 0.000 | 0.838 | 0.000 | 0.110 | 0.099 | 0.275 | 0.000 | 0.000 | 0.379 | 0.000 | 0.000 | 0.115 | 0.000 | 0.000 |
| CVC | 70 | 0.783 | 0.783 | 0.542 | 0.565 | 0.627 | 0.386 | 0.373 | 0.336 | 0.128 | 0.745 | 0.079 | 0.080 | 0.272 | 0.311 | 0.336 | 0.210 | 0.973 | 0.289 | 0.517 | 0.584 | 0.921 | 0.142 | 0.412 | 0.412 | 0.211 | 0.274 | 0.346 | 0.823 | 0.798 | 0.695 | 0.606 | 0.206 | 0.321 | 0.232 | 0.556 | 0.556 | 0.566 | 0.649 | 0.109 | 0.266 | 0.079 | 0.019 | 0.063 | 0.000 | 0.090 | 0.301 | 0.071 | 0.179 | 0.021 | 0.021 | 0.507 | 0.000 | 0.000 | 0.045 | 0.044 | 0.022 |
| EMAIL | 70 | 0.922 | 0.926 | 0.919 | 0.923 | 0.957 | 0.918 | 0.934 | 0.963 | 0.938 | 0.985 | 0.681 | 0.681 | 0.985 | 0.913 | 0.901 | 0.959 | 0.859 | 0.935 | 0.935 | 0.924 | 0.888 | 0.748 | 0.875 | 0.875 | 0.940 | 0.658 | 0.796 | 0.908 | 0.903 | 0.808 | 0.879 | 0.910 | 0.895 | 0.920 | 0.910 | 0.897 | 0.757 | 0.901 | 0.760 | 0.852 | 0.853 | 0.903 | 0.479 | 0.888 | 0.477 | 0.035 | 0.368 | 0.819 | 0.391 | 0.393 | 0.241 | 0.000 | 0.090 | 0.219 | 0.108 | 0.000 |
| INN | 70 | 0.938 | 0.938 | 0.901 | 0.901 | 0.938 | 0.915 | 0.903 | 0.874 | 0.787 | 1.000 | 0.894 | 0.894 | 0.909 | 0.949 | 0.949 | 0.776 | 0.999 | 0.757 | 0.853 | 0.865 | 0.948 | 0.873 | 0.653 | 0.653 | 0.796 | 0.436 | 0.667 | 0.940 | 0.956 | 0.776 | 0.936 | 0.912 | 0.724 | 0.561 | 0.583 | 0.583 | 0.693 | 0.375 | 0.405 | 0.200 | 0.672 | 0.138 | 0.195 | 0.807 | 0.443 | 0.275 | 0.280 | 0.000 | 0.000 | 0.000 | 0.226 | 0.000 | 0.000 | 0.126 | 0.045 | 0.000 |
| KPP | 70 | 0.960 | 0.960 | 0.880 | 0.880 | 0.901 | 0.747 | 0.818 | 0.755 | 0.754 | 0.847 | 0.739 | 0.739 | 0.728 | 0.878 | 0.878 | 0.747 | 0.954 | 0.740 | 0.850 | 0.771 | 0.960 | 0.788 | 0.649 | 0.649 | 0.636 | 0.374 | 0.681 | 0.051 | 0.943 | 0.757 | 0.337 | 0.911 | 0.123 | 0.597 | 0.000 | 0.000 | 0.568 | 0.386 | 0.293 | 0.568 | 0.677 | 0.101 | 0.835 | 0.807 | 0.583 | 0.011 | 0.290 | 0.366 | 0.000 | 0.000 | 0.340 | 0.000 | 0.000 | 0.022 | 0.021 | 0.000 |
| L-CHAT | 100 | 0.920 | 0.930 | 0.861 | 0.858 | 0.895 | 0.767 | 0.732 | 0.865 | 0.653 | 0.953 | 0.539 | 0.573 | 0.726 | 0.708 | 0.729 | 0.836 | 0.864 | 0.851 | 0.817 | 0.772 | 0.789 | 0.785 | 0.805 | 0.782 | 0.738 | 0.445 | 0.684 | 0.769 | 0.770 | 0.590 | 0.804 | 0.872 | 0.898 | 0.822 | 0.830 | 0.806 | 0.781 | 0.855 | 0.498 | 0.775 | 0.692 | 0.864 | 0.602 | 0.738 | 0.641 | 0.305 | 0.316 | 0.759 | 0.423 | 0.417 | 0.294 | 0.391 | 0.441 | 0.289 | 0.399 | 0.114 |
| L-DIALOG | 100 | 0.870 | 0.857 | 0.747 | 0.746 | 0.756 | 0.611 | 0.497 | 0.531 | 0.495 | 0.842 | 0.319 | 0.354 | 0.375 | 0.705 | 0.680 | 0.587 | 0.775 | 0.745 | 0.758 | 0.513 | 0.736 | 0.795 | 0.382 | 0.391 | 0.634 | 0.369 | 0.536 | 0.750 | 0.884 | 0.454 | 0.757 | 0.795 | 0.717 | 0.488 | 0.719 | 0.715 | 0.444 | 0.709 | 0.377 | 0.553 | 0.448 | 0.827 | 0.435 | 0.482 | 0.281 | 0.293 | 0.115 | 0.630 | 0.420 | 0.413 | 0.186 | 0.360 | 0.352 | 0.221 | 0.063 | 0.337 |
| NAME | 70 | 0.938 | 0.929 | 0.805 | 0.798 | 0.910 | 0.841 | 0.843 | 0.828 | 0.895 | 0.993 | 0.897 | 0.888 | 0.947 | 0.832 | 0.827 | 0.754 | 0.887 | 0.846 | 0.795 | 0.599 | 0.920 | 0.836 | 0.734 | 0.692 | 0.700 | 0.437 | 0.648 | 0.935 | 0.348 | 0.716 | 0.854 | 0.865 | 0.926 | 0.697 | 0.931 | 0.928 | 0.826 | 0.900 | 0.565 | 0.638 | 0.889 | 0.856 | 0.857 | 0.000 | 0.881 | 0.898 | 0.911 | 0.535 | 0.911 | 0.897 | 0.499 | 0.949 | 0.894 | 0.757 | 0.737 | 0.499 |
| OGRN | 70 | 0.987 | 0.987 | 0.834 | 0.834 | 0.916 | 0.833 | 0.930 | 0.845 | 0.867 | 0.848 | 0.905 | 0.905 | 0.923 | 0.926 | 0.926 | 0.796 | 0.972 | 0.724 | 0.836 | 0.705 | 0.904 | 0.910 | 0.660 | 0.660 | 0.708 | 0.431 | 0.842 | 0.027 | 0.920 | 0.807 | 0.617 | 0.172 | 0.691 | 0.631 | 0.247 | 0.247 | 0.840 | 0.396 | 0.164 | 0.486 | 0.661 | 0.097 | 0.534 | 0.822 | 0.309 | 0.399 | 0.047 | 0.054 | 0.000 | 0.000 | 0.428 | 0.000 | 0.000 | 0.171 | 0.114 | 0.000 |
| OGRNIP | 70 | 0.981 | 0.981 | 0.896 | 0.896 | 0.940 | 0.888 | 0.934 | 0.833 | 0.852 | 0.980 | 0.869 | 0.869 | 0.940 | 0.905 | 0.909 | 0.809 | 0.978 | 0.759 | 0.824 | 0.797 | 0.775 | 0.952 | 0.703 | 0.703 | 0.773 | 0.595 | 0.810 | 0.896 | 0.952 | 0.725 | 0.367 | 0.149 | 0.744 | 0.713 | 0.838 | 0.838 | 0.791 | 0.221 | 0.519 | 0.405 | 0.594 | 0.026 | 0.649 | 0.816 | 0.214 | 0.016 | 0.037 | 0.101 | 0.000 | 0.000 | 0.401 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 |
| PASSPORT_NUMBER | 70 | 0.913 | 0.911 | 0.891 | 0.898 | 0.835 | 0.769 | 0.831 | 0.832 | 0.825 | 0.922 | 0.795 | 0.811 | 0.726 | 0.854 | 0.838 | 0.902 | 0.878 | 0.639 | 0.810 | 0.739 | 0.771 | 0.706 | 0.707 | 0.692 | 0.856 | 0.397 | 0.743 | 0.890 | 0.797 | 0.677 | 0.802 | 0.813 | 0.721 | 0.466 | 0.907 | 0.911 | 0.732 | 0.799 | 0.369 | 0.685 | 0.722 | 0.828 | 0.047 | 0.413 | 0.373 | 0.063 | 0.027 | 0.321 | 0.000 | 0.000 | 0.612 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 |
| PHONE_NUMBER | 70 | 0.993 | 0.993 | 0.808 | 0.808 | 0.970 | 0.889 | 0.945 | 0.952 | 0.891 | 0.990 | 0.921 | 0.921 | 0.942 | 0.918 | 0.918 | 0.933 | 0.987 | 0.735 | 0.839 | 0.859 | 0.853 | 0.878 | 0.630 | 0.630 | 0.921 | 0.582 | 0.900 | 0.908 | 0.767 | 0.763 | 0.952 | 0.904 | 0.808 | 0.650 | 0.908 | 0.908 | 0.884 | 0.942 | 0.546 | 0.867 | 0.341 | 0.900 | 0.535 | 0.709 | 0.660 | 0.363 | 0.000 | 0.481 | 0.000 | 0.000 | 0.139 | 0.000 | 0.000 | 0.071 | 0.045 | 0.000 |
| S-AUTO | 100 | 0.918 | 0.900 | 0.903 | 0.906 | 0.848 | 0.814 | 0.738 | 0.833 | 0.682 | 0.883 | 0.615 | 0.621 | 0.719 | 0.831 | 0.828 | 0.830 | 0.839 | 0.831 | 0.841 | 0.722 | 0.852 | 0.812 | 0.762 | 0.775 | 0.764 | 0.571 | 0.655 | 0.776 | 0.868 | 0.609 | 0.766 | 0.850 | 0.786 | 0.568 | 0.753 | 0.753 | 0.622 | 0.727 | 0.491 | 0.675 | 0.526 | 0.804 | 0.726 | 0.603 | 0.647 | 0.375 | 0.368 | 0.434 | 0.500 | 0.480 | 0.247 | 0.476 | 0.446 | 0.217 | 0.250 | 0.291 |
| S-BANK | 100 | 0.975 | 0.978 | 0.942 | 0.937 | 0.948 | 0.850 | 0.809 | 0.881 | 0.754 | 0.977 | 0.704 | 0.730 | 0.800 | 0.910 | 0.916 | 0.865 | 0.951 | 0.787 | 0.856 | 0.792 | 0.902 | 0.857 | 0.776 | 0.774 | 0.847 | 0.566 | 0.801 | 0.906 | 0.962 | 0.616 | 0.852 | 0.796 | 0.832 | 0.684 | 0.808 | 0.808 | 0.704 | 0.796 | 0.477 | 0.741 | 0.669 | 0.656 | 0.447 | 0.661 | 0.374 | 0.199 | 0.189 | 0.528 | 0.300 | 0.284 | 0.360 | 0.246 | 0.222 | 0.151 | 0.107 | 0.063 |
| S-DELIVERY | 100 | 0.904 | 0.891 | 0.902 | 0.898 | 0.882 | 0.836 | 0.728 | 0.816 | 0.779 | 0.930 | 0.743 | 0.718 | 0.733 | 0.765 | 0.738 | 0.715 | 0.812 | 0.866 | 0.813 | 0.651 | 0.891 | 0.808 | 0.813 | 0.802 | 0.779 | 0.769 | 0.609 | 0.888 | 0.713 | 0.582 | 0.792 | 0.872 | 0.836 | 0.514 | 0.878 | 0.872 | 0.627 | 0.904 | 0.685 | 0.716 | 0.683 | 0.859 | 0.729 | 0.233 | 0.728 | 0.557 | 0.620 | 0.531 | 0.685 | 0.666 | 0.290 | 0.685 | 0.620 | 0.408 | 0.361 | 0.571 |
| S-HR | 100 | 0.973 | 0.968 | 0.953 | 0.956 | 0.927 | 0.774 | 0.769 | 0.833 | 0.751 | 0.935 | 0.646 | 0.666 | 0.765 | 0.812 | 0.814 | 0.807 | 0.907 | 0.775 | 0.859 | 0.741 | 0.914 | 0.767 | 0.725 | 0.723 | 0.805 | 0.546 | 0.646 | 0.924 | 0.912 | 0.641 | 0.820 | 0.910 | 0.819 | 0.690 | 0.869 | 0.869 | 0.744 | 0.817 | 0.511 | 0.771 | 0.685 | 0.766 | 0.532 | 0.566 | 0.534 | 0.328 | 0.254 | 0.574 | 0.432 | 0.401 | 0.384 | 0.426 | 0.355 | 0.251 | 0.172 | 0.183 |
| S-RE | 100 | 0.905 | 0.903 | 0.938 | 0.932 | 0.872 | 0.847 | 0.774 | 0.873 | 0.815 | 0.961 | 0.779 | 0.777 | 0.819 | 0.852 | 0.874 | 0.796 | 0.755 | 0.795 | 0.692 | 0.677 | 0.732 | 0.876 | 0.596 | 0.584 | 0.793 | 0.666 | 0.593 | 0.832 | 0.670 | 0.454 | 0.655 | 0.851 | 0.642 | 0.542 | 0.815 | 0.805 | 0.499 | 0.628 | 0.525 | 0.614 | 0.545 | 0.830 | 0.625 | 0.508 | 0.596 | 0.277 | 0.391 | 0.450 | 0.577 | 0.568 | 0.265 | 0.455 | 0.384 | 0.250 | 0.281 | 0.432 |
| S-SUPPORT | 100 | 0.958 | 0.962 | 0.964 | 0.950 | 0.963 | 0.909 | 0.864 | 0.927 | 0.821 | 0.776 | 0.709 | 0.727 | 0.821 | 0.908 | 0.916 | 0.950 | 0.779 | 0.795 | 0.859 | 0.873 | 0.685 | 0.938 | 0.896 | 0.893 | 0.934 | 0.489 | 0.702 | 0.918 | 0.824 | 0.708 | 0.801 | 0.685 | 0.901 | 0.889 | 0.866 | 0.866 | 0.542 | 0.804 | 0.715 | 0.592 | 0.814 | 0.670 | 0.449 | 0.494 | 0.436 | 0.385 | 0.413 | 0.740 | 0.346 | 0.338 | 0.385 | 0.243 | 0.267 | 0.171 | 0.168 | 0.057 |
| S-TELECOM | 100 | 0.939 | 0.941 | 0.944 | 0.946 | 0.920 | 0.841 | 0.842 | 0.844 | 0.773 | 0.943 | 0.666 | 0.675 | 0.827 | 0.899 | 0.908 | 0.825 | 0.888 | 0.866 | 0.884 | 0.785 | 0.877 | 0.905 | 0.781 | 0.775 | 0.854 | 0.605 | 0.704 | 0.849 | 0.870 | 0.621 | 0.794 | 0.891 | 0.856 | 0.628 | 0.831 | 0.831 | 0.639 | 0.782 | 0.529 | 0.746 | 0.715 | 0.787 | 0.618 | 0.613 | 0.543 | 0.374 | 0.406 | 0.622 | 0.490 | 0.488 | 0.301 | 0.492 | 0.438 | 0.315 | 0.248 | 0.261 |
| SNILS | 70 | 0.988 | 0.988 | 0.887 | 0.887 | 0.923 | 0.857 | 0.884 | 0.851 | 0.841 | 0.975 | 0.882 | 0.882 | 0.932 | 0.925 | 0.925 | 0.845 | 0.970 | 0.750 | 0.812 | 0.763 | 0.911 | 0.810 | 0.564 | 0.564 | 0.753 | 0.490 | 0.812 | 0.976 | 0.961 | 0.764 | 0.772 | 0.956 | 0.265 | 0.499 | 0.726 | 0.726 | 0.866 | 0.536 | 0.258 | 0.665 | 0.736 | 0.318 | 0.172 | 0.637 | 0.389 | 0.035 | 0.060 | 0.089 | 0.000 | 0.000 | 0.421 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 |
| TOKEN | 70 | 0.965 | 0.961 | 0.978 | 0.977 | 0.947 | 0.959 | 0.985 | 0.991 | 0.987 | 0.219 | 0.924 | 0.928 | 0.987 | 0.972 | 0.972 | 0.958 | 0.441 | 0.547 | 0.844 | 0.983 | 0.144 | 0.951 | 0.933 | 0.930 | 0.947 | 0.321 | 0.237 | 0.108 | 0.225 | 0.752 | 0.389 | 0.012 | 0.303 | 0.990 | 0.064 | 0.064 | 0.006 | 0.467 | 0.933 | 0.063 | 0.798 | 0.012 | 0.027 | 0.529 | 0.000 | 0.474 | 0.329 | 0.553 | 0.000 | 0.000 | 0.085 | 0.000 | 0.000 | 0.111 | 0.000 | 0.000 |

## Missed at thresholds 0.5 / 0.3 / 0.2 / 0.1

Only models that return a score. A lower threshold keeps more spans: fewer misses, more masking.

| model | 0.5 | 0.3 | 0.2 | 0.1 |
|---|---|---|---|---|
| nym-base+homoglyph | 44 (2.6%) | 27 (1.6%) | 27 (1.6%) | 27 (1.6%) |
| nym-base | 47 (2.8%) | 28 (1.7%) | 28 (1.7%) | 28 (1.7%) |
| nym-small | 82 (4.9%) | 59 (3.5%) | 56 (3.4%) | 56 (3.4%) |
| mmbert32k | 83 (5.0%) | 36 (2.2%) | 28 (1.7%) | 28 (1.7%) |
| opf-ru | 146 (8.8%) | 118 (7.1%) | 118 (7.1%) | 118 (7.1%) |
| apararti | 164 (9.8%) | 150 (9.0%) | 150 (9.0%) | 150 (9.0%) |
| traciora | 182 (10.9%) | 165 (9.9%) | 165 (9.9%) | 165 (9.9%) |
| ru-legal-ner | 191 (11.5%) | 112 (6.7%) | 108 (6.5%) | 105 (6.3%) |
| ru-legal-ner+homoglyph | 195 (11.7%) | 116 (7.0%) | 111 (6.7%) | 108 (6.5%) |
| pii-shield-onnx | 202 (12.1%) | 105 (6.3%) | 90 (5.4%) | 88 (5.3%) |
| opf-ru-v2 | 213 (12.8%) | 200 (12.0%) | 200 (12.0%) | 200 (12.0%) |
| opf-ru-v2+homoglyph | 215 (12.9%) | 202 (12.1%) | 202 (12.1%) | 202 (12.1%) |
| opf-kz-ru | 216 (13.0%) | 213 (12.8%) | 212 (12.7%) | 212 (12.7%) |
| gliner2-fastino-ru | 237 (14.2%) | 149 (8.9%) | 117 (7.0%) | 92 (5.5%) |
| nuner-zero | 262 (15.7%) | 69 (4.1%) | 35 (2.1%) | 15 (0.9%) |
| gliner-nvidia-ru | 263 (15.8%) | 150 (9.0%) | 104 (6.2%) | 64 (3.8%) |
| openmed-multilingual | 266 (16.0%) | 108 (6.5%) | 96 (5.8%) | 96 (5.8%) |
| gliner2-hivetrace-omni-ru | 304 (18.2%) | 159 (9.5%) | 89 (5.3%) | 56 (3.4%) |
| bardsai-eu | 329 (19.7%) | 191 (11.5%) | 174 (10.4%) | 173 (10.4%) |
| gliner-nvidia+homoglyph | 345 (20.7%) | 208 (12.5%) | 130 (7.8%) | 66 (4.0%) |
| gliner-nvidia | 356 (21.4%) | 212 (12.7%) | 130 (7.8%) | 66 (4.0%) |
| openai-base | 375 (22.5%) | 370 (22.2%) | 370 (22.2%) | 370 (22.2%) |
| gravitee-small | 418 (25.1%) | 283 (17.0%) | 276 (16.6%) | 276 (16.6%) |
| gliner-pii-edge | 423 (25.4%) | 32 (1.9%) | 2 (0.1%) | 0 (0.0%) |
| gliner2-vladlinv-ru | 448 (26.9%) | 432 (25.9%) | 422 (25.3%) | 405 (24.3%) |
| gliner-urchade-ru | 452 (27.1%) | 250 (15.0%) | 150 (9.0%) | 62 (3.7%) |
| gliner-stream-pii | 486 (29.2%) | 263 (15.8%) | 182 (10.9%) | 103 (6.2%) |
| gliner2-fastino | 505 (30.3%) | 325 (19.5%) | 240 (14.4%) | 135 (8.1%) |
| gliner25-fastino-ru | 517 (31.0%) | 483 (29.0%) | 476 (28.6%) | 472 (28.3%) |
| gliner-urchade | 555 (33.3%) | 326 (19.6%) | 208 (12.5%) | 84 (5.0%) |
| kalyan-ettin | 560 (33.6%) | 257 (15.4%) | 216 (13.0%) | 211 (12.7%) |
| gliner2-vladlinv+homoglyph | 575 (34.5%) | 558 (33.5%) | 549 (32.9%) | 531 (31.9%) |
| gliner2-vladlinv | 579 (34.7%) | 562 (33.7%) | 553 (33.2%) | 534 (32.0%) |
| gliner2-hivetrace-uni | 588 (35.3%) | 201 (12.1%) | 79 (4.7%) | 16 (1.0%) |
| gliner2-hivetrace-omni | 613 (36.8%) | 308 (18.5%) | 161 (9.7%) | 71 (4.3%) |
| openmed-nemotron | 626 (37.6%) | 484 (29.0%) | 477 (28.6%) | 477 (28.6%) |
| gliner2-large | 668 (40.1%) | 490 (29.4%) | 365 (21.9%) | 252 (15.1%) |
| fef2-secret-ru | 669 (40.1%) | 657 (39.4%) | 655 (39.3%) | 655 (39.3%) |
| gliner25-fastino | 775 (46.5%) | 731 (43.9%) | 718 (43.1%) | 711 (42.7%) |
| gliner-multi-v21-ru | 872 (52.3%) | 481 (28.9%) | 273 (16.4%) | 116 (7.0%) |
| gliner-multi-v21 | 931 (55.8%) | 465 (27.9%) | 263 (15.8%) | 112 (6.7%) |
| ner-ru-yqelz | 1113 (66.8%) | 1089 (65.3%) | 1089 (65.3%) | 1089 (65.3%) |
| gliner-pii-base | 1136 (68.1%) | 376 (22.6%) | 65 (3.9%) | 1 (0.1%) |
| ner-ru-gherman+homoglyph | 1193 (71.6%) | 1192 (71.5%) | 1191 (71.4%) | 1191 (71.4%) |
| ner-ru-gherman | 1206 (72.3%) | 1204 (72.2%) | 1203 (72.2%) | 1203 (72.2%) |
| gliner2-hivetrace-uni-ru | 1232 (73.9%) | 588 (35.3%) | 357 (21.4%) | 123 (7.4%) |
| davlan-xlmr | 1288 (77.3%) | 1282 (76.9%) | 1282 (76.9%) | 1282 (76.9%) |
| davlan-mbert | 1293 (77.6%) | 1290 (77.4%) | 1290 (77.4%) | 1290 (77.4%) |

Notes: the unit of counting is one gold span after boundary normalization - the same unit in `missed`, in the group table, in the threshold table and in the ensembles; two annotations that share boundaries but not type are two spans, so an empty answer misses 100%. Gold and predicted boundaries are normalized the same way (whitespace, word boundaries, merge of adjacent same-label pieces). `dropped spans` - predicted intervals outside the text: rejected, not clipped to fit. A run made before `run.py` started clipping span ends to the piece it fed the model can carry them; `meta.clipped` counts what the clipping fixes in newer runs. Zero-shot models get the taxonomy of the set as labels (the `labels` field of `meta.json`). `train` - the model was trained on the source of this set (its slices and corrupted copies included): its row is not comparable with the others and stays out of the pooled numbers; an empty `contaminated` list in `benchmark/models.toml` means no evidence of overlap was found, not proof of none. `hidden` - gold spans every character of which is covered; a touched span counts as detected, not as hidden. missed % and char F1 carry 95% bootstrap intervals over rows (1000 resamples, the same rows for every model of the set). The group of a gold type comes from `BENCH/<set>/meta.json`; a model label with no group falls into OTHER. ms/row is a median and includes chunking of long texts; hardware and batch are in the meta line of the prediction file.