PII detector latency and throughput benchmark
Compare measured CPU and GPU throughput with hardware, worker count, dataset count and amortized row timings visible.
AMD EPYC 9K84
16 threads per process · 24 concurrent workers · CPU speed sweep
Throughput at a glance
54 measurements · characters per second · higher is better
All speed measurements
Every row retains its original hardware and workload.
| Detector / variant | s / 10k chars ↓ | Chars / s ↑ | Rows / s | p50 ms / row | p95 ms / row | Peak RSS MB | Datasets | Hardware | Threads | Workers |
|---|---|---|---|---|---|---|---|---|---|---|
| natasha+cpu-speed | 0.076 | 130,799 | 83.33 | 3 | 49 | 209 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| spacy-alrosait+cpu-speed | 0.188 | 53,307 | 33.96 | 9 | 121 | 1,492 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| spacy-ru-lg+cpu-speed | 0.191 | 52,320 | 33.33 | 7 | 128 | 1,494 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| ru-legal-ner+cpu-speed | 0.196 | 50,942 | 28.99 | 11 | 134 | 903 | 8 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gravitee-small+cpu-speed | 0.660 | 15,141 | 9.65 | 40 | 485 | 1,065 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gravitee-small+cpu-int8 | 0.821 | 12,174 | 18.87 | 16 | 188 | 1,210 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| kalyan-ettin+cpu-speed | 1.144 | 8,742 | 5.57 | 65 | 873 | 1,148 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| ru-pii-ner+cpu-speed | 1.418 | 7,053 | 4.49 | 64 | 1,023 | 2,774 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner2-hivetrace-uni-ru+cpu-speed | 2.038 | 4,906 | 4.04 | 106 | 1,025 | 2,088 | 4 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| davlan-xlmr+cpu-speed | 2.257 | 4,431 | 2.82 | 90 | 1,552 | 1,612 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| mmbert32k+cpu-speed | 2.319 | 4,313 | 2.75 | 85 | 1,514 | 1,856 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| davlan-xlmr+cpu-int8 | 2.434 | 4,108 | 6.37 | 38 | 777 | 2,012 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| ner-ru-gherman+cpu-speed | 2.484 | 4,026 | 2.56 | 118 | 1,659 | 1,332 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| davlan-mbert+cpu-speed | 2.511 | 3,983 | 2.54 | 109 | 1,686 | 1,367 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| ner-ru-gherman+cpu-int8 | 2.850 | 3,509 | 6.89 | 57 | 520 | 1,706 | 8 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner2-hivetrace-uni+cpu-speed | 2.921 | 3,424 | 1.74 | 242 | 2,108 | 2,495 | 7 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| openmed-nemotron+cpu-speed | 3.042 | 3,287 | 2.09 | 118 | 1,844 | 2,848 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| fef2-secret-ru+cpu-speed | 3.051 | 3,278 | 2.09 | 113 | 2,073 | 1,395 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| davlan-mbert+cpu-int8 | 3.124 | 3,201 | 6.28 | 76 | 550 | 1,618 | 8 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| nym-base+cpu-speed | 3.209 | 3,116 | 1.45 | 168 | 3,014 | 2,053 | 6 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| openmed-multilingual+cpu-speed | 3.251 | 3,076 | 1.96 | 117 | 2,130 | 2,783 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| traciora+cpu-speed | 3.289 | 3,040 | 1.94 | 130 | 1,977 | 3,544 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| opf-kz-ru+cpu-speed | 3.390 | 2,950 | 1.88 | 128 | 2,165 | 3,807 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| opf-ru-v2+cpu-speed | 3.465 | 2,886 | 1.64 | 197 | 2,264 | 3,626 | 8 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| opf-ru+cpu-speed | 3.522 | 2,839 | 1.66 | 149 | 2,145 | 3,721 | 8 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| fef2-secret-ru+cpu-int8 | 3.545 | 2,821 | 6.21 | 75 | 648 | 1,664 | 7 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| apararti+cpu-speed | 4.088 | 2,446 | 1.56 | 158 | 2,499 | 3,999 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| openai-base+cpu-speed | 4.205 | 2,378 | 1.51 | 159 | 2,679 | 4,188 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner-pii-base+cpu-speed | 5.244 | 1,907 | 1.21 | 310 | 3,302 | 3,054 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner-urchade+cpu-int8 | 6.158 | 1,624 | 2.73 | 174 | 1,416 | 4,498 | 8 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner-urchade-ru+cpu-speed | 6.219 | 1,608 | 1.32 | 333 | 2,893 | 3,141 | 4 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner-multi-v21+cpu-int8 | 6.305 | 1,586 | 2.67 | 198 | 1,398 | 4,578 | 8 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner-multi-v21-ru+cpu-speed | 6.707 | 1,491 | 1.23 | 332 | 3,447 | 3,122 | 4 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner-pii-edge+cpu-speed | 6.878 | 1,454 | 0.93 | 435 | 3,678 | 3,842 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| ner-ru-yqelz+cpu-speed | 7.077 | 1,413 | 0.90 | 298 | 4,727 | 2,506 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner-pii-edge+cpu-int8 | 7.536 | 1,327 | 2.49 | 265 | 1,340 | 2,343 | 7 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner25-fastino-ru+cpu-speed | 7.686 | 1,301 | 1.07 | 499 | 3,438 | 3,157 | 4 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner-pii-base+cpu-int8 | 7.899 | 1,266 | 5.04 | 112 | 544 | 2,743 | 5 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner-stream-pii+cpu-speed | 8.203 | 1,219 | 0.78 | 453 | 5,465 | 5,957 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| stanza-ru+cpu-speed | 8.347 | 1,198 | 0.76 | 257 | 6,290 | 1,467 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner2-hivetrace-omni-ru+cpu-speed | 8.598 | 1,163 | 0.96 | 683 | 3,647 | 3,330 | 4 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner2-fastino-ru+cpu-speed | 8.905 | 1,123 | 0.92 | 697 | 3,585 | 3,324 | 4 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner-urchade+cpu-speed | 9.681 | 1,033 | 0.66 | 437 | 6,519 | 3,139 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner-multi-v21+cpu-speed | 9.891 | 1,011 | 0.64 | 483 | 6,741 | 3,244 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| pplx+cpu-speed | 9.940 | 1,006 | 0.52 | 642 | 7,479 | 4,133 | 7 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner25-fastino+cpu-speed | 12.469 | 802 | 0.51 | 714 | 8,092 | 4,490 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner2-vladlinv+cpu-speed | 14.493 | 690 | 0.44 | 860 | 9,428 | 4,536 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner2-hivetrace-omni+cpu-speed | 14.793 | 676 | 0.43 | 865 | 9,516 | 4,567 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner2-fastino+cpu-speed | 14.925 | 670 | 0.43 | 914 | 10,073 | 4,665 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner2-vladlinv-ru+cpu-speed | 17.575 | 569 | 2.64 | 373 | 942 | 3,155 | 3 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner-nvidia-ru+cpu-speed | 20.000 | 500 | 0.41 | 1,223 | 8,802 | 4,266 | 4 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| nuner-zero+cpu-speed | 20.121 | 497 | 0.32 | 1,573 | 12,582 | 4,263 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner-nvidia+cpu-speed | 22.624 | 442 | 0.26 | 2,184 | 15,780 | 4,259 | 8 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
| gliner2-large+cpu-speed | 24.691 | 405 | 0.26 | 2,079 | 14,714 | 5,969 | 9 | AMD EPYC 9K84 96-Core Processor | 16 | 24 |
p50 and p95 are amortized compute per row, not individually timed request latency. Missing measurements stay blank. Dataset counts differ across runs.