ASR Benchmark
| model | BPU core num | qtype | max context | TTFT (ms) | Decode (TPS) | memory (GB) |
|---|---|---|---|---|---|---|
| whisper-medium | encode 4 prefill 1 decode 1 | encode w8 prefill w8 decode w8 | 128 | 110 | 60.5 | 1.9 |
On This Page
| model | BPU core num | qtype | max context | TTFT (ms) | Decode (TPS) | memory (GB) |
|---|---|---|---|---|---|---|
| whisper-medium | encode 4 prefill 1 decode 1 | encode w8 prefill w8 decode w8 | 128 | 110 | 60.5 | 1.9 |