benchmarks/benchmark_results/google_gemma-3-12b-it_tp1_throughput.json

{
    "elapsed_time": 930.6109793490032,
    "num_requests": 200,
    "total_num_tokens": 148857,
    "requests_per_second": 0.2149125729635249,
    "tokens_per_second": 159.95620436815713
}
updates 2025-12-20 11:37:06 +00:00			`{`
updated benchmarks, fix start-vllm 2026-02-23 19:39:19 +00:00			`"elapsed_time": 930.6109793490032,`
feat: Update benchmark results across various models and configurations, increasing `num_requests` from 100 to 200. 2026-02-03 08:31:54 +00:00			`"num_requests": 200,`
			`"total_num_tokens": 148857,`
updated benchmarks, fix start-vllm 2026-02-23 19:39:19 +00:00			`"requests_per_second": 0.2149125729635249,`
			`"tokens_per_second": 159.95620436815713`
updates 2025-12-20 11:37:06 +00:00			`}`