LMSpeed

LMSpeed helps developers compare LLM API providers before they connect an endpoint to an app.

You can compare API price, output speed, first token latency, provider health, model coverage, and OpenAI compatible relay behavior in one web workspace.

The speed test runs five rounds with standard prompts. You can test a public provider, relay, proxy, or self hosted OpenAI compatible endpoint with a base URL, API key, and model ID.

LMSpeed also has provider and model directories, leaderboards, shared free API keys for testing, and a relay security audit workflow. The audit checks risks like model substitution, hidden prompt leakage, tool call rewriting, context truncation, error leakage, and stream integrity.

Shared free API keys are for testing only. They should not be used in production. Benchmark data can change over time, so users should recheck key choices with their own endpoint.