Open-source LLM inference server for ExLlamaV3 and EXL3 models, providing OpenAI- and Anthropic-compatible APIs with tool calling, structured output, streaming, reasoning, and other features for agent workloads.
Prices and medians update for the tier you select.
Ranked by how closely each one matches ExQServe's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.
Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.