Configguesser API Reference

This section covers all endpoints related to configguesser.

Analyze Model

Attempt to guess required GPU count and VRAM for a model on huggingface, assuming safetensors format.

Endpoint: GET /guess/vllm_config

Parameters

Responses