Skip to content

vllm.entrypoints.serve.instrumentator.health

logger module-attribute 

logger = init_logger(__name__)

router module-attribute 

router = APIRouter()

engine_client 

engine_client(request: Request) -> EngineClient
Source code in vllm/entrypoints/serve/instrumentator/health.py 
18
19
def engine_client(request: Request) -> EngineClient:
    return request.app.state.engine_client

health async 

health(raw_request: Request) -> Response

Health check.

Source code in vllm/entrypoints/serve/instrumentator/health.py 
22
23
24
25
26
27
28
29
@router.get("/health", response_class=Response)
async def health(raw_request: Request) -> Response:
    """Health check."""
    try:
        await engine_client(raw_request).check_health()
        return Response(status_code=200)
    except EngineDeadError:
        return Response(status_code=503)