API

Endpoint LLM ProvidersCombos Memory Cache

Analytics

System

Health Proxy Pools Logs Settings

Pod v0.0.82

API

Endpoint LLM ProvidersCombos Memory Cache

Analytics

System

Health Proxy Pools Logs Settings

Pod v0.0.82

Cache

Cache

Configure semantic cache behavior and run cache maintenance.

Cache Settings

Controls semantic cache enablement, size, and TTL

Enable Semantic CacheAllow cache reads/writes for non-streaming deterministic requests.

Cache Max Size

Cache TTL (minutes)

Cache Stats

Live semantic cache counters

Maintenance

Invalidate cache entries by scope

Invalidate by Model

Invalidate by Signature

Invalidate Stale (minutes)