EES (Elastic Endpoint)
Get full control on your executions
Last updated
Was this helpful?
Get full control on your executions
Last updated
Was this helpful?
Elastic Endpoint Service () — is a unified entrypoint that helps to manage integration between AI providers and your application. Using this service its possible to empower your solution with the following features:
Integration Type: Sync/Async You can define how do you prefer receive responses: using webhooks, stream or sync HTTP request.
Throttling and Load Control: Define RPM (Requests Per Minute) or RPMO (Requests Per Month) to align solution with your expectations.
Retry Strategy: You can define retry behaviors, and corner scenarios.
Fallback Model: it is possible to define default fallback model to prevent unsuccessful generations.
RBAC: Role based access using API and more.
