Request Format
URL Structure
| Component | Description | Example |
|---|---|---|
{tenant} | Your tenant subdomain | acme |
{endpoint-path} | Your endpoint path | /api/v1/summarize |
Required Headers
| Header | Value | Description |
|---|---|---|
Content-Type | application/json | Request body format |
x-api-key | Your API key | Authentication |
Request Body
JSON object matching your endpoint’s input schema:Complete Request Example
Response Format
Success Response
Response Headers
| Header | Description |
|---|---|
X-Request-Id | Unique request identifier for debugging |
X-RateLimit-Limit | Your rate limit |
X-RateLimit-Remaining | Requests remaining |
X-RateLimit-Reset | When limit resets (Unix timestamp) |
Request Options
Specifying a Prompt
By default, requests use the endpoint’s default prompt. To use a specific prompt:Only Live prompts can be specified via the API. Draft prompts are test-only.
Bypassing Cache
Force a fresh LLM call even if cached:Input Validation
Requests are validated against your input schema before processing.Required Fields
If a required field is missing:Type Validation
If a field has the wrong type:Constraint Validation
If a value violates constraints:Timeouts
Default timeout is 60 seconds. For long-running requests:- The connection stays open until the LLM responds
- Very complex prompts may take 30-60 seconds
- If timeout is exceeded, you’ll receive a 504 error
Idempotency
Endprompt requests are not idempotent by default. Each request:- Triggers a new LLM call (unless cached)
- Is logged separately
- Consumes tokens from the LLM provider
Best Practices
Handle errors gracefully
Handle errors gracefully
Always check for error responses and handle them appropriately.
Set reasonable timeouts
Set reasonable timeouts
Configure your HTTP client with appropriate timeout values.
Log request IDs
Log request IDs
Save the
X-Request-Id header for debugging support requests.Respect rate limits
Respect rate limits
Check rate limit headers and implement backoff when approaching limits.
Finding Your Endpoint URL
- Open your endpoint in the dashboard
- Go to the OpenAPI tab
- Your full URL is shown at the top
- Code samples are provided in multiple languages

