LLM Models Overview

Endprompt supports multiple LLM providers, giving you flexibility to choose the best model for each use case.

​

Supported Providers

​

Model Comparison

​

Choosing a Model

​

For Quality-Critical Tasks

• GPT-4o or Claude 3 Opus
• Complex analysis, nuanced responses
• Higher cost, worth it for important outputs

​

For High-Volume Tasks

• GPT-3.5-turbo or Claude 3 Haiku
• Simple classification, extraction
• Low cost, high throughput

​

For Long Documents

• Claude 3 models
• Support up to 200K tokens context
• Ideal for document analysis

​

For Image Tasks

• Vision (image inputs): GPT-4o, Claude 3 models, Gemini — analyze images alongside text prompts
• Image Generation (image outputs): gpt-image-1 — generate or edit images from text descriptions
• Image Editing: Use gpt-image-1 with both image inputs and outputs to edit existing images

​

Model Capabilities

​

Context Window

How much input each model can handle:

​

JSON Mode

Some models support native JSON output mode:

​

Model Selection in Prompts

When creating or editing a prompt:

1. Click the Model dropdown
2. Select your preferred model
3. The model is saved with the prompt

Different prompts on the same endpoint can use different models—useful for A/B testing.

​

Cost Considerations

LLM costs are based on tokens:

• Input tokens: Your prompt text (including rendered template)
• Output tokens: The model’s response

​

Model-Specific Tips

​

Adding Provider API Keys

Your tenant needs API keys configured for each provider you want to use:

1. Go to LLM API Keys in the sidebar (under Configuration)
2. Add your OpenAI and/or Anthropic API keys
3. Keys are encrypted and stored securely

​

Next Steps