Skip to main content
behaviors takes a provider’s model ID as given: it has no catalog of models, and it passes the string to the provider’s endpoint without checking it against a list or translating it. Choose the provider and endpoint first, then get the exact model ID from that provider’s listing API. Use the returned id, not a display name; the same model can have different IDs at different providers. When you’ve been asked for a particular model, keep it, and verify its ID rather than substituting another. The examples below use curl and jq, with API keys already set in the named environment variables. They only list model metadata. Use the same credentials and endpoint as the experiment, since a listing shows what that account can use. An authentication or permission error does not mean that no models exist.

OpenAI

List models with GET https://api.openai.com/v1/models:
Use a returned ID with OpenAIResponsesAPI(model_id) for models supporting the Responses API, or OpenAICompatibleAPI(model_id) for Chat Completions. The listing includes models for other tasks too; check a model’s supported endpoints and features in the model catalog before choosing an adapter.

Anthropic

List models with GET https://api.anthropic.com/v1/models:
This is one page, even with limit=1000. While has_more is true, request the next page with after_id set to the returned last_id, and collect its models before advancing again. Pass a returned id to AnthropicMessagesAPI(model_id); display_name is only for presentation.

OpenRouter

OpenRouter serves models from multiple vendors through an OpenAI-compatible endpoint. Its general catalog API is GET https://openrouter.ai/api/v1/models; the account-filtered listing also applies your provider preferences, privacy settings, and guardrails:
For the general catalog, change /models/user to /models. The model browser is useful for interactive search. Inspect architecture, context_length, and supported_parameters in the JSON for candidate models. Use the full returned id, including its vendor prefix and any suffix, with:
The OpenAI SDK does not read OPENROUTER_API_KEY by itself, so pass it explicitly as above. Close the adapter with await api.aclose() when finished, as in the conversation step.

Search and validate a candidate

Search a saved response by ID or display name, changing the file and search text as needed:
For paginated responses, search every collected page. A catalog entry does not establish that the model supports every feature the experiment needs. Check its support for the endpoint, streaming, tools, and reasoning, then try the chosen adapter and sampling settings with a small request before launching a sweep. Without credentials, the providers’ published catalogs and documentation give candidate IDs, but not whether your account can use them. Keep the chosen provider, model ID, and request settings in the experiment’s configuration inputs, so that each run records what was selected (see A conversation as a step).