The Cohort Wizard

A guided walk through provisioning a provider credential, verifying it, and (optionally) choosing a judge model — for a workspace setting up from scratch. It exists in two forms that walk the same steps, backed by the same model catalog and the same API routes as the standalone Provider Keys and LLM Judge settings: an interactive CLI command, and a dashboard modal.

Neither is a separate code path from the settings you'd otherwise click through one at a time — intutic setup calls the exact routes intutic credentials set and the judge-model settings PUT already call, and the dashboard's Guided Setup button drives the same mutations ProviderKeyWizard and JudgeModelPanel use individually. This is a sequence over existing actions, not new behavior to trust separately.

intutic setup (CLI)

intutic setup

Steps:

1. Codescan — detects harnesses in the current workspace (the same detection intutic init uses).
2. Mode — connected to Intutic (needs intutic login first) or local/offline, with no control plane.
3. Provider — pick one from the registry; each option shows whether the proxy currently routes to it (see Provider Keys).
4. Credentials — prompted per the provider's own field list (a password field for an API key, a multiline field for a service-account JSON blob, and so on).
5. Verify — the credential is checked against the provider's own API before it's saved. Only a confirmed-invalid key (401/403) stops you, and even then you can choose to save it anyway; a rate-limited or unreachable response is reported but never blocks.
6. Persist — connected mode saves the credential to your workspace (the same PUT /api/v1/workspace/provider-credentials/:provider route intutic credentials set uses); local mode writes a .intutic.env file (mode 0600) you source yourself.
7. Judge model (optional) — pick from the model catalog or type a custom name. In connected mode, the model is saved and then tested with a real, tiny completion through the exact path a judge call would take — the same round-trip the dashboard's LLM Judge panel runs from its own Test button, so a typo'd model name or a missing provider key fails here, not during a live judge call. In local mode, you're pointed at intutic judge configure to finish the on-prem side.
8. Summary.

intutic init is unaffected — it stays exactly as it was, flag-driven and safe for CI. intutic setup is the interactive counterpart for a human at a keyboard.

Related

• Settings & Configuration — Provider Keys, LLM Judge
• Model Catalog
• CLI Reference — intutic setup
• On-prem judge setup