UX problem
Two subcommands with similar names and overlapping semantics:
- `oc-bench preflight --suite ... --models ...` — benchmark-run preflight (predates M3). Verifies a suite + model config will run end-to-end safely.
- `oc-bench provider-preflight --profile X --provider vllm --base-url Y --route-model Z` — provider-route preflight (M3). Runs four gates against a provider config.
A user reading `--help` has to read both descriptions to know which to invoke. The names don't telegraph the difference.
Options
- Rename `preflight` → `run-preflight` and `provider-preflight` → `provider-check` (or similar). Breaking change.
- Subcommand groups: `oc-bench preflight run` and `oc-bench preflight provider`. Cleaner but bigger restructure.
- Leave as-is, sharpen `--help` text: change the two help strings so the difference is obvious from `oc-bench --help` alone. Lowest effort, lowest payoff.
Recommendation
Option 3 first (1-line fix). Revisit option 2 when the next CLI surface change lands.
Severity
P3 — neither command misbehaves; just easy to invoke the wrong one.
UX problem
Two subcommands with similar names and overlapping semantics:
A user reading `--help` has to read both descriptions to know which to invoke. The names don't telegraph the difference.
Options
Recommendation
Option 3 first (1-line fix). Revisit option 2 when the next CLI surface change lands.
Severity
P3 — neither command misbehaves; just easy to invoke the wrong one.