Metrics Baseline
This baseline uses current project onboarding surfaces:
README.mdagentic_executables_cli/README.mdinstall.shagentic_executables_cli/lib/src/cli.dart
North-star metrics
Time to first success (TTFS)
- Definition: time from landing on docs to successful
ae definition. - Target: median under 5 minutes.
Install success rate
- Definition: successful verification after install attempt.
- Slice by: OS, shell, install mode.
- Target: at least 95%.
Quickstart completion
- Definition: user/agent completes one post-install workflow.
- Slice by: beginner, developer, agent.
- Target: at least 80%.
Search-to-success
- Definition: search query leads to task completion without external support.
- Target: at least 70%.
Current friction baseline (pre-docs-site)
- No unified docs index for onboarding steps.
- Install guidance is concise but not role-segmented.
- No explicit expected-output blocks for each first-run command.
- No machine-targeted docs index (
llms.txt,llms-full.txt) in site output. - No documented onboarding telemetry loop.
Event instrumentation spec
Track these events:
docs_role_selectedinstall_command_copiedinstall_completedverify_command_startedverify_command_succeededquickstart_step_completedsearch_performedsearch_result_clickedfirst_success_completed
Keep telemetry privacy-safe:
- No command payload content.
- No secrets.
- Hash session IDs with short retention.