Skip to main content

Maturity taxonomy

the model behind the scorecard

Surfaces > categories > capabilities > evidence.

50 surfaces grouped into 4 families, with every category tied back to canonical docs and QA coverage IDs.

How to read this page

A surface is a product area such as Gateway runtime, Discord, or the macOS app. Each surface contains categories, and each category contains the capability-level checks that QA scenarios cover. Use the scorecard for release-level judgment; use this page to inspect the model underneath it.

Maturity levels

M0PlannedDirection is known, but no supported user path exists.Promotion: Design issue, owner, and target surface exist.
M1ExperimentalImplemented behind caveats, flags, source builds, or maintainer-only flows.Promotion: Maintainer can run the scenario from current main.
M2AlphaReal users can try it, but breaking changes and incomplete UX are expected.Promotion: Documented setup, basic tests, known caveats, and at least one real-environment proof.
M3BetaPublic path exists and the main workflow is usable with bounded caveats.Promotion: Install/update docs, regression tests, support runbook, and successful scenario proof across the expected environment.
M4StableRecommended path for normal users. Failures are treated as regressions.Promotion: Release gate, doctor/troubleshooting path, broad docs, and repeated real-world proof.
M5ClawesomePolished, delightful, well-instrumented, and competitive with the best comparable workflow.Promotion: Stable plus user scorecard pass across representative users.

Product areas

Details

Core

Normal setup and repair paths are documented across install, CLI, and gateway docs. Platform-specific Windows paths are tracked in the Windows via WSL2 and Native Windows rows.
Coverage Experimental - 2%Quality Stable - 83%Completeness Stable - 90%Partial - 6
AreaCoverageQualityCompletenessDocs
CLI Setup6 capabilities / LTS-supported
Experimental2%
Stable89%
Stable90%
Onboarding and Auth Setup5 capabilities / LTS-supported
Experimental2%
Beta75%
Stable89%
Plugin and Channel Setup5 capabilities
Experimental2%
Beta75%
Stable89%
Gateway Service Management5 capabilities / LTS-supported
Experimental2%
Stable87%
Stable90%
CLI Observability5 capabilities / LTS-supported
Experimental2%
Stable89%
Stable90%
Doctor10 capabilities / LTS-supported
Experimental2%
Stable89%
Stable90%
Updates and Upgrades5 capabilities / LTS-supported
Experimental2%
Beta75%
Stable89%
Core architecture, auth, pairing, protocol docs, daemon docs, and CLI runbooks are broad and current.
Coverage Experimental - 3%Quality Stable - 81%Completeness Stable - 89%Partial - 12
AreaCoverageQualityCompletenessDocs
Approvals and Remote Execution6 capabilities / LTS-supported
Experimental3%
Beta75%
Stable89%
HTTP APIs4 capabilities / LTS-supported
Experimental3%
Stable90%
Stable90%
Hosted Web Surface4 capabilities / LTS-supported
Experimental3%
Stable89%
Stable90%
Gateway RPC APIs and Events20 capabilities / LTS-supported
Experimental3%
Stable90%
Stable90%
Device Auth and Pairing10 capabilities / LTS-supported
Experimental3%
Beta75%
Stable89%
Network Access and Discovery6 capabilities / LTS-supported
Experimental3%
Beta75%
Stable89%
Nodes and Remote Capabilities8 capabilities
Experimental3%
Beta75%
Stable89%
Health, Diagnostics, and Repair7 capabilities / LTS-supported
Experimental3%
Beta75%
Stable89%
Protocol Compatibility7 capabilities / LTS-supported
Experimental3%
Beta75%
Stable89%
Roles and Permissions5 capabilities / LTS-supported
Experimental3%
Beta75%
Stable89%
Gateway Lifecycle7 capabilities / LTS-supported
Experimental3%
Stable90%
Stable90%
Security Controls6 capabilities / LTS-supported
Experimental3%
Beta75%
Stable89%
WebSocket Connection8 capabilities / LTS-supported
Experimental3%
Stable90%
Stable90%
Main loop, models, provider routing, and tool streaming are first-class, but provider behavior shifts weekly and needs scenario proof per release.
Coverage Experimental - 2%Quality Beta - 78%Completeness Beta - 79%Partial - 6
AreaCoverageQualityCompletenessDocs
Agent Turn Execution3 capabilities / LTS-supported
Experimental2%
Beta79%
Beta79%
External Runtimes and Subagents4 capabilities
Experimental2%
Beta79%
Beta79%
Hosted Provider Execution5 capabilities / LTS-supported
Experimental2%
Beta79%
Beta79%
Local and Self-hosted Providers5 capabilities
Experimental2%
Alpha68%
Beta79%
Model and Runtime Selection4 capabilities / LTS-supported
Experimental2%
Beta79%
Beta79%
Provider Auth10 capabilities / LTS-supported
Experimental2%
Beta79%
Beta79%
Streaming and Progress2 capabilities
Experimental2%
Beta79%
Beta79%
Tool Calls and Response Handling3 capabilities / LTS-supported
Experimental2%
Beta79%
Beta79%
Tool Execution Controls6 capabilities / LTS-supported
Experimental2%
Beta79%
Beta79%
Strong docs and active implementation. Maturity depends on transcript durability, compaction quality, and cross-client parity.
Coverage Experimental - 0%Quality Beta - 77%Completeness Beta - 79%Partial - 6
AreaCoverageQualityCompletenessDocs
CLI Session and Transcript Management2 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Token Management3 capabilities / LTS-supported
Experimental0%
Beta79%
Beta79%
Context Engine2 capabilities / LTS-supported
Experimental0%
Beta79%
Beta79%
Cross-client History and Session Parity2 capabilities
Experimental0%
Beta79%
Beta79%
Diagnostics, Maintenance, and Recovery3 capabilities
Experimental0%
Beta79%
Beta79%
Core Prompts and Context2 capabilities / LTS-supported
Experimental0%
Beta79%
Beta79%
Memory5 capabilities
Experimental0%
Beta79%
Beta79%
Session Routing2 capabilities / LTS-supported
Experimental0%
Beta79%
Beta79%
Transcript Persistence2 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Many channels share Gateway delivery and routing contracts, but channel behavior varies by upstream API and account-policy constraints.
Coverage Experimental - 0%Quality Beta - 76%Completeness Beta - 79%Partial - 5
AreaCoverageQualityCompletenessDocs
Channel Actions Commands and Approvals5 capabilities
Experimental0%
Beta79%
Beta79%
Channel Setup5 capabilities / LTS-supported
Experimental0%
Beta79%
Beta79%
Group Thread and Ambient Room Behavior5 capabilities
Experimental0%
Beta79%
Beta79%
Inbound Access and Identity Gates5 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Media Attachments and Rich Channel Data4 capabilities
Experimental0%
Alpha68%
Beta79%
Outbound Delivery and Reply Pipeline4 capabilities / LTS-supported
Experimental0%
Beta79%
Beta79%
Conversation Routing and Delivery10 capabilities / LTS-supported
Experimental0%
Beta79%
Beta79%
Status Health and Operator Controls4 capabilities / LTS-supported
Experimental0%
Beta79%
Beta79%
OTel, Prometheus, logging, and diagnostics docs exist. Needs a public “what operators should look at first” maturity pass.
Coverage Experimental - 6%Quality Beta - 75%Completeness Beta - 79%Partial - 3
AreaCoverageQualityCompletenessDocs
Health and Repair12 capabilities / LTS-supported
Experimental6%
Beta79%
Beta79%
Logging5 capabilities / LTS-supported
Experimental6%
Alpha68%
Beta79%
Diagnostic Collection8 capabilities
Experimental6%
Beta79%
Beta79%
Telemetry Export13 capabilities
Experimental6%
Beta79%
Beta79%
Session Diagnostics4 capabilities / LTS-supported
Experimental6%
Alpha68%
Beta79%
Web UI is documented with pairing, chat, PWA, Talk, push, and remote Gateway flows. Promote after cross-browser and mobile-PWA scorecards.
Coverage Experimental - 0%Quality Beta - 74%Completeness Beta - 79%None
AreaCoverageQualityCompletenessDocs
Browser Realtime Talk5 capabilities
Experimental0%
Alpha68%
Beta79%
Browser Access and Trust5 capabilities
Experimental0%
Alpha68%
Beta79%
Configuration5 capabilities
Experimental0%
Alpha68%
Beta79%
Browser UI10 capabilities
Experimental0%
Beta79%
Beta79%
WebChat Conversations15 capabilities
Experimental0%
Beta79%
Beta79%
Operator Console10 capabilities
Experimental0%
Beta79%
Beta79%
Broad docs and strong internal runtime evidence exist across manifests, discovery, loading, provider/tool architecture, and approval boundaries. Keep the row at beta until public SDK API/subpaths and external distribution proof are stronger.
Coverage Experimental - 2%Quality Beta - 72%Completeness Beta - 79%Partial - 7
AreaCoverageQualityCompletenessDocs
Authoring and Packaging plugins8 capabilities / LTS-supported
Experimental2%
Alpha68%
Beta79%
Bundled plugins5 capabilities / LTS-supported
Experimental2%
Alpha68%
Beta79%
Canvas plugin6 capabilities
Experimental2%
Alpha68%
Beta79%
Installing and running plugins6 capabilities / LTS-supported
Experimental2%
Beta79%
Beta79%
Channel plugins5 capabilities / LTS-supported
Experimental2%
Alpha68%
Beta79%
Provider and tool plugins6 capabilities / LTS-supported
Experimental2%
Beta79%
Beta79%
Plugin approvals6 capabilities / LTS-supported
Experimental2%
Alpha68%
Beta79%
Publishing plugins6 capabilities / LTS-supported
Experimental2%
Alpha68%
Beta79%
Testing plugins6 capabilities
Experimental2%
Beta79%
Beta79%
Good docs and hardening surfaces exist. Promote after regular upgrade/security scenario runs prove no setup regressions.
Coverage Experimental - 0%Quality Beta - 72%Completeness Beta - 79%Partial - 5
AreaCoverageQualityCompletenessDocs
Approval Policy and Tool Safeguards2 capabilities / LTS-supported
Experimental0%
Beta79%
Beta79%
Gateway Auth and Remote Access9 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Channel Access Control3 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Device and Node Pairing11 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Plugin Trust2 capabilities
Experimental0%
Alpha68%
Beta79%
Credential and Secret Hygiene5 capabilities / LTS-supported
Experimental0%
Beta79%
Beta79%
Documented and usable, but scenario proof should cover unattended delivery, retries, and failure visibility.
Coverage Experimental - 0%Quality Beta - 72%Completeness Beta - 79%None
AreaCoverageQualityCompletenessDocs
Cron Jobs15 capabilities
Experimental0%
Beta79%
Beta79%
Automation Hooks11 capabilities
Experimental0%
Alpha68%
Beta79%
Background Tasks and Flows10 capabilities
Experimental0%
Alpha68%
Beta79%
Heartbeat5 capabilities
Experimental0%
Beta79%
Beta79%
Polling Controls10 capabilities
Experimental0%
Alpha68%
Beta79%
Broad capability surface exists, but provider variance, file limits, and node/app parity make this not stable yet.
Coverage Experimental - 1%Quality Alpha - 64%Completeness Alpha - 68%None
AreaCoverageQualityCompletenessDocs
Media Intake and Access8 capabilities
Experimental1%
Alpha61%
Alpha68%
Channel Media Handling5 capabilities
Experimental1%
Alpha61%
Alpha68%
Media Configuration1 capabilities
Experimental1%
Alpha61%
Alpha68%
Text-to-Speech Delivery2 capabilities
Experimental1%
Alpha61%
Alpha68%
Media Understanding12 capabilities
Experimental1%
Alpha69%
Alpha69%
Media Generation17 capabilities
Experimental1%
Alpha69%
Alpha69%
Multiple implementations exist across Control UI, apps, and providers. Needs latency, failure-mode, and setup scorecards before beta.
Coverage Experimental - 0%Quality Alpha - 61%Completeness Alpha - 68%None
AreaCoverageQualityCompletenessDocs
Talk Providers7 capabilities
Experimental0%
Alpha61%
Alpha68%
Realtime Talk Sessions11 capabilities
Experimental0%
Alpha61%
Alpha68%
Speech and Transcription5 capabilities
Experimental0%
Alpha61%
Alpha68%
Native App Talk4 capabilities
Experimental0%
Alpha61%
Alpha68%
Voice Wake and Routing4 capabilities
Experimental0%
Alpha61%
Alpha68%
Talk Observability5 capabilities
Experimental0%
Alpha61%
Alpha68%
Present in docs and source, but less visible as a primary user workflow. Needs explicit scenario definition.
Coverage Experimental - 0%Quality Alpha - 59%Completeness Alpha - 66%None
AreaCoverageQualityCompletenessDocs
Runtime Modes14 capabilities
Experimental0%
Alpha59%
Alpha66%
Input and Commands8 capabilities
Experimental0%
Alpha59%
Alpha66%
Session Management3 capabilities
Experimental0%
Alpha59%
Alpha66%
Local Shell Execution4 capabilities
Experimental0%
Alpha59%
Alpha66%
Rendering and Output Safety4 capabilities
Experimental0%
Alpha59%
Alpha66%
Public docs and ecosystem concept exist. Needs install, trust, update, rollback, and compatibility scorecards.
Coverage Experimental - 0%Quality Alpha - 58%Completeness Alpha - 62%None
AreaCoverageQualityCompletenessDocs
Publishing7 capabilities
Experimental0%
Alpha54%
Alpha55%
Catalog Discovery5 capabilities
Experimental0%
Alpha61%
Alpha68%
Compatibility and Trust12 capabilities
Experimental0%
Alpha55%
Alpha56%
Plugin Lifecycle and Health26 capabilities
Experimental0%
Alpha61%
Alpha68%
OpenClaw App SDK is a distinct external app contract separate from Gateway runtime and Plugin SDK. Current scoring shows a real @openclaw/sdk path with gaps around public packaging, auto-discovery, approvals, helpers, and compatibility.
Coverage Experimental - 0%Quality Alpha - 54%Completeness Alpha - 53%None
AreaCoverageQualityCompletenessDocs
Client API4 capabilities
Experimental0%
Alpha51%
Alpha50%
Gateway Access5 capabilities
Experimental0%
Alpha53%
Alpha54%
Agent Conversations6 capabilities
Experimental0%
Alpha52%
Alpha52%
Events and Approvals5 capabilities
Experimental0%
Alpha52%
Alpha52%
Resource Helpers5 capabilities
Experimental0%
Alpha62%
Alpha53%
Compatibility5 capabilities
Experimental0%
Alpha54%
Alpha55%

Platform

Node runtime is recommended, systemd user service is documented, and VPS/container guidance is broad.
Coverage Experimental - 0%Quality Beta - 75%Completeness Stable - 89%Partial - 4
AreaCoverageQualityCompletenessDocs
Host Setup and Updates4 capabilities / LTS-supported
Experimental0%
Beta75%
Stable89%
Gateway Runtime and Service Control6 capabilities / LTS-supported
Experimental0%
Beta75%
Stable89%
Remote Access and Security6 capabilities / LTS-supported
Experimental0%
Beta75%
Stable89%
Diagnostics and Repair4 capabilities / LTS-supported
Experimental0%
Beta75%
Stable89%
Deployment Targets3 capabilities
Experimental0%
Beta75%
Stable89%
LaunchAgent service path, local/remote Gateway modes, CLI install, and app integration are documented.
Coverage Experimental - 0%Quality Beta - 74%Completeness Stable - 88%None
AreaCoverageQualityCompletenessDocs
CLI Setup4 capabilities
Experimental0%
Beta74%
Stable88%
Local Gateway Integration9 capabilities
Experimental0%
Beta74%
Stable88%
Remote Gateway Mode5 capabilities
Experimental0%
Beta74%
Stable88%
Gateway Service Lifecycle10 capabilities
Experimental0%
Beta74%
Stable88%
Diagnostics and Observability4 capabilities
Experimental0%
Beta74%
Stable88%
Permissions and Native Capabilities4 capabilities
Experimental0%
Beta74%
Stable88%
Profiles and Isolation5 capabilities
Experimental0%
Beta74%
Stable88%
Install docs exist and are common deployment paths. Promote after recurring release smoke captures upgrade and volume behavior.
Coverage Experimental - 5%Quality Beta - 71%Completeness Beta - 79%None
AreaCoverageQualityCompletenessDocs
Container Setup6 capabilities
Experimental5%
Alpha68%
Beta79%
Container Operations11 capabilities
Experimental5%
Alpha68%
Beta79%
Image Release and Validation5 capabilities
Experimental5%
Beta79%
Beta79%
Agent Sandbox and Tooling3 capabilities
Experimental5%
Alpha68%
Beta79%
Recommended Windows path with systemd/user-service guidance and boot-chain docs. Promote after repeated install/update scorecards.
Coverage Experimental - 3%Quality Alpha - 69%Completeness Beta - 79%Partial - 5
AreaCoverageQualityCompletenessDocs
WSL Setup6 capabilities / LTS-supported
Experimental3%
Alpha67%
Beta79%
CLI8 capabilities / LTS-supported
Experimental3%
Alpha67%
Beta79%
Gateway Service Lifecycle10 capabilities / LTS-supported
Experimental3%
Alpha67%
Beta79%
Gateway Access and Exposure11 capabilities / LTS-supported
Experimental3%
Alpha67%
Beta79%
Diagnostics and Repair6 capabilities / LTS-supported
Experimental3%
Beta79%
Beta79%
Browser and Control UI6 capabilities
Experimental3%
Alpha67%
Beta79%
Platform docs exist and Gateway path is Linux-based. Needs hardware-specific release smoke proof to move higher.
Coverage Experimental - 0%Quality Alpha - 67%Completeness Beta - 79%None
AreaCoverageQualityCompletenessDocs
Setup and Compatibility12 capabilities
Experimental0%
Alpha67%
Beta79%
Remote Access and Auth9 capabilities
Experimental0%
Alpha67%
Beta79%
Gateway Runtime10 capabilities
Experimental0%
Alpha67%
Beta79%
Performance and Diagnostics5 capabilities
Experimental0%
Alpha67%
Beta79%
Rich menu bar app, permissions, node mode, Canvas, voice wake, WebChat, and remote mode exist. Still fast-moving enough to avoid Stable.
Coverage Experimental - 0%Quality Alpha - 66%Completeness Beta - 78%None
AreaCoverageQualityCompletenessDocs
Canvas4 capabilities
Experimental0%
Alpha66%
Beta78%
Local Setup7 capabilities
Experimental0%
Alpha66%
Beta78%
Status and Settings5 capabilities
Experimental0%
Alpha66%
Beta78%
Native Capabilities5 capabilities
Experimental0%
Alpha66%
Beta78%
Remote Connections3 capabilities
Experimental0%
Alpha66%
Beta78%
Voice and Talk3 capabilities
Experimental0%
Alpha66%
Beta78%
WebChat3 capabilities
Experimental0%
Alpha66%
Beta78%
Remote WebChat5 capabilities
Experimental0%
Alpha66%
Beta78%
Public Google Play path exists, but app docs still describe the rebuild as extremely alpha and call out release hardening work.
Coverage Experimental - 0%Quality Alpha - 59%Completeness Alpha - 66%None
AreaCoverageQualityCompletenessDocs
Media Capture1 capabilities
Experimental0%
Alpha59%
Alpha66%
Mobile Chat1 capabilities
Experimental0%
Alpha59%
Alpha66%
Connection Setup1 capabilities
Experimental0%
Alpha59%
Alpha66%
Distribution3 capabilities
Experimental0%
Alpha59%
Alpha66%
Settings1 capabilities
Experimental0%
Alpha59%
Alpha66%
Voice1 capabilities
Experimental0%
Alpha59%
Alpha66%
Device Runtime2 capabilities
Experimental0%
Alpha59%
Alpha66%
Core CLI/Gateway flows work, but docs still recommend WSL2 for the full experience and list native caveats.
Coverage Experimental - 0%Quality Alpha - 58%Completeness Alpha - 66%Partial - 1
AreaCoverageQualityCompletenessDocs
CLI9 capabilities / LTS-supported
Experimental0%
Alpha54%
Alpha64%
Gateway Management11 capabilities
Experimental0%
Alpha59%
Alpha66%
Networking4 capabilities
Experimental0%
Alpha59%
Alpha66%
Updates4 capabilities
Experimental0%
Alpha59%
Alpha66%
Kubernetes hosting is a distinct Kustomize-based cluster deployment path. Current scoring shows a real minimal deployment path with gaps around Kubernetes-specific CI, ingress/TLS/NetworkPolicy packaging, backup/restore, and production exposure hardening.
Coverage Experimental - 0%Quality Alpha - 55%Completeness Alpha - 61%None
AreaCoverageQualityCompletenessDocs
Deployment Setup5 capabilities
Experimental0%
Alpha55%
Alpha61%
Configuration and Secrets5 capabilities
Experimental0%
Alpha55%
Alpha61%
Access and Exposure5 capabilities
Experimental0%
Alpha55%
Alpha61%
Cluster Lifecycle5 capabilities
Experimental0%
Alpha55%
Alpha61%
Internal preview / super-alpha. TestFlight and relay-backed push flows exist, but no public distribution yet.
Coverage Experimental - 0%Quality Experimental - 41%Completeness Experimental - 44%None
AreaCoverageQualityCompletenessDocs
Media and Sharing1 capabilities
Experimental0%
Experimental41%
Experimental44%
Canvas and Screen1 capabilities
Experimental0%
Experimental41%
Experimental44%
Chat and Sessions1 capabilities
Experimental0%
Experimental41%
Experimental44%
Gateway Setup and Diagnostics7 capabilities
Experimental0%
Experimental41%
Experimental44%
Distribution1 capabilities
Experimental0%
Experimental41%
Experimental44%
Device Commands2 capabilities
Experimental0%
Experimental41%
Experimental44%
Notifications and Background1 capabilities
Experimental0%
Experimental41%
Experimental44%
Voice1 capabilities
Experimental0%
Experimental41%
Experimental44%
Optional install flow. Needs clearer support promise before alpha/beta promotion.
Coverage Experimental - 0%Quality Experimental - 41%Completeness Experimental - 44%None
AreaCoverageQualityCompletenessDocs
Install Handoff4 capabilities
Experimental0%
Experimental41%
Experimental44%
Plugin Lifecycle4 capabilities
Experimental0%
Experimental41%
Experimental44%
Activation and App UX7 capabilities
Experimental0%
Experimental41%
Experimental44%
Config and State7 capabilities
Experimental0%
Experimental41%
Experimental44%
Service Runtime and Guards8 capabilities
Experimental0%
Experimental41%
Experimental44%
Source has Watch app/extension surfaces; public docs do not yet present this as a user feature.
Coverage Experimental - 0%Quality Experimental - 41%Completeness Experimental - 44%None
AreaCoverageQualityCompletenessDocs
Delivery and Recovery7 capabilities
Experimental0%
Experimental41%
Experimental44%
Exec Approvals3 capabilities
Experimental0%
Experimental41%
Experimental44%
Distribution and Support6 capabilities
Experimental0%
Experimental41%
Experimental44%
Notifications and Replies7 capabilities
Experimental0%
Experimental41%
Experimental44%
Watch App UI3 capabilities
Experimental0%
Experimental41%
Experimental44%
Docs say native Linux companion apps are planned; Gateway is the supported Linux path today.
Coverage Experimental - 0%Quality Experimental - 19%Completeness Experimental - 21%None
AreaCoverageQualityCompletenessDocs
App Distribution3 capabilities
Experimental0%
Experimental19%
Experimental21%
Gateway Connectivity4 capabilities
Experimental0%
Experimental19%
Experimental21%
Chat and Sessions3 capabilities
Experimental0%
Experimental19%
Experimental21%
Desktop Capabilities9 capabilities
Experimental0%
Experimental19%
Experimental21%
Status and Diagnostics7 capabilities
Experimental0%
Experimental19%
Experimental21%
Planned only.
Coverage Experimental - 0%Quality Experimental - 19%Completeness Experimental - 21%None
AreaCoverageQualityCompletenessDocs
Installation and Updates4 capabilities
Experimental0%
Experimental19%
Experimental21%
Gateway Connection3 capabilities
Experimental0%
Experimental19%
Experimental21%
Chat Sessions2 capabilities
Experimental0%
Experimental19%
Experimental21%
Status and Repair5 capabilities
Experimental0%
Experimental19%
Experimental21%
Desktop Tools and Permissions10 capabilities
Experimental0%
Experimental19%
Experimental21%

Channel

Deep docs and broad feature coverage. Voice/delegation paths should stay separately scored as beta/alpha.
Coverage Experimental - 0%Quality Beta - 73%Completeness Stable - 87%Partial - 4
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations10 capabilities / LTS-supported
Experimental0%
Beta73%
Stable87%
Access and Identity6 capabilities / LTS-supported
Experimental0%
Beta73%
Stable87%
Conversation Routing and Delivery12 capabilities / LTS-supported
Experimental0%
Beta73%
Stable87%
Media and Rich Content1 capabilities / LTS-supported
Experimental0%
Beta73%
Stable87%
Native Controls and Approvals5 capabilities
Experimental0%
Beta73%
Stable87%
Realtime Voice and Calls5 capabilities
Experimental0%
Beta73%
Stable87%
Core channel is mature enough for regular use, but high-variance UX and media edge cases need recurring scenario proof.
Coverage Experimental - 0%Quality Alpha - 68%Completeness Beta - 78%Full - 5
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations10 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Access and Identity10 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Conversation Routing and Delivery1 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Media and Rich Content1 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Native Controls and Approvals9 capabilities / LTS-supported
Experimental0%
Beta77%
Beta79%
First-class channel docs and routing surface. Needs workspace install/admin scenario scorecards.
Coverage Experimental - 0%Quality Alpha - 66%Completeness Beta - 78%Full - 5
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations10 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Access and Identity1 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Conversation Routing and Delivery5 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Media and Rich Content1 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Native Controls and Approvals8 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Supported iMessage runs through imsg on a signed-in macOS Messages host; legacy BlueBubbles configs require migration. Keep macOS permissions, SSH wrapper, SIP/private API, and migration caveats visible.
Coverage Experimental - 0%Quality Alpha - 66%Completeness Beta - 78%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations11 capabilities
Experimental0%
Alpha66%
Beta78%
Access and Identity6 capabilities
Experimental0%
Alpha66%
Beta78%
Conversation Routing and Delivery4 capabilities
Experimental0%
Alpha66%
Beta78%
Media and Rich Content7 capabilities
Experimental0%
Alpha66%
Beta78%
Native Controls and Approvals3 capabilities
Experimental0%
Alpha66%
Beta78%
Core path is important and documented; upstream Baileys/session volatility keeps it below Stable.
Coverage Experimental - 0%Quality Alpha - 66%Completeness Beta - 78%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations5 capabilities
Experimental0%
Alpha66%
Beta78%
Access and Identity7 capabilities
Experimental0%
Alpha66%
Beta78%
Conversation Routing and Delivery4 capabilities
Experimental0%
Alpha66%
Beta78%
Media and Rich Content2 capabilities
Experimental0%
Alpha66%
Beta78%
Native Controls and Approvals2 capabilities
Experimental0%
Alpha66%
Beta78%
Supported via bundled plugin. Needs bridge, auth, and room lifecycle scorecards.
Coverage Experimental - 0%Quality Alpha - 60%Completeness Alpha - 67%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations5 capabilities
Experimental0%
Alpha60%
Alpha67%
Access and Identity7 capabilities
Experimental0%
Alpha60%
Alpha67%
Conversation Routing and Delivery1 capabilities
Experimental0%
Alpha60%
Alpha67%
Media and Rich Content1 capabilities
Experimental0%
Alpha60%
Alpha67%
Native Controls and Approvals6 capabilities
Experimental0%
Alpha60%
Alpha67%
Encryption and Verification3 capabilities
Experimental0%
Alpha60%
Alpha67%
Documented channel, but enterprise/admin setup raises maturity risk.
Coverage Experimental - 0%Quality Alpha - 59%Completeness Alpha - 66%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations16 capabilities
Experimental0%
Alpha59%
Alpha66%
Access and Identity11 capabilities
Experimental0%
Alpha59%
Alpha66%
Conversation Routing and Delivery1 capabilities
Experimental0%
Alpha59%
Alpha66%
Media and Rich Content1 capabilities
Experimental0%
Alpha59%
Alpha66%
Native Controls and Approvals16 capabilities
Experimental0%
Alpha59%
Alpha66%
Enterprise auth/admin flows need explicit scenario proof.
Coverage Experimental - 0%Quality Alpha - 59%Completeness Alpha - 66%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations9 capabilities
Experimental0%
Alpha59%
Alpha66%
Access and Identity9 capabilities
Experimental0%
Alpha59%
Alpha66%
Conversation Routing and Delivery5 capabilities
Experimental0%
Alpha59%
Alpha66%
Media and Rich Content5 capabilities
Experimental0%
Alpha59%
Alpha66%
Native Controls and Approvals5 capabilities
Experimental0%
Alpha59%
Alpha66%
Supported channel docs exist; needs stronger install and reconnect proof.
Coverage Experimental - 0%Quality Alpha - 59%Completeness Alpha - 66%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations7 capabilities
Experimental0%
Alpha59%
Alpha66%
Access and Identity6 capabilities
Experimental0%
Alpha59%
Alpha66%
Conversation Routing and Delivery1 capabilities
Experimental0%
Alpha59%
Alpha66%
Media and Rich Content7 capabilities
Experimental0%
Alpha59%
Alpha66%
Native Controls and Approvals3 capabilities
Experimental0%
Alpha59%
Alpha66%
Important regional coverage, but public support level should be calibrated per account type, upstream approval, and maintainer proof.
Coverage Experimental - 0%Quality Alpha - 55%Completeness Alpha - 58%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations6 capabilities
Experimental0%
Alpha61%
Alpha68%
Access and Identity1 capabilities
Experimental0%
Alpha53%
Alpha54%
No linked docs
Conversation Routing and Delivery1 capabilities
Experimental0%
Alpha53%
Alpha54%
No linked docs
Media and Rich Content1 capabilities
Experimental0%
Alpha53%
Alpha54%
No linked docs
Supported surfaces exist, but maturity likely varies by upstream and maintainer coverage. Score individually later.
Coverage Experimental - 0%Quality Alpha - 53%Completeness Alpha - 54%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations1 capabilities
Experimental0%
Alpha53%
Alpha54%
No linked docs
Access and Identity1 capabilities
Experimental0%
Alpha53%
Alpha54%
No linked docs
Conversation Routing and Delivery1 capabilities
Experimental0%
Alpha53%
Alpha54%
No linked docs
Media and Rich Content1 capabilities
Experimental0%
Alpha53%
Alpha54%
No linked docs
Optional/plugin path with complex realtime behavior. Needs scenario scorecard before public beta.
Coverage Experimental - 0%Quality Experimental - 41%Completeness Experimental - 44%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations2 capabilities
Experimental0%
Experimental41%
Experimental44%
Access and Identity1 capabilities
Experimental0%
Experimental41%
Experimental44%
Conversation Routing and Delivery1 capabilities
Experimental0%
Experimental41%
Experimental44%
Media and Rich Content2 capabilities
Experimental0%
Experimental41%
Experimental44%
Realtime Voice and Calls2 capabilities
Experimental0%
Experimental41%
Experimental44%

Provider and tool

Core tools are documented, but host security and permission UX should stay under active scorecard review.
Coverage Experimental - 15%Quality Beta - 75%Completeness Beta - 79%Partial - 2
AreaCoverageQualityCompletenessDocs
Browser Automation8 capabilities
Experimental15%
Beta79%
Beta79%
Tool Invocation and Execution6 capabilities / LTS-supported
Experimental15%
Beta79%
Beta79%
Sandbox and Tool Policy6 capabilities / LTS-supported
Experimental15%
Alpha68%
Beta79%
Deep docs, OAuth/subscription path, realtime voice, image, and compatibility behavior. Provider churn keeps this from Stable without release-scorecard proof.
Coverage Experimental - 8%Quality Beta - 74%Completeness Beta - 79%Partial - 3
AreaCoverageQualityCompletenessDocs
Model and Auth6 capabilities / LTS-supported
Experimental8%
Beta79%
Beta79%
Responses and Tool Compatibility4 capabilities / LTS-supported
Experimental8%
Beta79%
Beta79%
Native Codex Harness2 capabilities / LTS-supported
Experimental8%
Beta79%
Beta79%
Image and Multimodal Input2 capabilities
Experimental8%
Alpha67%
Beta79%
Voice and Realtime Audio2 capabilities
Experimental8%
Alpha67%
Beta79%
Multiple providers and docs exist. Needs quota/error/SSRF proof per provider family.
Coverage Experimental - 7%Quality Beta - 74%Completeness Beta - 79%None
AreaCoverageQualityCompletenessDocs
Setup and Diagnostics9 capabilities
Experimental7%
Alpha68%
Beta79%
Network Safety4 capabilities
Experimental7%
Alpha68%
Beta79%
Tool Availability and Fetch11 capabilities
Experimental7%
Beta79%
Beta79%
First-class model provider. Needs recurring auth/catalog/tool-call scenario proof.
Coverage Experimental - 0%Quality Beta - 71%Completeness Beta - 78%None
AreaCoverageQualityCompletenessDocs
Provider Auth and Recovery9 capabilities
Experimental0%
Alpha66%
Beta78%
Model and Runtime Selection10 capabilities
Experimental0%
Beta78%
Beta79%
Request Transport and Turn Semantics10 capabilities
Experimental0%
Beta77%
Beta79%
Prompt Cache and Context5 capabilities
Experimental0%
Alpha66%
Beta78%
Media Inputs4 capabilities
Experimental0%
Alpha66%
Beta78%
First-class provider with model and realtime surfaces. Needs separate Live/Talk scoring.
Coverage Experimental - 0%Quality Alpha - 66%Completeness Beta - 78%None
AreaCoverageQualityCompletenessDocs
Provider Setup and Credentials10 capabilities
Experimental0%
Alpha66%
Beta78%
Model Routing and Endpoints10 capabilities
Experimental0%
Alpha66%
Beta78%
Direct Gemini Runtime9 capabilities
Experimental0%
Alpha66%
Beta78%
Media, Search, and Realtime10 capabilities
Experimental0%
Alpha66%
Beta78%
Prompt Caching5 capabilities
Experimental0%
Alpha66%
Beta78%
Unified provider path is documented and valuable, but model-specific behavior varies.
Coverage Experimental - 0%Quality Alpha - 66%Completeness Beta - 78%None
AreaCoverageQualityCompletenessDocs
Provider Setup and Auth14 capabilities
Experimental0%
Alpha66%
Beta78%
Chat Runtime and Normalization15 capabilities
Experimental0%
Alpha66%
Beta78%
Provider Recovery and Diagnostics5 capabilities
Experimental0%
Alpha66%
Beta78%
Media Generation and Speech7 capabilities
Experimental0%
Alpha66%
Beta78%
Capability exists across providers, but quality, latency, and parameter compatibility vary too much for beta without per-provider proof.
Coverage Experimental - 0%Quality Alpha - 61%Completeness Alpha - 68%None
AreaCoverageQualityCompletenessDocs
Media Routing and Discovery4 capabilities
Experimental0%
Alpha61%
Alpha68%
Task Lifecycle and Delivery12 capabilities
Experimental0%
Alpha61%
Alpha68%
Image Generation9 capabilities
Experimental0%
Alpha61%
Alpha68%
Video Generation11 capabilities
Experimental0%
Alpha61%
Alpha68%
Music Generation6 capabilities
Experimental0%
Alpha61%
Alpha68%
Useful and documented, but environment variance is high.
Coverage Experimental - 0%Quality Alpha - 61%Completeness Alpha - 68%None
AreaCoverageQualityCompletenessDocs
Provider Setup, Lifecycle, and Diagnostics12 capabilities
Experimental0%
Alpha61%
Alpha68%
Native Provider Plugins10 capabilities
Experimental0%
Alpha61%
Alpha68%
OpenAI-Compatible Runtime Compatibility8 capabilities
Experimental0%
Alpha61%
Alpha68%
Local Memory and Embeddings5 capabilities
Experimental0%
Alpha61%
Alpha68%
Network Safety and Prompt Controls2 capabilities
Experimental0%
Alpha61%
Alpha68%
Many docs/reference pages exist; score should be generated from provider metadata plus live smoke coverage.
Coverage Experimental - 0%Quality Alpha - 61%Completeness Alpha - 68%None
AreaCoverageQualityCompletenessDocs
Hosted LLM Providers12 capabilities
Experimental0%
Alpha61%
Alpha68%
Hosted Media Providers8 capabilities
Experimental0%
Alpha61%
Alpha68%
Provider Operations12 capabilities
Experimental0%
Alpha61%
Alpha68%