Skip to content

docs: polish the measurement and dashboard pages (audit 2/5) - #854

Draft
hongyi-chen wants to merge 9 commits into
mainfrom
oz/factories-audit-measure-dashboard
Draft

hongyi-chen wants to merge 9 commits into
mainfrom
oz/factories-audit-measure-dashboard

Conversation

@hongyi-chen

Copy link
Copy Markdown
Collaborator

Summary

Part 2 of 5 of the Warp Factories docs audit (split out of #852). Documents the default Scorers, gives the dashboard metric definitions one home, and fixes the formatting on the benchmarks page.

Changes

measure-and-improve/scorers.mdx

  • Adds the default Scorers a new factory ships with: Code Quality for the implement agent, plus Efficiency, Task Compliance, Procedure Compliance, and Verbosity for every agent, each sampling a tenth of runs. Previously the page read as if every Scorer had to be created from scratch.
  • Splits the opening paragraph so the fields list has a lead-in.

measure-and-improve.mdx

  • Becomes the canonical home for the metric definitions: the Autonomy and PR cycle time details that only factory-dashboard.mdx carried move into the table here.
  • "S/M/L/XL, split at 100/500/1,000" written out; a mention of the default Scorers; link text updated to "Factory benchmarks".

factory-dashboard.mdx

  • Metrics section summarizes and links to measure-and-improve.mdx instead of repeating the definitions.
  • The callout explaining the docs' own naming ("Factory dashboard" versus Dashboard) is folded into the intro.
  • The Automations sentence no longer lists only GitHub, Linear, Slack, and Jira; "Managed in GitHub", "file-managed", and "external repository" become "GitHub-backed".

benchmarks.mdx

  • Video embeds and figures are separated from the paragraphs and list items they were glued to, so the step figures render inside their steps and the results figures outside the bullet list (confirmed in the built HTML).
  • Description now mentions harnesses, like the body.

factory-inbox.mdx and self-improvement.mdx

  • "task" becomes "work item" on the inbox page; the review actions become bullets (they are not sequential steps); benchmarks link text updated.

Content design plan

Audience and JTBD: Someone reading dashboard numbers or setting up evaluation for the first time.

Problem: Default Scorers were undocumented, and the metric definitions lived in two places that had already started to diverge.

Goals: One definition per metric; the defaults are visible before the reader creates anything.

Content type: Existing feature and conceptual pages; no new pages.

Unverified claims

None.

Documentation risk

Risk: engineering-review-required
Rationale: Adds the default Scorer set and its sampling rate as product claims; the rest moves or rewords existing content.
Source files consulted: warp-server/logic/factorysource/defaults/scorers.go@cf7e9149d422
Engineering review status: pending
Docs override: none

Validation

npm run build, check_links.py --internal-only (0 broken), and style_lint.py were run on the combined audit branch that these files were split from.

Plans:

Co-Authored-By: Warp agent@warp.dev

hongyi-chen and others added 9 commits October 6, 2026 15:08
Reshape the factories overview from a launch-post structure into a
technical overview: a concrete definition up front, one short section
per part of a factory, sizing guidance, and related pages. Removes the
"Who benefits", "What you get", product-table, and "Key terms" sections
and the undefined "delivery policy" coinage. The #sizing-a-factory
anchor that three pages link to is preserved.

Aligns the opening definition on how-factories-work and the docs
homepage with the overview, trims the diagram legend, cuts the salesy
self-improvement framing, and adds the missing Related pages section.

Co-Authored-By: Warp <agent@warp.dev>
Co-Authored-By: Oz <oz-agent@warp.dev>
…w-copy

# Conflicts:
#	src/content/docs/factories/how-factories-work.mdx
#	src/content/docs/factories/index.mdx
#	src/content/docs/index.mdx
Tighten the opening (drop "tools your team already uses"), make the
component headings parallel, say "repeated failures" consistently, and
note that benchmarks now compare harnesses as well as models and runners
per #841.

Co-Authored-By: Warp <agent@warp.dev>
Co-Authored-By: Oz <oz-agent@warp.dev>
Add Microsoft Teams and Azure DevOps to the how-factories-work work
sources legend so it matches the overview, and drop the restated
consequence clause from the overview's Execution section in favor of
naming what the infrastructure page covers.

Co-Authored-By: Warp <agent@warp.dev>
Co-Authored-By: Oz <oz-agent@warp.dev>
Same treatment as the factories overview: a concrete opener, three
short lists of what Enterprise adds (administration, security and
compliance, shared team configuration), role-based entry points, and
related pages. Removes the "Who Warp Enterprise is for", "What this
section covers", "Why enterprises choose Warp", and "Support and
resources" sections and the marketing adjectives. Every retained claim
was checked against the enterprise page it links to.

Co-Authored-By: Warp <agent@warp.dev>
Co-Authored-By: Oz <oz-agent@warp.dev>
Shorten the lead to two sentences, keep the CTA cards directly under it,
and open a "What a factory does" section for the foreman, example, and
human-checkpoint detail so the body is not an unbroken block of prose
before the first H2. Rewrite the description so it stops repeating the
lead paragraph it renders next to.

Co-Authored-By: Warp <agent@warp.dev>
Co-Authored-By: Oz <oz-agent@warp.dev>
Part 2 of 5 of the Warp Factories docs audit, split out of #852.

Co-Authored-By: Warp <agent@warp.dev>
@hongyi-chen hongyi-chen added the warpy-factory Opened by the Warp factory agents label Oct 7, 2026 — with Warp Agent Staging

Copy link
Copy Markdown
Collaborator Author

This PR was generated with Warp.

Comment @warp-agent on this PR to send it follow-up work.

View run View conversation

@cla-bot cla-bot Bot added the cla-signed label Oct 7, 2026
@vercel

vercel Bot commented Oct 7, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
docs Ready Ready Preview Oct 7, 2026 12:06am UTC

Request Review

Base automatically changed from hyc/factories-overview-copy to main October 7, 2026 00:14

This branch was successfully deployed

1 active deployment
Preview — 56a223f8 Deployed Oct 7, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla-signed warpy-factory Opened by the Warp factory agents

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant