A/B Test Analysis

From raw experiment data to actionable recommendation in 8 minutes

8 minutesManual: 45-90 minutes

Takes A/B test results and produces a structured analysis: statistical significance check, segment breakdowns, impact projection, and a clear recommendation with confidence level. Catches common mistakes like stopping tests too early.

Workflow Steps

1

Data Intake

/excel-work

Parse test results from CSV/Excel with validation checks

2

Statistical Analysis

/excel-work

Significance testing, confidence intervals, and sample size validation

3

Segment Breakdown

/synthesize-knowledge

Analyze performance by segment, device, and traffic source

4

Recommendation

/produce-content

Written recommendation with confidence level and next steps

Example

Landing page test with 12,000 visitors. The workflow imports results, confirms 95% significance on the primary metric, discovers that variant B wins overall but loses on mobile, and recommends shipping B with a mobile-specific follow-up test.

Related Workflows

Channel Performance Review

Monthly cross-channel analysis with spend reallocation recommendations

15 minutes

Campaign Planning

From brief to fully scoped campaign plan in 20 minutes

20 minutes

Deep Dives

Claude Code for GTM

Ready to automate this workflow?

Every workflow ships with Knowledge OS. Set up your system in 90 minutes.

View Pricing All Workflows

Built and maintained by Victor Sowers at STEEPWORKS