Experiments — A/B, honestly
Variants, claims, subjects — same framework, one table. Click any row to drill into the A/B detail below.
Name & segmentControl vs. treatmentSampleMetricWinnerStatus
Observation-led vs Thesis-led (Home)
home_services · started jun 22
A · var-thumb-datamodel · 0%
B · var-thumb-auction · 0%
3 / 40
reply rate
too early
pending
running
Vignette vs Thesis (Tutoring)
tutoring · started jun 08
A · var-preply-serestar · 100%
B · var-preply-arch · 0%
4 / 20
reply rate
Δ +54pp · p<0.05
Δ +54pp · p<0.05
concluded
CTO-register vs CEO-register (tech buyers)
tutoring · started jun 14
A · var-preply-serestar · 50%
B · var-preply-arch · 0%
4 / 30
meeting rate
Δ +35pp (winner trending)
pending
running
Ask specificity (specific slot vs loose window)
care · started may 15
A · var-care-signal · 40%
B · var-care-thesis · 10%
40 / 40
meeting rate
Δ +31pp · p=0.03
Δ +31pp · p=0.03
concluded
Credential beat · single-line vs expanded
care · started may 01
A · var-care-signal · 80%
B · var-care-signal · 58%
30 / 30
open rate
Δ +22pp · p<0.05 (too credential dropped open rate)
Δ +22pp · p<0.05 (too credential dropped open rate)
concluded
Subject · lowercase-short vs title-long
home_services · started jun 19
A · var-angi-q4 · 0%
B · var-angi-street · 0%
2 / 30
open rate
too early
pending
running
Signal-led vs Thesis-led (Care) · care
scope: hook · split 0.5 · started jun 12 · 6 / 40 sends · p=0.34· stop: p<0.10, day 21
A · control
care-signal-led · 32-day-clock
year-one board deck + ai-originated demand
sends 4replies 1rate 25%
B · treatment
care-thesis-led · ai-demand-inflection
care.com: the ai-demand inflection
sends 2replies 0rate 0%