{"id":"mkt-x-checkout-ab-test-ideas","track":"marketing","audience":"product-managers","category":"brainstorming","technique":"constraints","title":"Brainstorm A/B tests that each change only one thing","free":false,"task":"You're the PM for the checkout page at Wrenfield Home, an online furniture store, and want test ideas for next sprint. Brainstorm exactly 5 numbered ideas, each one line written as Change: ... | Metric: ..., under 20 words, with each test changing only one element. Stay inside the freeze: nothing about prices, shipping fees or the logo. Plain text, only the list.","materialLabel":"Checkout notes (attached to your prompt automatically)","material":"WRENFIELD HOME - checkout page, test planning notes (Oct)\n\nCurrent numbers (last 30 days):\n- 18,200 people reached checkout\n- 61% completed the order\n- Biggest drop-off: the shipping address step (22% leave there)\n- 9% leave at payment\n- Mobile completion is 52%, desktop 70%\n\nWhat customers say (support tickets + exit survey):\n- \"I didn't know when it would arrive until the last step\"\n- \"Too many form fields\"\n- \"Wanted to pay with a buy-now-pay-later option\" (not possible this quarter, payments vendor contract)\n- \"Coupon box made me leave to go find a coupon\"\n\nFREEZE (from leadership, through Jan 31):\n- No changes to prices, discounts or shipping fees\n- No changes to the logo or brand colors (rebrand in Feb)\n\nAnalytics:\n- Main metric: checkout completion rate\n- Secondary: time to complete checkout, mobile completion rate\n\nIdeas floating around:\n- Free shipping banner (breaks the freeze)\n- Hide the coupon box behind a link\n- Show the delivery date on the cart page\n- Redo everything at once in a new one-page checkout","rules":[{"type":"numberedItems","count":5},{"type":"plainText"}],"mistakes":[{"title":"Asking for \"test ideas\"","why":"The AI gives 10+ ideas grouped under bold headings with a hypothesis paragraph each.","fix":"Set the count and shape: \"Exactly 5 numbered lines: Change: ... | Metric: ...\"","checks":["numberedItems","plainText","r0"]},{"title":"Bundling changes","why":"AI loves big ideas like a new one-page checkout, which can't tell you what worked.","fix":"Add: \"Each test changes exactly one element.\"","checks":["r1"]},{"title":"Ignoring the freeze","why":"Free shipping and discounts are the AI's go-to checkout fixes.","fix":"Add: \"Nothing about prices, discounts, shipping fees or the logo.\"","checks":["r2"]},{"title":"Suggesting what can't ship","why":"The AI suggests buy-now-pay-later because customers asked for it.","fix":"Add: \"No new payment options this quarter.\"","checks":["r2"]}],"promptHints":[{"label":"Says how many","patterns":["\\b(5|five)\\b.{0,20}(ideas|tests)","exactly \\d+"]},{"label":"Sets the line shape","patterns":["change:","metric","\\|"]},{"label":"One change per test","patterns":["one (change|element|thing|variable)","single (change|element|variable)"]},{"label":"Respects the freeze","patterns":["freeze","price","shipping fee","logo"]},{"label":"Asks for only the list","patterns":["only the (numbered )?list","no (intro|notes|explanation)","nothing else","plain text"]}],"hint":"Good A/B tests change one thing. Tell the AI the shape of each idea, the one-change rule, and what's frozen.","rubricLabels":["Every idea is one line in the shape 'Change: ... | Metric: ...' and under 20 words","Each idea changes only one element (no idea bundles several changes or proposes a full checkout redesign)","No idea touches prices, discounts, shipping fees, free shipping, the logo or brand colors, and no idea adds a buy-now-pay-later option; the reply is only the numbered list"]}