- Facts and progress
- On April 1, we exposed the new onboarding checklist to 50% of new workspace users. By April 14, 620 users were eligible: 311 saw the checklist and 309 remained in the control group. Seven-day activation was 44% for the exposed group and 38% for control. Eight user interviews were completed; five participants said the sample project helped them understand the first step. Setup-related support tickets fell from 52 in the prior two-week period to 39 across both cohorts in this period.
- Risks and uncertainty
- The activation difference has not yet been tested for statistical significance. Tracking for the ‘invite a teammate’ action was missing until April 6. A mobile checklist bug affected 23 sessions on April 9–10 and was fixed on April 10. The analyst will rerun the comparison excluding incomplete tracking windows by April 18.
- Decision or support needed
- VP Product should decide by April 19 whether to increase exposure to 100% on April 22 or keep the 50/50 test running for one more week.