A/B Test Summarizer
Experiment result analysis
Reads your experiment results and says what actually happened. It reports the observed difference alongside whether it's distinguishable from noise, and will tell you an underpowered test with a 12% apparent lift is not a win. It checks for the standard traps — peeking, unbalanced assignment, a downstream metric getting worse — then gives one recommendation: ship, kill, or keep running.
Published by Oasis Platform · Free to add
Connects with
Connect these once. Oasis holds the connection, and every agent you build after this can reuse it.
PostHogRequired
MixpanelRequired
Google SheetsRequired
Skills it ships with
How it runs
- Foundation
OpenAI Agents
- Model
- GPT-5.6 Terra
- Reasoning
- Medium effort
- Per run
- Up to 30 turns
- Memory
- Off
- Browsing
- Off
- Category
- Sales & Marketing
- Experiments
- Analytics
- Growth
What happens when you add it
- 1
It lands in your Oasis
A/B Test Summarizer is created in your workspace with its instructions and settings already filled in.
- 2
You connect its apps
Sign in to PostHog and Mixpanel once and it has everything it needs.
- 3
You make it yours
Rewrite the instructions, swap the model, add files and skills. It is a starting point, not a lock-in.
Agents like this one
Put A/B Test Summarizer to work today
Add it to your Oasis, connect its apps, and hand it the first task. Everything about it stays editable.