A/B Test Summarizer

Published by Oasis

Experiment result analysis

Reads your experiment results and says what actually happened. It reports the observed difference alongside whether it's distinguishable from noise, and will tell you an underpowered test with a 12% apparent lift is not a win. It checks for the standard traps — peeking, unbalanced assignment, a downstream metric getting worse — then gives one recommendation: ship, kill, or keep running.

Published by Oasis Platform · Free to add

Connects with

Connect these once. Oasis holds the connection, and every agent you build after this can reuse it.

PostHogPostHogRequired
MixpanelMixpanelRequired
Google SheetsGoogle SheetsRequired

Skills it ships with

Xlsx

How it runs

FoundationOpenAI Agents
ModelGPT-5.6 Terra
ReasoningMedium effort
Per runUp to 30 turns
MemoryOff
BrowsingOff
CategorySales & Marketing
ExperimentsAnalyticsGrowth

What happens when you add it

  1. 1

    It lands in your Oasis

    A/B Test Summarizer is created in your workspace with its instructions and settings already filled in.

  2. 2

    You connect its apps

    Sign in to PostHog and Mixpanel once and it has everything it needs.

  3. 3

    You make it yours

    Rewrite the instructions, swap the model, add files and skills. It is a starting point, not a lock-in.

Agents like this one

Put A/B Test Summarizer to work today

Add it to your Oasis, connect its apps, and hand it the first task. Everything about it stays editable.