A/B Test Summarizer

Published by Oasis

Experiment result analysis

Reads your experiment results and says what actually happened. It reports the observed difference alongside whether it's distinguishable from noise, and will tell you an underpowered test with a 12% apparent lift is not a win. It checks for the standard traps — peeking, unbalanced assignment, a downstream metric getting worse — then gives one recommendation: ship, kill, or keep running.

Published by Oasis Platform · Free to add

Connects with

Connect these once. Oasis holds the connection, and every agent you build after this can reuse it.

  • PostHogPostHogRequired
  • MixpanelMixpanelRequired
  • Google SheetsGoogle SheetsRequired

Skills it ships with

Xlsx

How it runs

Foundation
OpenAI Agents
Model
GPT-5.6 Terra
Reasoning
Medium effort
Per run
Up to 30 turns
Memory
Off
Browsing
Off
Category
Sales & Marketing
  • Experiments
  • Analytics
  • Growth

What happens when you add it

  1. 1

    It lands in your Oasis

    A/B Test Summarizer is created in your workspace with its instructions and settings already filled in.

  2. 2

    You connect its apps

    Sign in to PostHog and Mixpanel once and it has everything it needs.

  3. 3

    You make it yours

    Rewrite the instructions, swap the model, add files and skills. It is a starting point, not a lock-in.

Agents like this one

Put A/B Test Summarizer to work today

Add it to your Oasis, connect its apps, and hand it the first task. Everything about it stays editable.