Contents

Chapter 1

Features

This chapter covers the core features and capabilities of A/B Testing Framework.

Features

  • Deterministic visitor-to-variant assignment (hash-based, no cookies needed)
  • Conversion tracking with per-variant metrics
  • Two-proportion z-test for pairwise comparisons
  • Chi-squared test for multi-variant experiments
  • Sample size calculator (know how long to run your test)
  • CSV event log processing for batch analysis
  • JSON and text report output
  • Python stdlib only — zero pip dependencies

Quick Start

bash
# Generate a report from an experiment config with data
python src/ab_testing_framework.py --config examples/experiment.json --report

# Assign a visitor to a variant
python src/ab_testing_framework.py --config examples/experiment.json --assign visitor_001

# Calculate required sample size
python src/ab_testing_framework.py --config examples/experiment.json --sample-size 0.05 0.20

# Load events from CSV and analyze
python src/ab_testing_framework.py --config examples/experiment.json --events events.csv --report

# JSON output for programmatic use
python src/ab_testing_framework.py --config examples/experiment.json --report --format json
Chapter 2

CLI Reference

Follow this guide to get A/B Testing Framework up and running in your environment.

CLI Reference

FlagDescription
--config, -cPath to experiment JSON config (required)
--events, -ePath to events CSV file
--assign VISITOR_IDAssign a visitor and print the variant
--convert VISITOR_IDRecord a conversion event
--reportGenerate experiment report
--sample-size RATE EFFECTCalculate required sample size
--format, -fOutput format: text or json
--verbose, -vEnable verbose logging

Configuration

See examples/experiment.json for a complete example.

Chapter 3
🔒 Available in full product

Examples

You’ve reached the end of the free preview

Get the full A/B Testing Framework and unlock everything.

All Chapters

Get the complete guide with every chapter unlocked, including code samples, diagrams, and best practices.

Full Tool Suite

Access all interactive tools with complete data, all workload profiles, and the full scenario library.

Source Files

Downloadable source code, configuration files, and working examples from every chapter.

Lifetime Updates

Free updates for life. Every new chapter, tool, and improvement included.

Buy Now — $29 →
📦 Free sample included — download another copy for the full product.
A/B Testing Framework v1.0.0 — Free Preview