All products
EdTech · Exam preparationAug 2026 – present

CFA Mock Exam

An exam-prep business run day to day by AI agents

cfamockexam.com

124

Merged PRs (Aug 22 – Oct 24, 2026)

109

Merged in last 30 days

290 of 412

Commits on main with an AI agent co-author

cfamockexam.com

Live product

The Challenge

CFA candidates need realistic, timed mock exams that feel like the real computer-based test. The business question was whether a small team plus agents could run a paid exam product (content, payments, analytics, security) without a full-time engineering staff.

Tech Stack

ReactFirebase / FirestoreNetlify FunctionsStripeGoogle Analytics

Client

Phi Digital (own product)

The problem

Candidates want exam-day realism: the timer, the calculator, review flags and Level I–III mock sessions. The operator needs paywalled access, trustworthy analytics and a question bank that cannot be scraped.

The production system, owned end to end

  • Owned by Phi Digital LLC and live at cfamockexam.com. Merging to main deploys production; main is protected (PR, passing CI and owner approval) since Oct 14, 2026.
  • Phi holds Stripe, Firebase, Netlify, domain and Search Console; contributors work through PRs only.

Technical depth

  • Exam runner modelled on the computer-based test: timed sessions, BA II Plus calculator, preflight checks, attempt review and Level I/II/III mock sessions.
  • Paywall: Stripe Checkout, webhooks, server-side entitlements, regional pricing and a billing portal on Netlify Functions.
  • Analytics: funnel events through checkout, per-question analytics and admin traffic and event-stream views.
  • Agent fleet: CFA Pollen and other agents open PRs, run QA and fix issues; humans approve merges.

Judgment: security and guardrails

  • Database rules restrict the question bank and paid entitlements to admins and server code.
  • Grading runs server-side.
  • Score emails are rate-limited with a daily cap and a “Not you?” report link.

Real failures caught and fixed

  • Security: grading moved server-side after monitoring caught an automated scorer, and the question bank was locked to admins.
  • Security: agent security review found and closed paid-access and account-integrity gaps before exploitation, and tightened email rate limits.
  • PR #24 (Oct 1): the checkout_paid analytics event did not fire on the hosted Stripe return. Fixed so revenue reporting is complete.

What the agent fleet did

124 PRs merged in about two months, 109 of them in the last 30 days. 290 of 412 commits on main carry an AI agent co-author trailer. The server-side grading change was written and shipped by the CFA Pollen agent on pollen/ branches, with owner approval.

Sources · measured 2026-10-24

  • Merged PR counts: GitHub gohluke/cfamockexam (private), measured 2026-10-24 19:26 UTC with gh pr list --state merged.
  • Co-author trailers: git log origin/main --format=%(trailers:key=Co-authored-by), measured 2026-10-24.
  • Venture facts and branch protection: phi.llc docs/ventures/cfamockexam.md.

Ready to build something like this?

Start with Discovery Sprint (US$2,500, credited to the Build Pilot), email luke@phi.llc, or ask our AI agent how we would apply this approach to your workflow.

Buy Discovery SprintContact Us