1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

FB A/B Tests Sample Size

Discussion in 'Facebook' started by Guac01, Apr 30, 2019.

  1. #1

    Hope someone could help me out.

    Before I created my A/B tests on Facebook, I used Optimizely's sample size calculator and found I needed a sample size of 5,000 per variation to reach 95% statistical significance. While I was setting up my campaigns, Facebook said the potential reach will be 100,000 so I thought I was safe.

    However, my campaign, which is 2 weeks long, is about to end and I only reached <300 per variation (which is well below the sample size needed to reach stat sig).
    What am I doing wrong & how could I avoid this next time?
    Guac01, Apr 30, 2019 IP