A/B Testing - as approved by Google

Discussion in 'AdSense' started by mooiness, Aug 3, 2006.

  1. #1
    Straight from the horse's mouth this ...

    A/B testing is when you show one ad format half of the time, and another ad format the other half of the time, to help decide which performs better via using custom channels. But you cannot easily do this without tinkering with the code. But now it seems like it has been Ok'd by the Adsense Team.

    In general you'd implement it in PHP, using a random number generator. The code looks a bit like this:
    More at:
    http://adsense.blogspot.com/2006/08/abcs-of-ab-testing.html
     
    mooiness, Aug 3, 2006 IP
  2. jimkarter

    jimkarter Notable Member

    Messages:
    5,168
    Likes Received:
    347
    Best Answers:
    0
    Trophy Points:
    235
    #2
    Ok. Thats a good idea to test which format performs better on the same day/week.
     
    jimkarter, Aug 3, 2006 IP
  3. mooiness

    mooiness Peon

    Messages:
    409
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Yeah that's right, previously the other way to do this was to manually edit your page's code. And it wasn't randomised - this way, it may even help combat ad-blindness.

    Wonder what's Google's point of view with regards to using this as a permanent ad rotator, so to speak.
     
    mooiness, Aug 3, 2006 IP
  4. rahulm

    rahulm Peon

    Messages:
    178
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #4
    It could be possible by date as well.........I mean that one ad is on even dates and onther is on odd dates.........and lots of logic also available depend on logic used;)
     
    rahulm, Aug 3, 2006 IP
  5. mooiness

    mooiness Peon

    Messages:
    409
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #5
    rahulm: oh yeah. the possibilities are endless. :D

    I wonder if Google has now opened the pandora box with this. Though, at least this kind of code modification would not induce false clicks or change the way the ads work. So maybe they might be more lenient with this? Hmmm.
     
    mooiness, Aug 3, 2006 IP
  6. Gandalph

    Gandalph Active Member

    Messages:
    89
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    58
    #6
    The resulting code, the code sent to the visitors' browser, is exactly the same as the code you'd get from the adsense tool.

    Whether you do this -by hand- on an hourly basis or some other crazy schedule, or automatically is probably trivial to google.

    My guess is that they don't like you tinkering with the endresult, but serverside you can do just about anything you want with it; which includes inputting php variables for colors sizes and whatever to do your testing. (<-- I have read this somewhere else too, but can't remember where...)
     
    Gandalph, Aug 3, 2006 IP
  7. mooiness

    mooiness Peon

    Messages:
    409
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #7
    gandalph: ah that makes sense. But when even the ppl on the Adsense blog had to check with their "policy folks", you can see why us plebs are a bit unsure. ;)
     
    mooiness, Aug 3, 2006 IP
  8. qwestcommunications

    qwestcommunications Notable Member

    Messages:
    8,868
    Likes Received:
    172
    Best Answers:
    0
    Trophy Points:
    233
    #8
    Pretty neat idea. I still don't think you can make a completely valid comparison between ads to judge which is better performing on a given page.
     
    qwestcommunications, Aug 4, 2006 IP
  9. P8ntballer

    P8ntballer Peon

    Messages:
    115
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    This is really cool Im gonna try it right now!
     
    P8ntballer, Aug 4, 2006 IP
  10. Gandalph

    Gandalph Active Member

    Messages:
    89
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    58
    #10
    I think you need to brush up on your statistical skills...

    When out of 100 visitors one ad is clicked once and the other 99 times, which would you say is the better performing? And suppose your previous ad was the one that got only one click? Congratulations; by implementing the new ad you have improved your CTR by 10.000%...

    That's the power of knowing your metrics :cool:
     
    Gandalph, Aug 4, 2006 IP
  11. chachacallis

    chachacallis Well-Known Member

    Messages:
    1,086
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    128
    #11
    this is really good news now the testing can begin.
     
    chachacallis, Aug 4, 2006 IP
  12. 010081

    010081 Banned

    Messages:
    4,657
    Likes Received:
    222
    Best Answers:
    0
    Trophy Points:
    0
    #12
    oh great idea ,let me have a try then
     
    010081, Aug 4, 2006 IP
  13. cornetto

    cornetto Peon

    Messages:
    180
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Has anyone got any results from doing this then? If you have, please post them...

    I've set up a test on 300 pages of mine, all using A/B testing to see if black backgrounds with white writing are better than white backgrounds with black writing. I'll let you know in a week.
     
    cornetto, Aug 17, 2006 IP