1

We've setup an A/B in Optimizely to test a completely new design:

http://offerta.se

that we're testing against our legacy design:

http://offerta.se/?classic=1

Optimizely is setup to redirect 50% of our CPC traffic to the legacy design.

The old design is beating the new with about 10% better convertion rate and in trying to fiqure out why we started looking at if there was anything standing out in Google Analytics.

Optimizely creates the events with labels "New design" and "Legacy design" for us in GA.

And filtering on these and looking at "Screen Resolution=(not set)" we see some weird numbers:

enter image description here

If we remove all traffic with "Screen Resolution=(not set)" the new design instead performs 10% better than the old.

Anyone that can enlighten me?

Niels Bosma
  • 11,758
  • 29
  • 89
  • 148
  • Not that this is off topic, or you that you won't get an answer. But you are a customer (and possibly paying customer) of Optimizely. Contacting their customer service may prove beneficial since they'll be able to see how things are setup on the back end. – Steven V Dec 10 '13 at 14:50
  • +1 to Optimizely support. Also look at just a filter of Screen Resolution=(not set) and see if you can identify anything else (i.e, it's bot traffic, etc...). – TomFuertes Feb 05 '14 at 01:39

0 Answers0