One of the many things I do as a graphic designer for Vantage Media is come up with A/B tests for Yahoo! Education. These tests have involved title languages, button colors, arrows, form label locations, trust badges and more. But this week, I had the opportunity to create a whole new type of test.
This week I got to make an article test on http://education.yahoo.net/articles/degrees_for_busy_people_2.htm. The test was to see if users engage the inline call-to-action links more if we showed photographs, icons or illustrations for each degree listed. Here are the choices:
(Illustration Style 1)
(Illustration Style 2)
I came up with the style for illustration style 1 from a Pinterest post I saw showing Johnny Depp in all of his movies. Style 2 was largely inspired by Laura Pérez. When making the images, I definitely liked Challenger C the best, maybe because I put the most time in those article illustrations. I actually thought the icons would do the best though because they are the easiest to scan.
So out of the four versions, which one do you think won in engagement?
If you guessed Challenger C, the more realistic illustrations, you were correct! It seemed that users liked the Laura Pérez illustrations slightly more than the photographs. It's also interesting that the icons weren't that far off and that the more cartoony illustrations did so much worse. We can have several guesses why these numbers played out:
- Challenger C had more visual queues like the crime evidence or designer's bookshelf
- The cartoony illustrations didn't make the readers take the careers seriously
- The brighter colors of A and B turned users off
- Users just liked Challenger C's illustrations
No matter the results, this split test was a great starting point. If you have any similar tests, please comment on your experience.