Online Comparative or A/B Study
Online A/B Testing involves testing 2 or 3 versions of various processes or creative treatments to determine which version is most effective. A large panel is recruited to give the results more quantitative relavance. This type of research is best used to test competing prototype designs or to compare like features from other sites to come up with best-of-breed features. This service is ideal for clients who are developing or redesigning a site and want to gather feedback to help make final site design or site selection decisions.
Comparative or A/B Study Deployment
Invitations to participate (with or without an incentive) are usually sent by email to recruited panelists. Those who opt-in are presented with a series of tasks to perform or designs to review. At the end of each task a survey captures their staisfaction and success ratings as well as open text feedback. In addition, task completion times, successful task completions, and a complete click stream path by task are captured and recorded.
Competitive or A/B Study Deliverables
Once a pre-determined number of participants have completed the study, a data export is delivered in spreadsheet format followed by a detailed report. The analysis report will contain by task:
- key performance metrics,
- categorized open text responses with sample verbatim comments, and
- usability findings and recommended solutions.
Contact Us for more information or to schedule a Competitive or A/B Study.
