the startups.com platform about startups.comCheck out the new Startups.com - A Comprehensive Startup University
Education
Planning
Mentors
Funding
Customers
Assistants
Clarity
Categories
Business
Sales & Marketing
Funding
Product & Design
Technology
Skills & Management
Industries
Other
Business
Career Advice
Branding
Financial Consulting
Customer Engagement
Strategy
Sectors
Getting Started
Human Resources
Business Development
Legal
Other
Sales & Marketing
Social Media Marketing
Search Engine Optimization
Public Relations
Branding
Publishing
Inbound Marketing
Email Marketing
Copywriting
Growth Strategy
Search Engine Marketing
Sales & Lead Generation
Advertising
Other
Funding
Crowdfunding
Kickstarter
Venture Capital
Finance
Bootstrapping
Nonprofit
Other
Product & Design
Identity
User Experience
Lean Startup
Product Management
Metrics & Analytics
Other
Technology
WordPress
Software Development
Mobile
Ruby
CRM
Innovation
Cloud
Other
Skills & Management
Productivity
Entrepreneurship
Public Speaking
Leadership
Coaching
Other
Industries
SaaS
E-commerce
Education
Real Estate
Restaurant & Retail
Marketplaces
Nonprofit
Other
Dashboard
Browse Search
Answers
Calls
Inbox
Sign Up Log In

Loading...

Share Answer

Menu
A/B Testing: What are the best ways to test 2 different version of product page/user flow?
AD
AD
Alec Dibble, Growth Engineer. Software & fullstack web. answered:

I have experience at several companies testing website variations. What you are looking to do is commonly called split or A/B testing. There are several companies that provide split testing services.

My favorite testing tool is called Optimizely. (https://www.optimizely.com/plans/#testing). It has free and paid plans depending on your needs. The tool has a lot of engineering going into it, meaning it probably won't mess with any other analytic services you might have on your site.

I have used split testing solutions that caused Google Analytics and other tools to incorrectly pick up data. If you are using any scripts or third party services on your site, it is very important to make sure split tests do not interfere with them.

Optimizely will allow you to test different pages or even minor alterations to the same page. You can make these modifications using a powerful editor that requires little coding knowledge.

Before you setup a test, you must make sure Optimizely is tracking the right goals. Goals are any interactions that indicate the test was a success or failure. You can track specific clicks on the page and whether other pages were visited.

After enough people have visited your test, you may reach statistical significance. Statistical significance means the sample size of people in the test was large enough to be reasonably sure the winner didn't win by pure chance.

The hard part about split testing comes when you can't reach statistical significance or can't make sense of your results. That is where a conversion rate optimization expert or growth engineer can help give advice on next steps.

Talk to Alec Upvote • Share
•••
Share Report

Answer URL

Share Question

  • Share on Twitter
  • Share on LinkedIn
  • Share on Facebook
  • Share on Google+
  • Share by email
About
  • How it Works
  • Success Stories
Experts
  • Become an Expert
  • Find an Expert
Answers
  • Ask a Question
  • Recent Answers
Support
  • Help
  • Terms of Service
Follow

the startups.com platform

Startups Education
Startup Planning
Access Mentors
Secure Funding
Reach Customers
Virtual Assistants

Copyright © 2025 Startups.com. All rights reserved.