Loading...
Answers
MenuWhat are the best ways to test 2 different version of product page/user flow?
Hello all, we are building a website which is something like groupon for fashion. We have 2 product pages in mind. What's the best way to test, learn and improve? Anyone has experience on this?
Answers
Easiest way would be to use an existing A/B testing service (e.g. https://www.optimizely.com/)
Or, you could do it manually by sending out (via email or whatever) different links to different people.
A couple of great services that can help you out with this:
I have experience at several companies testing website variations. What you are looking to do is commonly called split or A/B testing. There are several companies that provide split testing services.
My favorite testing tool is called Optimizely. (https://www.optimizely.com/plans/#testing). It has free and paid plans depending on your needs. The tool has a lot of engineering going into it, meaning it probably won't mess with any other analytic services you might have on your site.
I have used split testing solutions that caused Google Analytics and other tools to incorrectly pick up data. If you are using any scripts or third party services on your site, it is very important to make sure split tests do not interfere with them.
Optimizely will allow you to test different pages or even minor alterations to the same page. You can make these modifications using a powerful editor that requires little coding knowledge.
Before you setup a test, you must make sure Optimizely is tracking the right goals. Goals are any interactions that indicate the test was a success or failure. You can track specific clicks on the page and whether other pages were visited.
After enough people have visited your test, you may reach statistical significance. Statistical significance means the sample size of people in the test was large enough to be reasonably sure the winner didn't win by pure chance.
The hard part about split testing comes when you can't reach statistical significance or can't make sense of your results. That is where a conversion rate optimization expert or growth engineer can help give advice on next steps.
You have some options and your choice depends on what point in the design process you want to test it.
Option 1: create a prototype of each and do a moderated or unmoderated user test study with it.
Option 2: Develop and launch both versions and do it as an A/B test where half your users are shown version A and half are shown B. Then you look at the data to see which version converts better.
Related Questions
-
Is having "HOME" button in navigation menu necessary if I have a clickable logo? What makes most sense from UX POV?
We have been collecting usage data on the home button from about 750 websites we manage across North America in an effort to try to determine if it is necessary or not. While each website is different, and much of the data is statistically insignificant, we have started to operate with a few assumptions. 1.) Most users, particularly younger users, recognize the logo as a way to get to the home page. 2.) Websites without home buttons seem to get a comparable amount of traffic to the home page as those that do not. We don't see a significant difference between having a home button or not. 3.) Websites without a home button often will see an increase in direct traffic from returning users during a session indicating that users who do not know the logo is a route to the home page will instead clear the address bar back to the root domain to get back home. Based on our research, we have decided to omit the home button in most instances. Although when it is present, it is often used, most users seem to understand how to get to the home page regardless of the inclusion of a home button. With the complexity of modern websites, we are usually pressed for space in the header and can better use the real estate that would be dedicated to the home button for other UI elements. That said, if the audience for our website skews older, we will still include the home button. Our research has indicated older users are less familiar with the concept of the logo being a home button.RS
-
What tools do designers use to produce usage animations when a mobile app is still in infancy (i.e., mockups, composites, prototyping)?
I second invision for showing quick online prototypes, but for something more versatile, i use AxureRP (www.axure.com) . The ability to build a sketchy wireframe or a pixel perfect app is amazing. I love it. Great for mobile gestures and animations. Go check it out - they offer a free trial. Contact me if you want more info but they have awesome tutorials on the site. I taught myself everything.DH
-
When people sign up to my online marketplace, should I ask for their phone number in the application form so I can get feedback from them?
I have designed a few of these online marketplaces and I can tell you from experience that in this day and age, phone numbers are a deterrent on a signup form. I advise against it and agree more with the cons. However, that does not mean that you cannot get feedback from students. Form the past websites that I have built with student demographics, I have found that they like to interact with each other, so a better way to get feedback is to set up a forum in your online marketplace. Also, just adding a comment thread like blogs have is a very good way to get feedback, even more effective than phone numbers. Also, one reliable method that I found works is an incentive based feedback survey when students can earn pennies on the dollar to take surveys. If you go this route, you could offer 25 cents or $1 or even $5 to the first 20 or 100 students that fill out the survey answering all your questions that you would normally have asked over the phone. I hope my suggestions are helpful to you. I can always assist you in building your online marketplace. I have more suggestions for you as well. BruceBC
-
What's your opinion on using something like usertesting.com vs. real time usability testing (online and offline)?
UserTesting can be instructive in terms of understanding whether people understand your copy, CTAs, and intended flows but generally, I've found the quality of their panels to be pretty low. You're almost always getting people who are not your actual users, so the feedback can only be generally applied as above. I find whatever web analytics package or packages you're using are generally able to provide much better insights. I also really do believe in *real* user panels. Buying pizza or offering small financial incentives to real users to click through new flows where they are talking out loud or answering specific questions is going to give far more actionable insights than anything else. What I like to do is take my best guesses as to what's not working or what I'm looking to improve and then discover/validate via real in-person customer panels. Happy to talk through this in more detail with you in a call.TW
-
What's your advice for drilling down on use-case for our real time communications iPad app for co-viewing docs together?
Hmmm? This is a tough one because your product is so wonderfully horizontal, meaning it applies to a very broad set of cases. I'd slice and dice in two directions. First, I'd think about the general process of collaboration on a document, for example: a) drafting - are two people actually writing the words together? I personally don't like this. b) first read through together staying on the same sentence or page, c) editing together, etc. Second, I'd think about industries or verticals or contexts, such as in a Legal setting, in a Tech Documentation setting, in a coding or XP dual programming setting, in a social media post drafting setting, and so forth. Check out: https://medium.com/look-what-i-made/fd48c3b412bc Seems to be evocative of what you're doing, but targeted to one specific use case of "pair programming".BB
the startups.com platform
Copyright © 2025 Startups.com. All rights reserved.