Loading...
Answers
MenuWhat are the best ways to test 2 different version of product page/user flow?
Hello all, we are building a website which is something like groupon for fashion. We have 2 product pages in mind. What's the best way to test, learn and improve? Anyone has experience on this?
Answers
Easiest way would be to use an existing A/B testing service (e.g. https://www.optimizely.com/)
Or, you could do it manually by sending out (via email or whatever) different links to different people.
A couple of great services that can help you out with this:
I have experience at several companies testing website variations. What you are looking to do is commonly called split or A/B testing. There are several companies that provide split testing services.
My favorite testing tool is called Optimizely. (https://www.optimizely.com/plans/#testing). It has free and paid plans depending on your needs. The tool has a lot of engineering going into it, meaning it probably won't mess with any other analytic services you might have on your site.
I have used split testing solutions that caused Google Analytics and other tools to incorrectly pick up data. If you are using any scripts or third party services on your site, it is very important to make sure split tests do not interfere with them.
Optimizely will allow you to test different pages or even minor alterations to the same page. You can make these modifications using a powerful editor that requires little coding knowledge.
Before you setup a test, you must make sure Optimizely is tracking the right goals. Goals are any interactions that indicate the test was a success or failure. You can track specific clicks on the page and whether other pages were visited.
After enough people have visited your test, you may reach statistical significance. Statistical significance means the sample size of people in the test was large enough to be reasonably sure the winner didn't win by pure chance.
The hard part about split testing comes when you can't reach statistical significance or can't make sense of your results. That is where a conversion rate optimization expert or growth engineer can help give advice on next steps.
You have some options and your choice depends on what point in the design process you want to test it.
Option 1: create a prototype of each and do a moderated or unmoderated user test study with it.
Option 2: Develop and launch both versions and do it as an A/B test where half your users are shown version A and half are shown B. Then you look at the data to see which version converts better.
Related Questions
-
What's your opinion on using something like usertesting.com vs. real time usability testing (online and offline)?
UserTesting can be instructive in terms of understanding whether people understand your copy, CTAs, and intended flows but generally, I've found the quality of their panels to be pretty low. You're almost always getting people who are not your actual users, so the feedback can only be generally applied as above. I find whatever web analytics package or packages you're using are generally able to provide much better insights. I also really do believe in *real* user panels. Buying pizza or offering small financial incentives to real users to click through new flows where they are talking out loud or answering specific questions is going to give far more actionable insights than anything else. What I like to do is take my best guesses as to what's not working or what I'm looking to improve and then discover/validate via real in-person customer panels. Happy to talk through this in more detail with you in a call.TW
-
If you were hired by a SaaS company that needed to increase its free user base from 1,200 to 3,000 in 6 weeks w/a budget of $10k, how would you do it?
Top 2 tactics: Existing Users and Industry Influencers. First, leverage the existing user base. Incent referrals with $5 for every new free user they get to sign up and start using PT Engine for a new domain. Second, reach influencers and offer them the same deal when they tweet / post to / email their audiences. Make the offer a 60 day free trial instead of the standard 30 day so that they are providing value to the people they refer as well. This is critical - don't make them feel sleazy, make them feel (and look) like heroes to the connections they share PT Engine with. That's $9k to get 1800 users, leaving you $1k for graphics, referral tracking system, administrative costs. I assume the $10k budget does not include your time - if it does you'll have to reduce the incentive, which will definitely make it less appealing. If you want to dive deep on reaching influencers, schedule a call with me at www.clarity.fm/ryandravingRD
-
How should the dynamic between a ux designer and a developer who are working together look like?
It depends a lot of in the skill sets and experience of both people but in most cases the ux designer should be controlling the developer pretty heavily in order to make sure his ideas come through properly. The UX designer may just need to work on his approach so people don't feel bossed around and more like they are working together. In an ideal world, there would be a project manager who makes sure everything is communicated well and keeps the dynamic feeling great.JM
-
I want to develop a platform with KPI dashboard for seo resellers which can be used to share various reports with their clients. Where to start?
Start by calling SEO resellers. Ask them if they experience any challenges sharing reports with their clients. If they do, dig into what the problems are. Does your solution meet what they need? If so, tell them you are creating a solution they'd like and ask them if they want to buy it. Then you have two options: collect payment then and there for your uncreated product or add them to your list to contact when you launch. But first you need to validate that enough SEO resellers need the product you want to create. Start there.JI
-
When people sign up to my online marketplace, should I ask for their phone number in the application form so I can get feedback from them?
I have designed a few of these online marketplaces and I can tell you from experience that in this day and age, phone numbers are a deterrent on a signup form. I advise against it and agree more with the cons. However, that does not mean that you cannot get feedback from students. Form the past websites that I have built with student demographics, I have found that they like to interact with each other, so a better way to get feedback is to set up a forum in your online marketplace. Also, just adding a comment thread like blogs have is a very good way to get feedback, even more effective than phone numbers. Also, one reliable method that I found works is an incentive based feedback survey when students can earn pennies on the dollar to take surveys. If you go this route, you could offer 25 cents or $1 or even $5 to the first 20 or 100 students that fill out the survey answering all your questions that you would normally have asked over the phone. I hope my suggestions are helpful to you. I can always assist you in building your online marketplace. I have more suggestions for you as well. BruceBC
the startups.com platform
Copyright © 2025 Startups.com. All rights reserved.