Loading...
Answers
MenuBuilding a database of A/B testing examples
Answers
Yes definitely. As you know these elements are super important pertaining to to this information. There are plethora of small businesses that cannot the technical expertise needed in some cases to increase in engagements on websites, which for most websites are the best promotion tools. This would be a great asset for small to medium size business who want to increase the proficiency of engagements for one. Some other ideas I could think of too. I would explore those engagements with those users to see if there is an noticeable difference before and after using the information provided from your db.
Great idea - I'd be interested, especially in pricing A/B test results. Are you up and running already?
There are already a couple of products in market like this, goodui.org being the main one.
However, personally, I don't believe that this kind of meta-analysis of experiments from different sites has too much value, for a couple of reasons. I'm only really outlining this stuff for you because it might be food for thought if you want to create products for the experimentation community:
Whilst the theory of meta-analysis is technically sound, it is also fraught with issues relating to the complexity of web experiences:
Tests must be subjectively categorized and then analysed as 'patterns' when there is zero evidence that that thing was the cause of the result. For example, you might think a test won because you removed the voucher code box, but it equally could have won because of the change in page layout.
No two tests are in any way the same in any controlled way. Meta analysis mainly comes from sciences where experiments can be repeated under (relatively) identical controlled conditions. This is impossible and A/B testing cannot really be compared to that kind of controlled experimentation. By comparing two different experiments you instantly remove any control you had around audiences etc because they will not be the same.
The greatest benefit to be had from experimentation is by integrating it with business and brand strategy. A good business strategy is aimed at carving out a unique and differentiated direction of travel for that brand. The opportunity with experimentation is to iteratively develop and innovate the business through learning and adaptation. This means that experimentation should aim at being meaningful within the context of the brand strategy. Meta-analysis of experiments from different sites is, in many ways, the opposite of this because it seeks to make the ‘lowest common denominator’ changes which would be beneficial to any business anywhere. Conversion uplift and revenue might be achieved but what has been furthered in terms of strategy and differentiation? This is not to say that it isn’t valuable if you simply want to do ‘CRO’ but my argument is that nobody should merely do CRO.
Related Questions
-
How important is a polished/pretty prototype to pitch an idea to potential customers and/or investors? I'm using this as a means to support my pitch.
It depends how clear your idea value is without it, or with a rough one, or mock ups vs polished. There are a few goals you are trying to conquer with a prototype, overall its about concept clarity and valuation. 1. customer/investor acceptance: "i want that" 2. customer feedback: "you should change that" 3. investor valuation: "wow, you are that far along" vs "its just an idea" Without more details only you know what it will take to get the right clarity to the customer and investors to answers on above.BS
-
What's the best way to sell a SaaS prior to launching?
I was involved with a SaaS product that launched a landing page and made clear that the product was still in development, but that we would give earliest access to people who pre-paid for the product. We also allowed people to choose what they paid, and promised them that payment would stay in-effect for several months. We generated revenue the first day of posting the landing-page publicly and increased revenue month-over-month. However, we discontinued the product as it was simply not big enough of a market for us to justify continued time and energy. But I would encourage you to pursue a similar model in that it's a great way to test and validate the pain others experience for the problem and a great way to ensure you're building the product to satisfy real customers. Happy to talk this through in more detail in a callTW
-
Does anyone know of a good SaaS financial projection template for excel/apple numbers?
Here is a link to a basic model - http://monetizepros.com/tools/template-library/subscription-revenue-model-spreadsheet/ Depending on the purpose of the model you could get much much more elaborate or simpler. This base model will help you to understand size of the prize. But if you want to develop an end to end profitability model (Revenue, Gross Margin, Selling & General Administrative Costs, Taxes) I would suggest working with financial analyst. You biggest drivers (inputs) on a SaaS model will be CAC (Customer Acquisition Cost, Average Selling Price / Monthly Plan Cost, Customer Churn(How many people cancel their plans month to month), & Cost to serve If you can nail down them with solid backup data on your assumption that will make thing a lot simpler. Let me know if you need any help. I spent 7 years at a Fortune 100 company as a Sr. Financial Analyst.BD
-
What is the point of having multi-year contracts in SAAS if the customer does not pay upfront for the 2nd year?
If you have an enforceable contract, the client is obligated to pay for the services received. As a business owner, I would be very concerned if a SAAS was demanding upfront payment for 2 years.SN
-
What are the SaaS B2B expectations when paying annually - annual paid annually or annual paid monthly? Is a discount necessary (i.e. 20%)?
Most Software as a service vendors generally don't book annual deals except in highly specialized cases. Most customers prefer to be able to cancel/change anytime they choose. Also, deals done "offline" end up actually often being more trouble than they are worth to administrate especially for a $2988 ticket. Generally, companies don't view prepaying for SaaS products a year in advance as a "convenience" (to them) so if the debate is internal (not customer driven), I'd set this debate aside until it's requested by the customer. Most customers will request a discount to pre-pay annual service. Happy to talk this through with you in a call, to work through the specifics of your situation in more detail.TW
the startups.com platform
Copyright © 2025 Startups.com. All rights reserved.