Loading...
Answers
MenuWhat is a good process and timeframe for rolling our your beta with a 100 testflight user group?
We have our three core team members testing currently, 100 testflight signups, they break down as friends and family, cool early adopter tech people, massive enterprise customers in retail and hospital systems, and physician early adopters. How do we think about rolling out our testflight beta? Over what time frame should we be considering? We are pushing releases essentially weekly at this point with a tiny team.
Answers
More information needed, I think. What goals do you want to accomplish with this beta? In terms of process and timeframe for actually _rolling out_ the beta, I don't think there's anything special that needs to be done.
When it comes to gathering feedback from those user segments, however, it would make sense to target them.
First of all, I'd suggest you use Hockey instead of TestFlight. Although I'm sure the product will change now that Apple has acquired them, TestFlight is currently inferior to Hockey in so many ways, I could write an entire post on just that!
Ignore "cool early adopter tech people and friends and family" and decide which of the user segments of potentially real early adopters are most likely your customers. This is best accomplished by actually segmenting each group (into a separate email list) and surveying each to understand their current perceived degree of pain for the problem you're solving and also trying to assess their degree of motivation to experiment with your approach.
The product should be refined enough to fully function before testing with real customers. This is a point I can't stress enough. Customers act the same regardless of what stage of development you are in. This is to decide they will decide quickly (within minutes) as to whether they think that what you have on offer is worth their time. If you fail to impress the first time, you will have a difficult time getting them to reopen the app, regardless of what the build notes have on offer.
So if you're still a ways away from having a true MVP, you should count on early adopter tech people to give you generalized product feedback. Their feedback can't be relied upon to validate actual product/market fit but they can help you shape the MVP to get the core UX right and help squash bugs, etc.
Happy to talk through this in more detail in a call.
We just finished a small beta with 200 people on TestFlight, so I'd be happy to share my experience! I've run 5 TestFlights now totalling many hundreds of users so I'm somewhat qualified to help you out.
My main advice here would be to roll out to users as slow as you can afford to, but obviously there's a load of factors to consider, notably how much testing you've done so far.
The issue with large scale rollouts is twofold. Firstly, there's a massive hit to your servers all at once, which could cause availability issues and highlight any bugs. Secondly, the more people you get involved early on the more people will SEE those availability problems and bugs. If you control the rollout you'll be able to see how your systems react to the increased load and scale accordingly.
That goes for platforms too. What's powering your iOS app? Do you have a web app? Secondary services that add on to your main platform? If there's anything that it's possible to hold off on offering, you should think about it. It's best to start out with something that's really great and reliable - you don't get a second chance at making a first impression.
Most of this stems from the rather uncomfortable truth that people don't actually understand what betas consist of. You're probably hoping for 100 people that really want to help you improve your product, but what you may actually have is 100 people that really want early access to something that's already finished.
It's best to manage their expectations up front. Just be clear about the feedback you're expecting, the level of contact you'll have, your update schedule, how you'll be communicating with them, how often, etc.
There's other factors to consider here too like the reliability of TestFlight (Apple are usually great, but TestFlight has its own unique issues with sending out invites and invalidating them). You'll also need to think about the drain that handling feedback will have on your team's ability to iterate quickly. It sounds like you're doing a great job at the moment, so you need to consider how much impact it will have dealing with support requests for non-technical issues.
I'd love to help you more. Sounds like you're working on a really interesting product, and betas are right in my area of expertise. Let me know if you'd like to schedule a call.
Related Questions
-
How much should it cost to develop this IOS app?
As the host of 'The App Guy Podcast', I can introduce you to a few good developers ranging from inexpensive locations to $100 per hour top rates. As a quick guess, this type of app will start from $900 using a cross platform solution (Like Titanium Studio) to $5000 for Objective-C apps written on xCode Let me know if you want an introduction by contacting me through my website or podcast Paul Kemp - The App Guy Podcast http://TheAppGuy.co/PK
-
Should our photo sharing app use Base64 Strings or Files using URLs to display images?
We have been asked this question before and it really depends on the situation and use case. 1. In depends on many factors. 2. Base64 encoding enlarges file sizes by up to 33% 3. If quality is your focus, I recommend URL/URIs. I would love to hear more about this project and provide some more insight. Let me know if you have any other questions. -SteveSD
-
What is the best technology for developing a new mobile app from scratch?
There are two sides to that question. One is the mobile app itself and the other is the backend. If I misunderstood in any way and you didn't mean "native" app I apologize in advance. On the backend, there is no clear cut answer to which is the "best". It depends solely on the developers you are able to get. We for example use Node.js , mongoDB, redis, elasticsearch and a couple of proprietary tools in the backend. But you have your pick of the litter now both on the backend api and the datastore with the myriad of options available and touted as the "best" currently on the market. Now on the app side again it solely depends on what you need your mobile app to do. Experiencing first-hand "develop once, run anywhere" I can say it's more like "develop once, debug everywhere" to quote a Java saying. We have tried Phonegap and Titanium Appcelerator and we have switched to native (ObjC and Java) after a couple of months of trying to go the hybrid route. The reasons behind the choice are as follows: - anything that breaks the pattern of how those frameworks NEED to operate is just a huge technical debt that keeps accruing a huge interest. - anything that uses css3 accelerated animations on Android is buggy at best and slow as hell at worst on any lower (< 4.1 I think) versions of Android I hope this gives you some insight. If you need/want to ask me anything feel free to contact me. MihaiMP
-
Creating social networking application for iOS, which languages should it support?
It's generally not worth supporting additional languages at launch. Why add extra work when you don't even know if the network will take-off in English? Best to minimize the complexity for launch.TW
-
What is the best mobile app install tracking solution? By this I mean a solution that truly (or nearly) tracks click to install of app on iOS.
Sure, it's correlative for technical reasons, iTunes / AppStore does not provide (yet, might change) a mechanism for that, so 3rd parties have to build their own. I recently discussed with people from Adjust and I was really impressed. HasOffers / MobileAppTracking seems to be a good choice as well.AJ
the startups.com platform
Copyright © 2025 Startups.com. All rights reserved.