Loading...
Answers
MenuI need advice on developing a software testing strategy quickly?
Anyone have advice on developing a testing strategy that covers realistic production scenarios? I find unit tests to be fast but not very realistic, and functional tests to be realistic but slow and brittle. Anyone have a happy medium? I'm working on a systems integration project and we're leaning on BDD with Selenium, but I'd rather know my options. Maybe a mix?
Answers
I'd recommend looking into these options:
https://www.fiverr.com/
(do a search for QA)
https://www.reddit.com/r/slavelabour/
(e.g. pay $1 per bug committed to Trello)
If you'd like to discuss managing the software testing in more detail in relation to your specific product let me know,
best,
Lee
Yes, there's a lot we can discuss.
We internally use BDD tests (Gherkin for user stories), coupled with Selenium via CoyPu wrapped around any mock-up output (in our case, Indigo Studio).
You can take a look at an example from a while ago on our YouTube Channel (Axelisys Wonder), specifically at:
https://www.youtube.com/watch?v=ZWeC56bL3Oc&list=UUdTOmUegcjXIPtZt2sVutRQ&index=11
What we typically do is:
1. Sit together with the business, BA and a Dev to develop user stories representing customer journeys using "As a... I want... So that..." often in conjunction with mock-up web pages which are then changed into static HTML pages.
2. Run through the primary scenario and develop the "Given... When... Then" statements.
3. Commit that to your Version Control system ("What?")
4. At this point, the devs or a DiT (Developer in Test - if your organisation uses that) can pull it out and wrap the mock-up in CoyPu/Selenium with references to the appropriate elements. The behaviour of the mock-up should represent the user journey. Hence the BDD test should use the same data as the mock-up did. However...
The maximum number of tests should be 2 to the power of the number of "Given" "Ands". So if you have
"GIVEN I am 17 AND I have a driving license"
This counts as 2 test variates and as such, creates upto 4 test cases.
5. As the devs work through the process, they fill out the mock-ups and push data back through the layers (perhaps walking the skeleton for the primary scenario) and filling in any data persistence layers etc. as they go. The very same tests are used to regress existing functionality too.
So the test strategy is basically to make sure you have covered as much of the valuable journey as possible (all primary scenarios/happy paths and the most valuable secondary scenarios, as long as TDD level tests can adequately cover the rest).
How do you know what is adequate? I'll direct you to a couple of articles.
Feel free to arrange a call if you need more information.
http://goadingtheitgeek.blogspot.co.uk/2015/02/code-coverage-metrics-cyclocmatic.html
http://goadingtheitgeek.blogspot.co.uk/2014/09/going-from-acceptance-tests-to-code.html
Best of luck!
There are several options you can consider, some of them have been mentioned by other experts here. I have been helping startups for the past 10 years developing executable business and marketing plans as well software customization and applications development.
If you are paying for the premium access for example you are simply still only getting a tool that extends as far as your time and skill set allow. What you could do instead is also consider another development team whom you can partner with and allocate your budgets to them to do the testing while also providing you with their expertise in software development and customization for various interfaces they can run your tests as fix or provide direct solutions. Companies like www.BetaBulls.com for example can help you with services like that and maybe even fix any errors.
You're absolutely correct in the sense that there are certainly development costs (in terms of both development time and dollars) associated with the available testing strategies. In general, BDD with Selenium should produce outcomes of sufficient quality for you.
Depending on the purpose of the underlying system and how critical it is relative to operations, other additional techniques may be advisable (such as Test Driven Development/TDD or Unit testing) in order to assure adequate coverage of critical core components.
At FarShore, nearly 20% of our staff is tasked with QA testing exclusively, so we are tackling these exact type of questions every day. We usually advise a review the system's purpose, scale, anticipated rate of change for that system's code base, budget and based on that review, recommend a testing strategy that fits best for the parameters provided.
Happy to connect and offer additional insights or help with any guidance I can.
Related Questions
-
Where can I find top notch Lamp Stack engineers with the business know how and VC connections?
I've always hired only ridiculously brilliant engineers and those that were either entrepreneurs or entrepreneurially minded (i.e. attended startup weekend, contributed to open source, blogged, etc). The best way to find them is to go to the events they attend. Typically it's developer meetups, open source or programming language oriented conferences, etc. To add a heightened filter, maybe only entrepreneurial oriented events like Business as Software, StartupSchool, or StartupDrinks. Also, using Angel.co to find companies that were once listed, but didn't raise or seem to have "Sunsetted" might be a good strategy. The question I always ask myself when I'm about to do sourcing for talent, or marketing is: 1) Who do I want, or what are examples of those people in the real world? 2) What places do they go/hangout, tools do they use, news sources they read, etc? Be strict with your filters and you should find some candidates... the hard part is convincing them that your project is more interesting then their current job/project/ideas/company/etc - cause these people typically have many options for work.DM
-
How do you find a good overseas QA team? Has anyone had a good experience with a specific company?
You can have a look at http://ekipa.coHM
-
How do build a empowered and motivated engineering team?
I am assuming your question is more pertaining to empowering and motivating (rather than hiring). I can outline some of the practices I have seen really result in high motivation and sense of ownership among engineering teams: * Empathize - Your engineering team will work well and be more motivated if they see you as one of them rather than a person who doesn't understand their function. Show your geeky side to them, and show that you understand their thought process and drivers. * Pick their brain on big and small decisions (roadmap, usability, whatever it is) - Product teams value being heard. The more you position yourself as someone who is WANTS to listen, is keen to have their inputs, you will be surprised at how involved they can get, and also how you can actually tap into a lot of smart ideas/thoughts from them that you can develop on. * Take care to explain - show how you arrive at decisions. Share your research, competitive analysis, and even your thought process on arriving at a feature set or list of things for a release. Its stuff you would have worked on anyway - so no harm sharing with more eyes! * Share customer feedback - nothing motivates your engineers than a positive interaction with a customer. Get them to see customer feedback. Have them sit in and observe some of the usability studies. (B2B - have them see you do some demos or do a successful sales pitch) * Send out interesting articles, insights, business and tech articles with your comments/highlights to them on a regular basis (maybe twice a week?) - maybe even some analysis you did on competition or customer feedback * Engineers like working with people they feel are competent and complement the work they are doing to build a great product. So make sure they see how everyone else around them is also doing a good job and adding value and contributing to the success of the product. * Be transparent about the product/business - Make them feel they are responsible and involved in the business, not just technology. I've seen engineering teams happy about their annual goals having components relating to making revenues, keeping customers happy, or reducing costs. If they are enthused about the business as a whole, they will be more motivated with their engineering efforts * Have a mix of little experiments, R&D, attending to engineering debt, in addition to bug fixes and new features that each engineer gets to spend some time on (based on their interest) * Finally get to know each of your engineers personally, and be aware of what their priorities are. Each of us has different motivations in life, so there is no silver bullet to motivate people. When they know you care for them, they are more motivated :).SG
-
Is it ok to use Javascript / Angular for a mobile app that uses a wearable? Is it fast enough?
If your goal is a proof of concept, use what you know and don't stress about performance yet. Other options for using a web stack to build native apps include Steroids (native transitions with web views) and React Native. From what you're describing, it doesn't seem like you'll hit any major challenges in the alpha stages. Once the project grows legs, it would probably be worth consulting with an expert to dig deeper into the architecture and requirements to make a more informed judgment. Good luck!JL
-
I'm a non-technical founder developing a karaoke mobile app. How I should architect my app in term of software/servers used and programming languages?
Better than choose an architecture and try to build the server side of your app, I suggest you to try to find a mate that helps you and was your cofounder. Just you will probably fail in building the app and keeping it working fine in the near future. One-founder teams are very risky for accelerators and VCs. So, you definitely should trust in a co-founder. Read this: http://venturehacks.com/articles/pick-cofounderJL
the startups.com platform
Copyright © 2025 Startups.com. All rights reserved.