@CloudExpo Authors: Liz McMillan, Jason Bloomberg, Zakia Bouachraoui, Yeshim Deniz, Pat Romanski

Related Topics: @CloudExpo, Agile Computing, Cloud Security

@CloudExpo: Article

Could Crowdsourced Testing Be the Future? | @CloudExpo #Cloud

Can in-house testing be replaced with testing on the clouds?

This is how a typical software product lifecycle works: You gather requirements, build a prototype, detail out the architecture and design, develop the product, test it, deploy the product, handle migration and maintenance and ensure product support. This is a closed loop where the Product Support team gathers new requirements which are eventually deployed.

This clearly detailed lifecycle loop has been getting increasingly fuzzy in the recent past, at least for web product development. For one, requirement gathering and prototype building are often carried out in parallel. Pivoting is a concept where the features of a software product are constantly improved upon as new requirements come in. But it is in testing where there is a paradigm shift in the way things work. Unlike a typical PLM set-up where a dedicated team of testers dig out bugs and other malfunctions in a product that are fixed by the development team before deployment, crowdsourced testing often works over a live product.

Software product life cycle

Present day web products get deployed in 'beta' where the product or service is tested by real customers. In many cases in fact, there is not even a beta period and products are tested continually by real customers through the life of the product. A lot of web businesses already have a 'bug bounty programs' where testers are awarded cash rewards in exchange for notification of critical bugs and vulnerabilities. To be fair though, these are at the moment complementary to in-house product testing teams that work out bugs on the product before launch.

But could we be moving towards a scenario where more and more testing could be crowdsourced instead of being handled by in-house testing teams? This aspect is already prevalent many web-based industries. Online marketers for example, no longer spend resources on surveys and studies to identify the optimal parameters for their marketing campaigns. Instead, they use the resource from the crowd to test email subject lines, advertisements and other aspects of marketing.

While crowdsourced testing among marketers has been deemed a success, some experts believe that crowdsourced software testing could have its own set of challenges for typical software development. The most critical among them is security. Imagine a scenario where the beta version of a product carries serious security vulnerabilities. Hackers could exploit these vulnerabilities to steal valuable intellectual property before they are patched. It needs to be remembered that not all users in a crowd are well-meaning customers. By relying on crowdsourced testing for software products, businesses could put themselves at a lot of risk.

The future thus seems to point towards a scenario where in-house testers would continue to exist. However, their scope could be smaller yet more holistic than it is today. They could continue to work on testing product features and security vulnerabilities that need to be resolved before it could be taken out for crowd-testing. Essentially, this would mean playing the role of a facilitator that would ensure continual crowd testing and management of products and services. Now that is something that would ensure that the product not only stays robust, but also turns more nimble and agile in tune with the time. What are your thoughts? Please share them in the comments below.

More Stories By Harry Trott

Harry Trott is an IT consultant from Perth, WA. He is currently working on a long term project in Bangalore, India. Harry has over 7 years of work experience on cloud and networking based projects. He is also working on a SaaS based startup which is currently in stealth mode.

CloudEXPO Stories
Mike is managing director in Deloitte Consulting LLP's Cloud practice, responsible for helping clients implement cloud strategy and architecture to drive digital transformation. Beyond his technology experience, Mike brings an insightful understanding of how to address the organizational change, process improvement, and talent management challenges associated with digital transformation. Mike brings more than 30 years of experience in software development and architecture to his role. Most recently, he was a principal architect with Cloud Technology Partners. A pioneer in cloud computing, Mike led a team that built the world's first high-speed transaction network in Amazon's public cloud and won the 2010 AWS Global Startup Challenge. He has written extensively about cloud technologies and the Internet of Things.
Having been in the web hosting industry since 2002, dhosting has gained a great deal of experience while working on a wide range of projects. This experience has enabled the company to develop our amazing new product, which they are now excited to present! Among dHosting's greatest achievements, they can include the development of their own hosting panel, the building of their fully redundant server system, and the creation of dhHosting's unique product, Dynamic Edge.
Your job is mostly boring. Many of the IT operations tasks you perform on a day-to-day basis are repetitive and dull. Utilizing automation can improve your work life, automating away the drudgery and embracing the passion for technology that got you started in the first place. In this presentation, I'll talk about what automation is, and how to approach implementing it in the context of IT Operations. Ned will discuss keys to success in the long term and include practical real-world examples. Get started on automating your way to a brighter future!
The challenges of aggregating data from consumer-oriented devices, such as wearable technologies and smart thermostats, are fairly well-understood. However, there are a new set of challenges for IoT devices that generate megabytes or gigabytes of data per second. Certainly, the infrastructure will have to change, as those volumes of data will likely overwhelm the available bandwidth for aggregating the data into a central repository. Ochandarena discusses a whole new way to think about your next-gen applications and how to address the challenges of building applications that harness all data types and sources.
DXWorldEXPO LLC announced today that Big Data Federation to Exhibit at the 22nd International CloudEXPO, colocated with DevOpsSUMMIT and DXWorldEXPO, November 12-13, 2018 in New York City. Big Data Federation, Inc. develops and applies artificial intelligence to predict financial and economic events that matter. The company uncovers patterns and precise drivers of performance and outcomes with the aid of machine-learning algorithms, big data, and fundamental analysis. Their products are deployed by some of the world's largest financial institutions. The company develops and applies innovative machine-learning technologies to big data to predict financial, economic, and world events. The team is a group of passionate technologists, mathematicians, data scientists and programmers in Silicon Valley with over 100 patents to their names. Big Data Federation was incorporated in 2015 and is ...