Welcome!

@CloudExpo Authors: Shelly Palmer, Elizabeth White, Karthick Viswanathan, Pat Romanski, Liz McMillan

Related Topics: @CloudExpo, Java IoT, Mobile IoT, Linux Containers, Agile Computing, FinTech Journal, @DevOpsSummit

@CloudExpo: Article

Mobile Performance Testing | @CloudExpo #DevOps #IoT #M2M #ML #BigData

Simply ignoring mobile users during your performance testing is dangerous

If you read the title and assumed this post would be filled with baseball analogies, you'd be right! It's game day and all those fans who fill up major league stadiums, those are your application users. They are invested in the game and have shown up to watch the players (i.e. your application) perform.

Depending on how the game plays out, your audience will either head home elated or full of disappointment. The great thing is that in your case, unlike in the case of traditional baseball games, there doesn't have to be a loser. You can consistently ensure happy mobile users by setting yourself up for home runs and the crème de la crème, grand slams.

Despite the monumental importance of providing a seamless app experience for mobile users, companies still fall short in terms of mobile performance testing - some even choose to completely forgo the practice.

Striking out isn't any fun for you or your app users, but that's exactly what you'll end up doing if you ignore mobile users during performance testing. So here's the breakdown - from strikeouts to grand slams - of the steps you'll need to take to deliver exceptional application performance to all of your mobile users, regardless of device, network conditions and geographic location.

A Strikeout
Simply ignoring mobile users during your performance testing is dangerous. More than once, major brands have faced website outages on Black Friday, no less, due to unexpected spikes in mobile usage. You need a mobile performance testing strategy because people will access your application via mobile devices, whether or not you have a dedicated mobile app.

If you fail to test the performance of your application for mobile users, they may encounter slow load times and/or site outages. This results in an automatic strikeout. It's even possible that your poor application performance sends users running...straight into the arms of competitors.

A Single
Device Simulation

Hitting a single is nothing to be ashamed of, but it's nothing to write home about either. As it relates to mobile performance testing, hitting a single means you're simulating devices (i.e., using a software platform installed on a laptop or desktop that imitates a mobile platform or OS environment). This gives testers insight into how an application behaves on an emulated phone.

A Double
Device Simulation + Network Emulation

As you'll note, these build on one another. Hitting a double is a result of using both device simulation and network emulation. Unlike desktop and laptop users, mobile users will suffer from poor network conditions including limited bandwidth, latency and packet loss at a much greater rate. Using a tool to emulate different conditions in your testing scenarios is essential in understanding how your application performs when users face changes in connectivity.

Ignoring the various network conditions users will face in the wild will surely affect the end user experience, and not in a positive way.

A Triple
Device Simulation + Network Emulation + Real-Device Recording

To hit a triple, you'll need to incorporate recording from real devices. Could you record your test cases on the web version of your app and just use device simulation during your tests? Sure, but you need to know the web and mobile versions of your app inside and out.

While the calls to the backend may be the same for web and mobile versions of apps, mobile versions often don't have all the features of the web versions. This means you may be replaying actions a mobile user would never perform, and that could significantly skew your test results.

A Home Run
Device Simulation + Network Emulation + Real-Device Recording + End-User Experience Testing on Real Devices

Adding end-user experience (EUE) testing via real devices to your mobile performance testing strategy will earn you a home run! With EUE testing, functional test scripts will run on a real device while load testing is also being performed. Meanwhile, testers are able to measure the rendering times on the front end of the application so they can correlate backend times in order to quickly identify the root cause of performance issues.

A Grand Slam
Device Simulation + Network Emulation + Real-Device Recording + End User Experience Testing on Real Devices + Cloud Testing

To perform complete mobile performance testing and hit that grand slam, you'll need to add geographic realism to your scenarios by load testing from the cloud. Mobile users aren't accessing your servers from a single location and varying geographic dynamics can greatly affect the way load is placed on your application. To create the most realistic tests, use the cloud to distribute your load generators geographically based on historical user data - from where do they typically access your application?

Adding geographic realism to your performance tests will give you better insight into any performance limitations of your application.

Take Home the Win
Racking up some singles, doubles and triples never hurt, but mobile users (and fans) demand more. Any sign of application performance issues can quickly lead to revenue loss, brand damage and diminished employee productivity. As such, companies should, at the very least, invest in the development of a Home Run mobile performance testing strategy.

However, to come out on top and continuously deliver an exceptional application experience to mobile users, you'll need to adopt a Grand Slam strategy. We know that on your journey to complete mobile performance testing you may face some challenges. To learn how you can overcome these challenges check out our free whitepaper, "Addressing Mobile Load Testing Challenges."

Batter up!

More Stories By Tim Hinds

Tim Hinds is the Product Marketing Manager for NeoLoad at Neotys. He has a background in Agile software development, Scrum, Kanban, Continuous Integration, Continuous Delivery, and Continuous Testing practices.

Previously, Tim was Product Marketing Manager at AccuRev, a company acquired by Micro Focus, where he worked with software configuration management, issue tracking, Agile project management, continuous integration, workflow automation, and distributed version control systems.

@CloudExpo Stories
The Internet giants are fully embracing AI. All the services they offer to their customers are aimed at drawing a map of the world with the data they get. The AIs from these companies are used to build disruptive approaches that cannot be used by established enterprises, which are threatened by these disruptions. However, most leaders underestimate the effect this will have on their businesses. In his session at 21st Cloud Expo, Rene Buest, Director Market Research & Technology Evangelism at Ara...
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, will introduce two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a mu...
Trying to improve density, lower costs and run applications faster than before? Today, enterprises looking for a secure cloud strategy are increasingly turning to container-based Platform as a Service solutions for on-premises hosted DevOps. In her session at 21st Cloud Expo, Alise Cashman Spence, Offering Manager, Power Systems Cloud Solutions at IBM, will discuss the driving factors behind these cloud trends and how IBM customers are realizing exceptional performance, security and control for ...
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devic...
Mobile device usage has increased exponentially during the past several years, as consumers rely on handhelds for everything from news and weather to banking and purchases. What can we expect in the next few years? The way in which we interact with our devices will fundamentally change, as businesses leverage Artificial Intelligence. We already see this taking shape as businesses leverage AI for cost savings and customer responsiveness. This trend will continue, as AI is used for more sophistica...
"When we talk about cloud without compromise what we're talking about is that when people think about 'I need the flexibility of the cloud' - it's the ability to create applications and run them in a cloud environment that's far more flexible,” explained Matthew Finnie, CTO of Interoute, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"NetApp's vision is how we help organizations manage data - delivering the right data in the right place, in the right time, to the people who need it, and doing it agnostic to what the platform is," explained Josh Atwell, Developer Advocate for NetApp, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
SYS-CON Events announced today that SourceForge has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. SourceForge is the largest, most trusted destination for Open Source Software development, collaboration, discovery and download on the web serving over 32 million viewers, 150 million downloads and over 460,000 active development projects each and every month.
What You Need to Know You know you need the cloud, but you’re hesitant to simply dump everything at Amazon since you know that not all workloads are suitable for cloud. You know that you want the kind of ease of use and scalability that you get with public cloud, but your applications are architected in a way that makes the public cloud a non-starter. You’re looking at private cloud solutions based on hyperconverged infrastructure, but you’re concerned with the limits inherent in those technolog...
SYS-CON Events announced today that DXWorldExpo has been named “Global Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Digital Transformation is the key issue driving the global enterprise IT business. Digital Transformation is most prominent among Global 2000 enterprises and government institutions.
One of the biggest challenges with adopting a DevOps mentality is: new applications are easily adapted to cloud-native, microservice-based, or containerized architectures - they can be built for them - but old applications need complex refactoring. On the other hand, these new technologies can require relearning or adapting new, oftentimes more complex, methodologies and tools to be ready for production. In his general session at @DevOpsSummit at 20th Cloud Expo, Chris Brown, Solutions Marketi...
SYS-CON Events announced today that Nihon Micron will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Nihon Micron Co., Ltd. strives for technological innovation to establish high-density, high-precision processing technology for providing printed circuit board and metal mount RFID tags used for communication devices. For more inf...
SYS-CON Events announced today that Ryobi Systems will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Ryobi Systems Co., Ltd., as an information service company, specialized in business support for local governments and medical industry. We are challenging to achive the precision farming with AI. For more information, visit http:...
SYS-CON Events announced today that mruby Forum will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. mruby is the lightweight implementation of the Ruby language. We introduce mruby and the mruby IoT framework that enhances development productivity. For more information, visit http://forum.mruby.org/.
SYS-CON Events announced today that Mobile Create USA will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Mobile Create USA Inc. is an MVNO-based business model that uses portable communication devices and cellular-based infrastructure in the development, sales, operation and mobile communications systems incorporating GPS capabi...
SYS-CON Events announced today that Daiya Industry will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Daiya Industry specializes in orthotic support systems and assistive devices with pneumatic artificial muscles in order to contribute to an extended healthy life expectancy. For more information, please visit https://www.daiyak...
SYS-CON Events announced today that Fusic will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Fusic Co. provides mocks as virtual IoT devices. You can customize mocks, and get any amount of data at any time in your test. For more information, visit https://fusic.co.jp/english/.
SYS-CON Events announced today that Keisoku Research Consultant Co. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Keisoku Research Consultant, Co. offers research and consulting in a wide range of civil engineering-related fields from information construction to preservation of cultural properties. For more information, vi...
SYS-CON Events announced today that MIRAI Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MIRAI Inc. are IT consultants from the public sector whose mission is to solve social issues by technology and innovation and to create a meaningful future for people.
SYS-CON Events announced today that Interface Corporation will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Interface Corporation is a company developing, manufacturing and marketing high quality and wide variety of industrial computers and interface modules such as PCIs and PCI express. For more information, visit http://www.i...