|By SmartBear Blog||
|February 21, 2016 09:00 AM EST||
Five Ways to Safeguard Your Application from Third-Party API Outages
By Janet Wagner
The Internet of Things (IoT) is growing at a rapid pace with millions of new devices getting connected every day.
Gartner forecasts that 6.4 billion connected things will be in use in 2016 and by 2020, the number will reach 20.8 billion. Billions of devices including smartphones, laptops, cars, watches, refrigerators, and even thermostats are all getting connected thanks to APIs. Many of these devices are part of a larger application ecosystem, connected to the cloud and each other using the same APIs.
There have been a number of high-profile API outages in recent months that caused some well-known websites and applications to go down. With so many devices and applications using many of the same cloud services and APIs, one outage can potentially take down entire application ecosystems. While it may not be possible to completely prevent an API outage from taking down your website, web or mobile application, it is possible to take steps to reduce the impact of a third-party API outage.
Web Service Outages
Twitter experienced a major outage for about an hour on January 19, 2016 which caused the Twitter website and applications to malfunction for users worldwide.
Application ecosystems are getting larger and more complex with each passing day. While API providers do their best to ensure API availability, outages do still occur from time to time.
Consider the following examples:
- On January 26, 2015, both the Facebook and Instagram API servers went down for about an hour taking down Facebook and Instagram. The outage also impacted a number of well-known websites including Tinder and HipChat.
- On September 20, 2015, Amazon Web Services (AWS) experienced a brief disruption that caused an increase in faults for the EC2 Auto Scaling APIs. Within the same month, the Facebook Graph API went down briefly on three separate occasions. Facebook is considered a very reliable service so the fact that Facebook suffered from three outages in the same month was widely reported.
- On January 19, 2016, Twitter experienced a major outage that impacted many of the websites and applications using Twitter APIs. The API outages caused the Twitter website and applications to malfunction for users worldwide for about an hour.
API outages aren't limited to the large scale APIs like those experienced by giants like Facebook and Amazon. And if you have an application that is dependent on external APIs to perform a critical function, you need to have a plan for dealing with disruptions.
There are a number of solutions that developers can use to prevent API outages from negatively impacting a website or application.
1. API Virtualization
API virtualization is a process that makes it possible to create a virtual copy of an API capable of emulating the same functionality and performance of a production API. API virtualization can be used to create a virtual sandbox for integration, scenario, load, and performance testing of internal and third-party APIs. Unlike service virtualization, a process that mimics an entire system, API virtualization only emulates the API which is considerably less expensive, easier to implement, and less time consuming.
"It's all about time and cost. API virtualization, beyond simple service mocking, provides technical teams a frictionless way to reduce delays in development and testing. Lightweight, virtual APIs empower teams to simulate errors, network latency and congestion, and even stand up API sandboxes," said Paul Bruce, API team product manager at SmartBear. "These ‘virts' (as the folks at SmartBear call them), allow you overcome third-party downtime, safeguard you from running over subscription limits, and even help to simplify versioning and release logistics."
Using API virtualization tools like ServiceV Pro, developers can test third-party API integrations by mimicking errors, server, and network behavior.
Matti Hjelm, product owner at SmartBear, said that "ServiceV works from two angles: both from the dev perspective to quickly create APIs for own use or for others to use; and for testers to have something to test against. This will truly speed up the build and deploy workflows dramatically."
API virtualization can help developers anticipate how specific third-party API outages will impact their application allowing them to plan for outages before moving the application to general availability.
2. Synthetic and Real User Monitoring
Synthetic monitoring is a script or tool that is capable of monitoring various aspects of APIs, web and mobile applications. Synthetic monitoring effectively "simulates users" monitoring the paths that users may take while using an application. Synthetic monitoring can help developers discover problems with an application before users do. Using synthetic monitoring, developers can find out:
- How well the website/application performs from specific geographic locations.
- How long it takes web pages to load.
- How an outage or slowdown will impact users.
- How well third-party scripts and APIs are operating.
- How well transactions are performing.
- How new features will impact performance and speed.
These are just a few of the things that developers can learn about an application by using synthetic monitoring.
"On the production side, synthetic API monitoring provides critical visibility into how your APIs perform under real conditions, prove uptime and availability, and split out important layers of your user experience so you can involve the right people to quickly resolve problems when they arise," said Bruce.
Real User Monitoring
Real user monitoring (RUM) is a script or tool designed to monitor and analyze all user transactions of a website or application. RUM is based on the traffic of actual application users, not virtual or simulated users like synthetic monitoring. RUM shows how users are interacting with an application, providing metrics that reflect the user experience (UX).
RUM can be used to monitor and capture a wide variety of web and mobile application metrics including load time, speed, errors, transaction performance, availability, and more. Problems with third-party APIs can impact the speed and performance of a website or application. There are RUM tools that can send automatic alerts in the event of a problem such as an API outage or application slowdown.
Products like AlertSite can be used for RUM monitoring as well as for synthetic monitoring of APIs, web and mobile applications.
3. A/B Testing
A/B testing is a method of testing in which two variants of a web page or application are compared to each other. For example, two versions of an application; one that includes a third-party API and one that does not, would be compared to see how that API will impact application speed and performance. A/B testing tools use data and metrics to determine the positive or negative impact of specific changes made to web pages or applications.
4. Asynchronous Scripting
Asynchronous scripting helps web pages render faster by allowing the main body of content to be loaded without having to wait for all of the external scripts to load. Without asynchronous scripting, users must wait for all of the external scripts to load first before they can view the main content of the web page. If a problem with a third-party script or API occurs, asynchronous scripting allows the body of content to be loaded despite the problem.
<script async src="script.js"></script>
Caching API responses allows API data to be stored on your website server instead of relying on the third-party server for every API call. Caching helps prevent an application from being impacted by third-party API outages because data is pulled from a local cache file instead of directly from the API server. Caching scripts are available in PHP, Python, and many other languages.
This article covers only a few of the steps that can be taken to safeguard your application from third-party API outages and errors.
Limiting the number of APIs your application uses, using well-designed APIs from reputable API providers, and using a full-featured APM tool can also help safeguard your application from API outages.
With the number of connected devices and application ecosystems growing at such as rapid pace, it is more important than ever for applications to be safeguarded from third-party API outages and errors.
@DevOpsSummit at Cloud taking place June 6-8, 2017, at Javits Center, New York City, is co-located with the 20th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long developm...
Apr. 30, 2017 10:15 AM EDT Reads: 2,565
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo 2016 in New York. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place June 6-8, 2017, at the Javits Center in New York City, New York, is co-located with 20th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry p...
Apr. 30, 2017 10:00 AM EDT Reads: 1,706
SYS-CON Events announced today that Juniper Networks (NYSE: JNPR), an industry leader in automated, scalable and secure networks, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Juniper Networks challenges the status quo with products, solutions and services that transform the economics of networking. The company co-innovates with customers and partners to deliver automated, scalable and secure network...
Apr. 30, 2017 09:45 AM EDT Reads: 1,847
SYS-CON Events announced today that Progress, a global leader in application development, has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Enterprises today are rapidly adopting the cloud, while continuing to retain business-critical/sensitive data inside the firewall. This is creating two separate data silos – one inside the firewall and the other outside the firewall. Cloud ISVs oft...
Apr. 30, 2017 09:15 AM EDT Reads: 816
Five years ago development was seen as a dead-end career, now it’s anything but – with an explosion in mobile and IoT initiatives increasing the demand for skilled engineers. But apart from having a ready supply of great coders, what constitutes true ‘DevOps Royalty’? It’ll be the ability to craft resilient architectures, supportability, security everywhere across the software lifecycle. In his keynote at @DevOpsSummit at 20th Cloud Expo, Jeffrey Scheaffer, GM and SVP, Continuous Delivery Busine...
Apr. 30, 2017 09:15 AM EDT Reads: 1,435
As pervasive as cloud technology is -- and as persuasive as the arguments are for using it -- the cloud has its limits. Some companies will always have security concerns about storing data in the cloud and certain high-transaction applications will always be better suited for on-premises storage. Those statements were among the bottom-line takeaways delivered at Cloud Expo this week, a three day, bi-annual event focused on cloud technologies, adoption and associated challenges.
Apr. 30, 2017 09:00 AM EDT Reads: 4,286
Bert Loomis was a visionary. This general session will highlight how Bert Loomis and people like him inspire us to build great things with small inventions. In their general session at 19th Cloud Expo, Harold Hannon, Architect at IBM Bluemix, and Michael O'Neill, Strategic Business Development at Nvidia, discussed the accelerating pace of AI development and how IBM Cloud and NVIDIA are partnering to bring AI capabilities to "every day," on-demand. They also reviewed two "free infrastructure" pr...
Apr. 30, 2017 08:30 AM EDT Reads: 1,827
SYS-CON Events announced today that T-Mobile will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. As America's Un-carrier, T-Mobile US, Inc., is redefining the way consumers and businesses buy wireless services through leading product and service innovation. The Company's advanced nationwide 4G LTE network delivers outstanding wireless experiences to 67.4 million customers who are unwilling to compromise on ...
Apr. 30, 2017 08:15 AM EDT Reads: 1,628
SYS-CON Events announced today that Super Micro Computer, Inc., a global leader in compute, storage and networking technologies, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Supermicro (NASDAQ: SMCI), the leading innovator in high-performance, high-efficiency server technology, is a premier provider of advanced server Building Block Solutions® for Data Center, Cloud Computing, Enterprise IT, Hadoop/...
Apr. 30, 2017 05:45 AM EDT Reads: 2,661
NHK, Japan Broadcasting, will feature the upcoming @ThingsExpo Silicon Valley in a special 'Internet of Things' and smart technology documentary that will be filmed on the expo floor between November 3 to 5, 2015, in Santa Clara. NHK is the sole public TV network in Japan equivalent to the BBC in the UK and the largest in Asia with many award-winning science and technology programs. Japanese TV is producing a documentary about IoT and Smart technology and will be covering @ThingsExpo Silicon Val...
Apr. 30, 2017 03:45 AM EDT Reads: 9,466
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
Apr. 30, 2017 03:30 AM EDT Reads: 6,259
Keeping pace with advancements in software delivery processes and tooling is taxing even for the most proficient organizations. Point tools, platforms, open source and the increasing adoption of private and public cloud services requires strong engineering rigor – all in the face of developer demands to use the tools of choice. As Agile has settled in as a mainstream practice, now DevOps has emerged as the next wave to improve software delivery speed and output. To make DevOps work, organization...
Apr. 30, 2017 02:45 AM EDT Reads: 9,271
The 20th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held June 6-8, 2017, at the Javits Center in New York City, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Containers, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal ...
Apr. 30, 2017 02:45 AM EDT Reads: 1,798
“DevOps is really about the business. The business is under pressure today, competitively in the marketplace to respond to the expectations of the customer. The business is driving IT and the problem is that IT isn't responding fast enough," explained Mark Levy, Senior Product Marketing Manager at Serena Software, in this SYS-CON.tv interview at DevOps Summit, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
Apr. 30, 2017 01:15 AM EDT Reads: 16,444
SYS-CON Events announced today that CollabNet, a global leader in enterprise software development, release automation and DevOps solutions, will be a Bronze Sponsor of SYS-CON's 20th International Cloud Expo®, taking place from June 6-8, 2017, at the Javits Center in New York City, NY. CollabNet offers a broad range of solutions with the mission of helping modern organizations deliver quality software at speed. The company’s latest innovation, the DevOps Lifecycle Manager (DLM), supports Value S...
Apr. 30, 2017 01:15 AM EDT Reads: 1,480
With billions of sensors deployed worldwide, the amount of machine-generated data will soon exceed what our networks can handle. But consumers and businesses will expect seamless experiences and real-time responsiveness. What does this mean for IoT devices and the infrastructure that supports them? More of the data will need to be handled at - or closer to - the devices themselves.
Apr. 30, 2017 12:15 AM EDT Reads: 1,226
Building a cross-cloud operational model can be a daunting task. Per-cloud silos are not the answer, but neither is a fully generic abstraction plane that strips out capabilities unique to a particular provider. In his session at 20th Cloud Expo, Chris Wolf, VP & Chief Technology Officer, Global Field & Industry at VMware, will discuss how successful organizations approach cloud operations and management, with insights into where operations should be centralized and when it’s best to decentraliz...
Apr. 30, 2017 12:00 AM EDT Reads: 1,130
Multiple data types are pouring into IoT deployments. Data is coming in small packages as well as enormous files and data streams of many sizes. Widespread use of mobile devices adds to the total. In this power panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists will look at the tools and environments that are being put to use in IoT deployments, as well as the team skills a modern enterprise IT shop needs to keep things running, get a handle on all this data, and deli...
Apr. 29, 2017 10:30 PM EDT Reads: 2,808
Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market across the USA and Europe, we work with a variety of customers from emerging startups to Fortune 1000 companies.
Apr. 29, 2017 10:15 PM EDT Reads: 2,634
Financial Technology has become a topic of intense interest throughout the cloud developer and enterprise IT communities. Accordingly, attendees at the upcoming 20th Cloud Expo at the Javits Center in New York, June 6-8, 2017, will find fresh new content in a new track called FinTech.
Apr. 29, 2017 10:00 PM EDT Reads: 2,678