Welcome!

Cloud Expo Authors: Jerry Melnick, Liz McMillan, Michelle Drolet, Elizabeth White, Kevin Benedict

Related Topics: Cloud Expo, Java, SOA & WOA, Virtualization, Big Data Journal, SDN Journal

Cloud Expo: Blog Feed Post

SaaS Metrics 2.0 – A Guide to Measuring and Improving What Matters

SaaS/subscription businesses are more complex than traditional businesses

“If you cannot measure it, you cannot improve it” – Lord Kelvin

This article is a comprehensive and detailed look at the key metrics that are needed to understand and optimize a SaaS business. It is a completely updated rewrite of an older post.  For this version, I have co-opted two real experts in the field: Ron Gill, (CFO, NetSuite), and Brad Coffey (VP of Strategy, HubSpot), to add expertise, color and commentary from the viewpoint of a public and private SaaS company. My sincere thanks to both of them for their time and input.

SaaS/subscription businesses are more complex than traditional businesses. Traditional business metrics totally fail to capture the key factors that drive SaaS performance. In the SaaS world, there are a few key variables that make a big difference to future results. This post is aimed at helping SaaS executives understand which variables really matter, and how to measure them and act on the results.

The goal of the article is to help you answer the following questions:

  • Is my business financially viable?
  • What is working well, and what needs to be improved?
  • What levers should management focus on to drive the business?
  • Should the CEO hit the accelerator, or the brakes?
  • What is the impact on cash and profit/loss of hitting the accelerator?

(Note: although I focus on SaaS specifically, the article is applicable to any subscription business.)

What's so different about SaaS?
SaaS, and other recurring revenue businesses are different because the revenue for the service comes over an extended period of time (the customer lifetime). If a customer is happy with the service, they will stick around for a long time, and the profit that can be made from that customer will increase considerably. On the other hand if a customer is unhappy, they will churn quickly, and the business will likely lose money on the investment that they made to acquire that customer. This creates a fundamentally different dynamic to a traditional software business: there are now two sales that have to be accomplished:

  1. Acquiring the customer
  2. Keeping the customer (to maximize the lifetime value).

Because of the importance of customer retention, we will see a lot of focus on metrics that help us understand retention and churn. But first let's look at metrics that help you understand if your SaaS business is financially viable.

image

The SaaS P&L / Cash Flow Trough

SaaS businesses face significant losses in the early years (and often an associated cash flow problem). This is because they have to invest heavily upfront to acquire the customer, but recover the profits from that investment over a long period of time. The faster the business decides to grow, the worse the losses become. Many investors/board members have a problem understanding this, and want to hit the brakes at precisely the moment when they should be hitting the accelerator.

In many SaaS businesses, this also translates into a cash flow problem, as they may only be able to get the customer to pay them month by month. To illustrate the problem, we built a simple Excel model which can be found here.  In that model, we are spending $6,000 to acquire the customer, and billing them at the rate of $500 per month. Take a look at these two graphs from that model:

image

image

If we experience a cash flow trough for one customer, then what will happen if we start to do really well and acquire many customers at the same time? The model shows that the P&L/cash flow trough gets deeper if we increase the growth rate for the bookings.

image

But there is light at the end of the tunnel, as eventually there is enough profit/cash from the installed base to cover the investment needed for new customers. At that point the business would turn profitable/cash flow positive - assuming you don't decide to increase spending on sales and marketing. And, as expected, the faster the growth in customer acquisition, the better the curve looks when it becomes positive.

Ron Gill, NetSuite:

If plans go well, you may decide it is time to hit the accelerator (increasing spending on lead generation, hiring additional sales reps, adding data center capacity, etc.) in order to pick-up the pace of customer acquisition. The thing that surprises many investors and boards of directors about the SaaS model is that, even with perfect execution, an acceleration of growth will often be accompanied by a squeeze on profitability and cash flow.

As soon as the product starts to see some significant uptake, investors expect that the losses / cash drain should narrow, right? Instead, this is the perfect time to increase investment in the business. which will cause losses to deepen again. The graph below illustrates the problem:

image

Notice in the example graph that the five customer per month model ultimately yields a much steeper rate of growth, but you have to go through another deep trough to get there. It is the concept of needing to re-enter that type of trough after just having gotten the curve to turn positive that many managers and investors struggle with.

Of course this a special challenge early-on as you need to explain to investors why you'll require additional cash to fund that next round of acceleration. But it isn't just a startup problem. At NetSuite, even as a public company our revenue growth rate has accelerated in each of the last three years. That means that each annual plan involves a stepping-up of investment in lead generation and sales capacity that will increase spending and cash flow out for some time before it starts yielding incremental revenue and cash flow in. As long as you're accelerating the rate of revenue growth, managing and messaging around this phenomenon is a permanent part of the landscape for any SaaS company.

Why is growth important?
We have suggested that as soon as the business has shown that it can succeed, it should invest aggressively to increase the growth rate. You might ask question: Why?

SaaS is usually a "winner-takes-all" game, and it is therefore important to grab market share as fast as possible to make sure you are the winner in your space. Provided you can tell a story that shows that eventually that growth will lead to profitability, Wall Street, acquiring companies, and venture investors all reward higher growth with higher valuations. There's also a premium for the market leader in a particular space.

However not all investments make sense. In the next section we will look at a tool to help you ensure that your growth initiatives/investments will pay back:  Unit Economics.

A Powerful Tool: Unit Economics
Because of the losses in the early days, which get bigger the more successful the company is at acquiring customers, it is much harder for management and investors to figure out whether a SaaS business is financially viable. We need some tools to help us figure this out.

A great way to understand any business model is to answer the following simple question:

Can I make more profit from my customers than it costs me to acquire them?

This is effectively a study of the unit economics of each customer. To answer the question, we need two metrics:

  • LTV - the Lifetime Value of a typical customer
  • CAC - the Cost to Acquire a  typical Customer

(For more on how to calculate LTV and CAC, click here.)

Entrepreneurs are usually overoptimistic about how much it costs to acquire a customer. This probably comes from a belief that customers will be so excited about what they have built, that they will beat a path to their doors to buy the product. The reality is often very different! (I have written more on this topic here: Startup Killer: The Cost of Customer Acquisition, and here: How Sales Complexity impacts CAC.)

Is your SaaS business viable?
In the first version of this article, I introduced two guidelines that could be used to judge quickly whether your SaaS business is viable. The first is a good way to figure out if you will be profitable in the long run, and the second is about measuring the time to profitability (which also greatly impacts capital efficiency).

image

Over the last two years, I have had the chance to validate these guidelines with many SaaS businesses, and it turns out that these early guesses have held up well. The best SaaS businesses have a LTV to CAC ratio that is higher than 3, sometimes as high as 7 or 8. And many of the best SaaS businesses are able to recover their CAC in 5-7 months. However many healthy SaaS businesses don't meet the guidelines in the early days, but can see how they can improve the business over time to get there.

The second guideline (Months to Recover CAC)  is all about time to profitability and cash flow. Larger businesses, such as wireless carriers and credit card companies, can afford to have a longer time to recover CAC, as they have access to tons of cheap capital. Startups, on the other hand, typically find that capital is expensive in the early days.  However even if capital is cheap, it turns out that Months to recover CAC is a very good predictor of how well a SaaS business will perform. Take a look at the graph below, which comes from the same model used earlier. It shows how the profitability is anemic if the time to recover CAC extends beyond 12 months.

I should stress that these are only guidelines, there are always situations where it makes sense to break them.

image

Three uses for the SaaS Guidelines

  1. One of the key jobs of the CEO is to decide when to hit the accelerator pedal. The value of these two guidelines is that they help you understand when you have a SaaS business that is in good shape, where it makes sense to hit the accelerator pedal. Alternatively if your business doesn't meet the guidelines, it is a good indicator that there is more tweaking needed to fix the business before you should expand.
  2. Another way to use the two guidelines is for evaluating different lead sources. Different lead sources (e.g. Google AdWords, TV, Radio, etc.) have different costs associated with them. The guidelines help you understand if some of the more expensive lead generation options make financial sense. If they meet these guidelines, it makes sense to hit the accelerator on those sources (assuming you have the cash).Using the second guideline, and working backwards, we can tell that if we are getting paid $500 per month, we can afford to spend up to 12x that amount (i.e. $6,000) on acquiring the customer. If we're spending less than that, you can afford to be more aggressive and spend more in marketing or sales.
  3. There is another important way to use this type of guideline: segmentation. Early-stage companies are often testing their offering with several different uses/types of customers / pricing models / industry verticals. It is very useful to examine which segments show the quickest return or highest LTV to CAC in order to understand which will be the most profitable to pursue.

Unit Economics in Action: HubSpot Example
HubSpot's unit economics were recently published in an article in Forbes:

You can see from the second row in this table how they have dramatically improved their unit economics (LTV:CAC ratio) over the five quarters shown. The big driver for this was lowering the MRR Churn rate from 3.5% to 1.5%. This drove up the lifetime value of the customer considerably.  They were also able to drive up their AVG MRR per customer.

Brad Coffey, HubSpot:

In 2011 and early 2012 we used this chart to guide many of our business decisions at HubSpot. By breaking LTV:CAC down into its components we could examine each metric and understand what levers we could pull to drive overall improvement.

It turned out that the levers we could pull varied by segment. In the SMB market for instance we had the right sales process in place - but had an opportunity to improve LTV by improving the product to lower churn and increasing our average price in the segment. In the VSB (Very Small Business) segment, by contrast, there wasn't as much upside left on the LTV (VSB customers have less money and naturally higher churn) so we focused on lowering CAC by removing friction from our sales process and moving more of our sales to the channel.

Two kinds of SaaS business:

There are two kinds of SaaS business:

  • Those with primarily monthly contracts, with some longer term contracts. In this business, the primary focus will be on MRR (Monthly Recurring Revenue)
  • Those with primarily annual contracts, with some contracts for multiple years. Here the primary focus is on ARR (Annual Recurring Revenue), and ACV (Annual Contract Value).

Most of the time in this article, I will refer to MRR/ACV. This means use MRR if you are the first kind of business, or ACV if you are the second kind of business. The dashboard shown below assumes monthly contracts (MRR). However in the downloadable spreadsheet, there is a tab that shows the same dashboard for the second kind, focusing on ACV instead of MRR.

SaaS Bookings: Three Contributing Elements
Every month in a SaaS business, there are three elements that contribute to how much MRR will change relative to the previous month:

What happened with new customers added in the month:

  • New MRR (or ACV)

What happened in the installed base of customers:

  • Churned MRR (or ACV) (from existing customers that cancelled their subscription. This will be a negative number.)
  • Expansion MRR (or ACV) (from existing customers who expanded their subscription)

The sum all three of these makes up your Net MRR or ACV Bookings:

image

I recommend that you track these using a chart similar to the one below:

image

This chart shows the three components of MRR (or ACV) Bookings, and the Net New MRR (or ACV) Bookings. By breaking out each component, you can track the key elements that are driving your business. The one variation we would recommend making to this chart is to show a dotted line for the plan, so you can track how you are doing against plan for each of the four lines. This is one of the most important charts to help you understand and run your business.

Ron Gill, NetSuite:

This chart is really good. I also like to look at this data in tabular form because I want to know y-o-y growth rates. E.g. "Net new MRR is up 25% over June of last year". The Y-o-Y % is a metric easily compared with increased spending, sales capacity, etc.

The Importance of Customer Retention (Churn)

In the early days of a SaaS business, churn really doesn't matter that much. Let's say that you lose 3% of your customers every month. When you only have a hundred customers, losing 3 of them is not that terrible. You can easily go and find another 3 to replace them. However as your business grows in size, the problem becomes different. Imagine that you have become really big, and now have a million customers. 3% churn means that you are losing 30,000 customers every month! That turns out to be a much harder number to replace. Companies like Constant Contact have run into this problem, and it has made it very hard for them to keep up their growth rate.

Ron Gill, NetSuite:

One oft-overlooked aspect of churn is that the churn rate, combined with the rate of new ARR adds, not only defines how fast you can grow the business, it also defines the maximum size the business can reach (see graph below).

image

It is an enlightening exercise to build a simple model like this for your business and plot where your current revenue run rate sits on the blue line defined by your present rate of ARR adds and churn. Are you near the left-hand side, where the growth is still steep and the ceiling is still far above? Or, are you further to the right where revenue growth will level off and there is limited room left to grow? How much benefit will you get from small improvements in churn or the pace of new business sign-up?

At NetSuite, we've had great success shifting the line in the last few years by both dramatically decreasing churn and by increasing average deal size and volume, thus increasing ARR adds. The result was both to steadily move the limit upward and to steepen the growth curve at the current ARR run rate, creating room for increasingly rapid expansion.

The Power of Negative Churn
The ultimate solution to the churn problem is to get to Negative Churn.

image

There are two ways to get this expansion revenue:

  1. Use a pricing scheme that has a variable axis, such as the number of seats used, the number of leads tracked, etc. That way, as your customers expand their usage of your product, they pay you more.
  2. Upsell/Cross-sell them to more powerful versions of your product, or additional modules.

To help illustrate the power of negative churn, take a look at the following two graphs that show how cohorts behave with 3% churn, and then with 3% negative churn. (Since this is the first time I have used the word Cohort, let me explain what it means. A cohort is simply a fancy word for a group of customers. In the SaaS world, it is used typically to describe the group that joined in a particular month. So there would be the January cohort, February cohort, etc.  In our graphs below, a different color is used for each month's cohort, so we can see how they decline or grow, based on the churn rate.)

In the top graph, we are losing 3% of our revenue every month, and you can see that with a constant bookings rate of $6k per month, the revenue reaches $140k after 40 months, and growth is flattening out. In the bottom graph, we may be losing some customers, but the remaining customers are more than making up for that with increased revenue. With a negative churn rate of 3%, we reach $450k in revenue (more then 3x greater), and the growth in revenues is increasing, not flattening.

imageimage

For more on this topic, you may wish to refer to these two blog posts of mine:

More Stories By David Skok

David Skok joined Matrix Partners as a General Partner in May 2001. He has a wealth of experience running companies. He started his first company in 1977 at age 22. Since then he has founded a total of four separate companies and performed one turn-around. Three of these companies went public.

Skok joined Matrix from SilverStream Software, which he founded in June 1996. Prior to its July 2002 acquisition by Novell, SilverStream was a public company that had reached a revenue run rate in excess of $100M, with approximately 800 employees and offices in more than 20 countries around the world. His work as a value added investor is best known for helping JBoss take its Open Source business to a successful exit with its sale to Red Hat, and for helping AppIQ, Tabblo and Diligent Technologies, which have all had successful exits, from their inceptions to their acquisitions by HP and IBM.

He serves on the boards of Digium (makers of the very popular Asterisk Open Source PBX/telephony software), CloudSwitch, Enservio, OpenSpan, Solidworks, VideoIQ, and HubSpot. In addition to his broad focus on enterprise software, he is specifically focused on the areas of cloud computing, Open Source, Software as a Service (SaaS), marketing automation, virtualization, storage, and data center automation.

Cloud Expo Breaking News
More and more enterprises today are doing business by opening up their data and applications through APIs. Though forward-thinking and strategic, exposing APIs also increases the surface area for potential attack by hackers. To benefit from APIs while staying secure, enterprises and security architects need to continue to develop a deep understanding about API security and how it differs from traditional web application security or mobile application security. In his session at 14th Cloud Expo, Sachin Agarwal, VP of Product Marketing and Strategy at SOA Software, will walk you through the various aspects of how an API could be potentially exploited. He will discuss the necessary best practices to secure your data and enterprise applications while continue continuing to support your business’s digital initiatives.
Web conferencing in a public cloud has the same risks as any other cloud service. If you have ever had concerns over the types of data being shared in your employees’ web conferences, such as IP, financials or customer data, then it’s time to look at web conferencing in a private cloud. In her session at 14th Cloud Expo, Courtney Behrens, Senior Marketing Manager at Brother International, will discuss how issues that had previously been out of your control, like performance, advanced administration and compliance, can now be put back behind your firewall.
Next-Gen Cloud. Whatever you call it, there’s a higher calling for cloud computing that requires providers to change their spots and move from a commodity mindset to a premium one. Businesses can no longer maintain the status quo that today’s service providers offer. Yes, the continuity, speed, mobility, data access and connectivity are staples of the cloud and always will be. But cloud providers that plan to not only exist tomorrow – but to lead – know that security must be the top priority for the cloud and are delivering it now. In his session at 14th Cloud Expo, Kurt Hagerman, Chief Information Security Officer at FireHost, will detail why and how you can have both infrastructure performance and enterprise-grade security – and what tomorrow's cloud provider will look like.
The social media expansion has shown just how people are eager to share their experiences with the rest of the world. Cloud technology is the perfect platform to satisfy this need given its great flexibility and readiness. At Cynny, we aim to revolutionize how people share and organize their digital life through a brand new cloud service, starting from infrastructure to the users’ interface. A revolution that began from inventing and designing our very own infrastructure: we have created the first server network powered solely by ARM CPU. The microservers have “organism-like” features, differentiating them from any of the current technologies. Benefits include low consumption of energy, making Cynny the ecologically friendly alternative for storage as well as cheaper infrastructure, lower running costs, etc.
The revolution that happened in the server universe over the past 15 years has resulted in an eco-system that is more open, more democratically innovative and produced better results in technically challenging dimensions like scale. The underpinnings of the revolution were common hardware, standards based APIs (ex. POSIX) and a strict adherence to layering and isolation between applications, daemons and kernel drivers/modules which allowed multiple types of development happen in parallel without hindering others. Put simply, today's server model is built on a consistent x86 platform with few surprises in its core components. A kernel abstracts away the platform, so that applications and daemons are decoupled from the hardware. In contrast, networking equipment is still stuck in the mainframe era. Today, networking equipment is a single appliance, including hardware, OS, applications and user interface come as a monolithic entity from a single vendor. Switching between different vendor'...
Cloud backup and recovery services are critical to safeguarding an organization’s data and ensuring business continuity when technical failures and outages occur. With so many choices, how do you find the right provider for your specific needs? In his session at 14th Cloud Expo, Daniel Jacobson, Technology Manager at BUMI, will outline the key factors including backup configurations, proactive monitoring, data restoration, disaster recovery drills, security, compliance and data center resources. Aside from the technical considerations, the secret sauce in identifying the best vendor is the level of focus, expertise and specialization of their engineering team and support group, and how they monitor your day-to-day backups, provide recommendations, and guide you through restores when necessary.
Cloud scalability and performance should be at the heart of every successful Internet venture. The infrastructure needs to be resilient, flexible, and fast – it’s best not to get caught thinking about architecture until the middle of an emergency, when it's too late. In his interactive, no-holds-barred session at 14th Cloud Expo, Phil Jackson, Development Community Advocate for SoftLayer, will dive into how to design and build-out the right cloud infrastructure.
You use an agile process; your goal is to make your organization more agile. What about your data infrastructure? The truth is, today’s databases are anything but agile – they are effectively static repositories that are cumbersome to work with, difficult to change, and cannot keep pace with application demands. Performance suffers as a result, and it takes far longer than it should to deliver on new features and capabilities needed to make your organization competitive. As your application and business needs change, data repositories and structures get outmoded rapidly, resulting in increased work for application developers and slow performance for end users. Further, as data sizes grow into the Big Data realm, this problem is exacerbated and becomes even more difficult to address. A seemingly simple schema change can take hours (or more) to perform, and as requirements evolve the disconnect between existing data structures and actual needs diverge.
SYS-CON Events announced today that SherWeb, a long-time leading provider of cloud services and Microsoft's 2013 World Hosting Partner of the Year, will exhibit at SYS-CON's 14th International Cloud Expo®, which will take place on June 10–12, 2014, at the Javits Center in New York City, New York. A worldwide hosted services leader ranking in the prestigious North American Deloitte Technology Fast 500TM, and Microsoft's 2013 World Hosting Partner of the Year, SherWeb provides competitive cloud solutions to businesses and partners around the world. Founded in 1998, SherWeb is a privately owned company headquartered in Quebec, Canada. Its service portfolio includes Microsoft Exchange, SharePoint, Lync, Dynamics CRM and more.
The world of cloud and application development is not just for the hardened developer these days. In their session at 14th Cloud Expo, Phil Jackson, Development Community Advocate for SoftLayer, and Harold Hannon, Sr. Software Architect at SoftLayer, will pull back the curtain of the architecture of a fun demo application purpose-built for the cloud. They will focus on demonstrating how they leveraged compute, storage, messaging, and other cloud elements hosted at SoftLayer to lower the effort and difficulty of putting together a useful application. This will be an active demonstration and review of simple command-line tools and resources, so don’t be afraid if you are not a seasoned developer.
SYS-CON Events announced today that BUMI, a premium managed service provider specializing in data backup and recovery, will exhibit at SYS-CON's 14th International Cloud Expo®, which will take place on June 10–12, 2014, at the Javits Center in New York City, New York. Manhattan-based BUMI (Backup My Info!) is a premium managed service provider specializing in data backup and recovery. Founded in 2002, the company’s Here, There and Everywhere data backup and recovery solutions are utilized by more than 500 businesses. BUMI clients include professional service organizations such as banking, financial, insurance, accounting, hedge funds and law firms. The company is known for its relentless passion for customer service and support, and has won numerous awards, including Customer Service Provider of the Year and 10 Best Companies to Work For.
Chief Security Officers (CSO), CIOs and IT Directors are all concerned with providing a secure environment from which their business can innovate and customers can safely consume without the fear of Distributed Denial of Service attacks. To be successful in today's hyper-connected world, the enterprise needs to leverage the capabilities of the web and be ready to innovate without fear of DDoS attacks, concerns about application security and other threats. Organizations face great risk from increasingly frequent and sophisticated attempts to render web properties unavailable, and steal intellectual property or personally identifiable information. Layered security best practices extend security beyond the data center, delivering DDoS protection and maintaining site performance in the face of fast-changing threats.
From data center to cloud to the network. In his session at 3rd SDDC Expo, Raul Martynek, CEO of Net Access, will identify the challenges facing both data center providers and enterprise IT as they relate to cross-platform automation. He will then provide insight into designing, building, securing and managing the technology as an integrated service offering. Topics covered include: High-density data center design Network (and SDN) integration and automation Cloud (and hosting) infrastructure considerations Monitoring and security Management approaches Self-service and automation
In his session at 14th Cloud Expo, David Holmes, Vice President at OutSystems, will demonstrate the immense power that lives at the intersection of mobile apps and cloud application platforms. Attendees will participate in a live demonstration – an enterprise mobile app will be built and changed before their eyes – on their own devices. David Holmes brings over 20 years of high-tech marketing leadership to OutSystems. Prior to joining OutSystems, he was VP of Global Marketing for Damballa, a leading provider of network security solutions. Previously, he was SVP of Global Marketing for Jacada where his branding and positioning expertise helped drive the company from start-up days to a $55 million initial public offering on Nasdaq.
Performance is the intersection of power, agility, control, and choice. If you value performance, and more specifically consistent performance, you need to look beyond simple virtualized compute. Many factors need to be considered to create a truly performant environment. In his General Session at 14th Cloud Expo, Marc Jones, Vice President of Product Innovation for SoftLayer, will explain how to take advantage of a multitude of compute options and platform features to make cloud the cornerstone of your online presence.