Welcome!

@CloudExpo Authors: Elizabeth White, Pat Romanski, Liz McMillan, Yeshim Deniz, Aruna Ravichandran

Related Topics: @CloudExpo, Microservices Expo

@CloudExpo: Article

The New DBA for the Cloud

Five skills that enterprise DBAs need to acquire to manage cloud

Cloud Database Administration:
Database administration skills are the core of traditional enterprises in the data center. DBAs with skills in replication, backup, recovery and  clustering have been in high demand over the years due to the way the enterprises have taken care all aspects of the database administration.

However, the advent of the Cloud has shifted much of the DBA duties from the Cloud Consumer  (Enterprises) to the Cloud Providers (EC2, Azure and more).

Is the role of DBA irrelevant in a Cloud world? This article discuss five new skills that regular enterprise DBAs should acquire to make their presence as unique as always.

1. Improve On NOSQL Database Usage And Skills
In computing, NoSQL is a term used to designate database management systems that differ from classic relational database management systems in some way. In a cloud managed environment, NOSQL databases are here to stay, and they have their own advantages especially  in processing large amounts of distributed data.

  • Google's BigTable
  • Amazon SimpleDB
  • Windows Azure Storage BLOB Storage

All the above mean that the Non-Relational database usage is here to stay and the current DBAs should identify appropriate usage and maintenance of them.

2. Capacity Planning in Terms of On-Demand Usage Cost
Over the years, DBAs have been very successful in reactive monitoring of storage usages in terms of  GB, TB of disk space and also in predicting future capacity planning. However, as the entire trust of Cloud Computing is about a chargeback model based on storage, it becomes even more important for the DBA to understand the costing models behind the storage and help the enterprise with the best model possible for a given cloud provider.

  • For example, SQL Azure Business Edition databases are charged at $99.99 up to 10 GB per month and goes on based on further storage , Data transfers = $0.10 in / $0.15 out / GB - ($0.10 in / $0.20 out / GB in Asia)
  • Similar Amazon RDS On Demand DB Instances cost $2.60 price per hour for a extra large DB instance and similarly data transfers are priced separately. Apart from this the concept of Reserved Instances and Backup storage additionally alter the pricing.

With the additional concepts behind Cloud storage and pricing, it is the DBAs who need to have these details behind them and can provide the organizations about accurate information of how the storage and usage costs of the database will look like in a cloud environment.

3. Multi Tenancy & Data Partitioning
Earlier DBAs have big  servers and databases with unlimited storage at their disposal and most times the databases have been exclusively owned by enterprise vertical domains and  very little DBAs worried about the size of a single database and the  tenants who share the database.

  • SQL Azure has a 50 GB Limit per database
  • For each DB Instance class, AmazonRDS provides you with the ability to select from 5 GB to 1 TB of associated storage capacity for your primary data set. While the storage is unlimited , provisioning storage on demand rather pre allocating , makes it more efficient.

The new limitations in the database storage and the need to store multiple tenants require DBAs to think of different ways of partitioning data across multiple databases, which will go a long way toward an efficient data organization for Cloud.

4. Monitoring
On-demand instances are provisioned based on the  usage of the application and hourly demands. Also  much of the  instances  are virtual server based and the IP Addresses that connect are virtual and may get changed over time. All these require that much more  monitoring capabilities need to be brought in by the DBAs to make sure how the databases behave to the demands and how they can be managed.

  • Amazon RDS makes DB Instance metrics available via theAmazon AWS CloudWatch service. You can access your metrics using theAmazon CloudWatch API Toolsor via the API itself.
  • MicrosoftSQL Azure Database enables a subset of dynamic management views to diagnose the performance problems, which might be caused by blocked or long-running queries, resource bottlenecks, poor query plans, and so on.

The above concepts clearly proves that the traditional DBA needs to know new tools and  new concepts behind monitoring a Cloud Database.

5. Data In & Data Out  Between Cloud & Data Centers
For very small organizations, it would almost be impossible for an enterprise to run its entire business on the Cloud. So with the Cloud adoption it will still be a hybrid environment of:

  • Continued usage of ‘On Premise' data center for mission critical applications
  • SaaS usage for certain scenarios
  • PaaS or IaaS usage for other scenarios

In this Hybrid situation, it's important for the DBA to have all the options to move data in and out of the cloud seamlessly in an efficient manner.

With SQL Azure Data Sync CTP2  Microsoft  delivering an update to SQL Azure Data Sync to enable synchronization between on-premises SQL Server and SQL Azure, giving customers greater flexibility in building solutions that span on-premises and the cloud. With SQL Azure Data Sync CTP2, customers can:

  • Extend enterprise data to the cloud rather than replace it
  • Move workloads to the cloud in stages preserving investment in existing infrastructure
  • Extend data to remote offices and retails stores
  • Enable new scenarios spanning enterprise and cloud

Similarly  Amazon RDS has multiple tools based on MYSQL Engine that supports loading data from  data center applications into Cloud.

Summary
Cloud has abstracted certain traditional DBA needs in an enterprise:

  • Installation
  • Backup
  • Recovery
  • Replication
  • Stand By Servers
  • Fail Over Servers

Cloud has indeed brought in new DBA skill requirements and hence the role of DBA is as important as before in a cloud managed environment. However, now the DBAs can concentrate more on the business needs and can support the ‘Do More With Less' slogan that marks the  Cloud Platform usage in enterprises.

More Stories By Srinivasan Sundara Rajan

Highly passionate about utilizing Digital Technologies to enable next generation enterprise. Believes in enterprise transformation through the Natives (Cloud Native & Mobile Native).

@CloudExpo Stories
The session is centered around the tracing of systems on cloud using technologies like ebpf. The goal is to talk about what this technology is all about and what purpose it serves. In his session at 21st Cloud Expo, Shashank Jain, Development Architect at SAP, will touch upon concepts of observability in the cloud and also some of the challenges we have. Generally most cloud-based monitoring tools capture details at a very granular level. To troubleshoot problems this might not be good enough.
The dynamic nature of the cloud means that change is a constant when it comes to modern cloud-based infrastructure. Delivering modern applications to end users, therefore, is a constantly shifting challenge. Delivery automation helps IT Ops teams ensure that apps are providing an optimal end user experience over hybrid-cloud and multi-cloud environments, no matter what the current state of the infrastructure is. To employ a delivery automation strategy that reflects your business rules, making r...
Most technology leaders, contemporary and from the hardware era, are reshaping their businesses to do software. They hope to capture value from emerging technologies such as IoT, SDN, and AI. Ultimately, irrespective of the vertical, it is about deriving value from independent software applications participating in an ecosystem as one comprehensive solution. In his session at @ThingsExpo, Kausik Sridhar, founder and CTO of Pulzze Systems, will discuss how given the magnitude of today's applicati...
Smart cities have the potential to change our lives at so many levels for citizens: less pollution, reduced parking obstacles, better health, education and more energy savings. Real-time data streaming and the Internet of Things (IoT) possess the power to turn this vision into a reality. However, most organizations today are building their data infrastructure to focus solely on addressing immediate business needs vs. a platform capable of quickly adapting emerging technologies to address future ...
Data scientists must access high-performance computing resources across a wide-area network. To achieve cloud-based HPC visualization, researchers must transfer datasets and visualization results efficiently. HPC clusters now compute GPU-accelerated visualization in the cloud cluster. To efficiently display results remotely, a high-performance, low-latency protocol transfers the display from the cluster to a remote desktop. Further, tools to easily mount remote datasets and efficiently transfer...
In a recent survey, Sumo Logic surveyed 1,500 customers who employ cloud services such as Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP). According to the survey, a quarter of the respondents have already deployed Docker containers and nearly as many (23 percent) are employing the AWS Lambda serverless computing framework. It’s clear: serverless is here to stay. The adoption does come with some needed changes, within both application development and operations. Tha...
In his Opening Keynote at 21st Cloud Expo, John Considine, General Manager of IBM Cloud Infrastructure, will lead you through the exciting evolution of the cloud. He'll look at this major disruption from the perspective of technology, business models, and what this means for enterprises of all sizes. John Considine is General Manager of Cloud Infrastructure Services at IBM. In that role he is responsible for leading IBM’s public cloud infrastructure including strategy, development, and offering ...
Companies are harnessing data in ways we once associated with science fiction. Analysts have access to a plethora of visualization and reporting tools, but considering the vast amount of data businesses collect and limitations of CPUs, end users are forced to design their structures and systems with limitations. Until now. As the cloud toolkit to analyze data has evolved, GPUs have stepped in to massively parallel SQL, visualization and machine learning.
We all know that end users experience the Internet primarily with mobile devices. From an app development perspective, we know that successfully responding to the needs of mobile customers depends on rapid DevOps – failing fast, in short, until the right solution evolves in your customers' relationship to your business. Whether you’re decomposing an SOA monolith, or developing a new application cloud natively, it’s not a question of using microservices – not doing so will be a path to eventual b...
Enterprises are adopting Kubernetes to accelerate the development and the delivery of cloud-native applications. However, sharing a Kubernetes cluster between members of the same team can be challenging. And, sharing clusters across multiple teams is even harder. Kubernetes offers several constructs to help implement segmentation and isolation. However, these primitives can be complex to understand and apply. As a result, it’s becoming common for enterprises to end up with several clusters. Thi...
SYS-CON Events announced today that Taica will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. TAZMO technology and development capabilities in the semiconductor and LCD-related manufacturing fields are among the best worldwide. For more information, visit https://www.tazmo.co.jp/en/.
SYS-CON Events announced today that TidalScale will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. TidalScale is the leading provider of Software-Defined Servers that bring flexibility to modern data centers by right-sizing servers on the fly to fit any data set or workload. TidalScale’s award-winning inverse hypervisor technology combines multiple commodity servers (including their ass...
SYS-CON Events announced today that Avere Systems, a leading provider of hybrid cloud enablement solutions, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Avere Systems was created by file systems experts determined to reinvent storage by changing the way enterprises thought about and bought storage resources. With decades of experience behind the company’s founders, Avere got its ...
Microsoft Azure Container Services can be used for container deployment in a variety of ways including support for Orchestrators like Kubernetes, Docker Swarm and Mesos. However, the abstraction for app development that support application self-healing, scaling and so on may not be at the right level. Helm and Draft makes this a lot easier. In this primarily demo-driven session at @DevOpsSummit at 21st Cloud Expo, Raghavan "Rags" Srinivas, a Cloud Solutions Architect/Evangelist at Microsoft, wi...
The next XaaS is CICDaaS. Why? Because CICD saves developers a huge amount of time. CD is an especially great option for projects that require multiple and frequent contributions to be integrated. But… securing CICD best practices is an emerging, essential, yet little understood practice for DevOps teams and their Cloud Service Providers. The only way to get CICD to work in a highly secure environment takes collaboration, patience and persistence. Building CICD in the cloud requires rigorous ar...
Containers are rapidly finding their way into enterprise data centers, but change is difficult. How do enterprises transform their architecture with technologies like containers without losing the reliable components of their current solutions? In his session at @DevOpsSummit at 21st Cloud Expo, Tony Campbell, Director, Educational Services at CoreOS, will explore the challenges organizations are facing today as they move to containers and go over how Kubernetes applications can deploy with lega...
In his session at 21st Cloud Expo, Raju Shreewastava, founder of Big Data Trunk, will provide a fun and simple way to introduce Machine Leaning to anyone and everyone. Together we will solve a machine learning problem and find an easy way to be able to do machine learning without even coding. Raju Shreewastava is the founder of Big Data Trunk (www.BigDataTrunk.com), a Big Data Training and consulting firm with offices in the United States. He previously led the data warehouse/business intellige...
Today most companies are adopting or evaluating container technology - Docker in particular - to speed up application deployment, drive down cost, ease management and make application delivery more flexible overall. As with most new architectures, this dream takes significant work to become a reality. Even when you do get your application componentized enough and packaged properly, there are still challenges for DevOps teams to making the shift to continuous delivery and achieving that reducti...
As hybrid cloud becomes the de-facto standard mode of operation for most enterprises, new challenges arise on how to efficiently and economically share data across environments. In his session at 21st Cloud Expo, Dr. Allon Cohen, VP of Product at Elastifile, will explore new techniques and best practices that help enterprise IT benefit from the advantages of hybrid cloud environments by enabling data availability for both legacy enterprise and cloud-native mission critical applications. By rev...
SYS-CON Events announced today that Ryobi Systems will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Ryobi Systems Co., Ltd., as an information service company, specialized in business support for local governments and medical industry. We are challenging to achive the precision farming with AI. For more information, visit http:...