Welcome!

@CloudExpo Authors: Liz McMillan, Elizabeth White, Don MacVittie, Mehdi Daoudi, Shelly Palmer

Related Topics: @CloudExpo, Java IoT, Microservices Expo, Linux Containers, @DXWorldExpo, SDN Journal

@CloudExpo: Article

How Data Integration Is Changing the Enterprise Landscape

Cloud integration is now more important than ever to tackle increasingly complex integration challenges

Two words that are continually brought up in conversations at company meetings are "integration" and "cloud." According to leading analyst firm Gartner, by 2016 the growth of cloud computing will increase to become the bulk of new IT spend. The relative cost of cloud services as compared to handling integration in-house has historically hindered executives' decisions to implement cloud services and brokers. However, the undeniable benefits to cloud-based integration have now come to the forefront of consideration for C-level decision makers looking to relieve their companies of compliance challenges and security risks, while increasing the speed of data being transferred and analyzed. Putting the two words together, cloud integration is now more important than ever to tackle increasingly complex integration challenges.

As such, 2014 will be a disruptive year for integration providers, cloud services, Big Data and C-level executives looking to take full advantage of what data integration has to offer. Below are three trends companies can expect to see and incorporate into their businesses in the next year:

The Marriage of A2A and B2B Integration
By the end of this year, it is very possible the only people still separating Business-to-Business (B2B) and Application-to-Application (A2A) integration will be software vendors. Integration has historically been separated into the two distinct solutions of B2B and A2A, but as the year continues, we will see these two solution groups merge into one category, known simply as integration. No longer viewed as siloed entities, enterprises will be better able to manage and share information both internally and externally. Heavily influencing this holistic convergence is cloud-based integration. Additionally, the growth of cloud-based integration will continue to act as a fusing structure for evolving integration.

The Bifurcation of the Integration Market
Fueled by the increasing complexity of integration where "data-centric" computing has overtaken "application-centric" architectures, the integration market will bifurcate into two categories: "use case specific" and "use case independent" solutions, the latter of which will focus on the integration technology itself. With the demand for cloud services sold through brokerages expected to reach 20 percent, CSBs are becoming the go-to data-centric strategy for companies looking for an application-agnostic approach spanning across various providers to handle complex integration requirements associated with the growing classes of data generated.

For integration cloud brokers who optimize their offerings for specific "use cases," they will typically work within industries with repetitive implementations and low variation between customers. This model drives the complexity to the end points or the cloud applications. In these cases, providers advocate for common data models or "industry canonicals" with "connect once" marketing messages that entice customers with a simple integration story. However, integration complexity can pose some significant challenges in this market as providers try to address varying integration scenarios with over-simplified solutions.

Looking to the future, the more valuable and sustainable approach will focus on integration providers that embrace variations among customers, developing a core competency to deliver tailored solutions that fit each unique use case. This solution will necessarily yield lower margins, but will ultimately prevent customers from feeling forced to settle for less. This model is a foundational principle of mass customization applied to cloud integration services.

In the end, the two newly created markets will boil down to simple and complex frameworks. As Albert Einstein said it best, "things should be made as simple as possible but not simpler." It's important for both customers and providers to recognize that mass customization offerings, as would be proposed in the second market, are neither a technology nor sales technique, but rather a shift in organizational discipline, which may be difficult for many companies to handle.

Emergence of the Chief Data Officer
In recent years, it seems like a new C-level title is created and en vogue to capitalize on just about every emerging business trend. Some of these positions have more staying power than others. One position, in particular, that will continue to gain legitimacy is the CDO - the chief data officer. Over the past year, companies have become more aware of how data is being analyzed and communicated within their business as well as with partners and customers. Additionally, they have begun to embrace the evolution of data integration and data management to govern new analytics including applications, reporting, planning and social media. This growing emphasis on data management will be the catalyst that propels the CDO from early adopter status to mainstream C-level executive.

In essence, the CDO is the evolution of what most people know as the chief information officer. As with any executive position, the CDO will be faced with various challenges, including the increased complexity of data integration. The CDO's role will expand on the historically internal focus of integration to include external data integration. With 85 percent of respondents to IDC's recent study reporting that IT has become a more valuable partner to their businesses than it was three years ago, today's enterprise has more technology that needs to be integrated within the business. Additionally, the rise of cloud services, cloud application and mobile devices within a company is opening the door for more data, but leaving IT teams with more to manage and integrate.

The increasing presence of CSBs and cloud applications across businesses of all sizes and types is another area of focus that will be guided by the vision of the CDO. With expectations like analyst firm IDC's prediction of $100 billion to be spent on cloud and cloud services alone in 2014, CDOs will need to oversee both external customer and internal cloud implementations, solutions and services. Within this cloud framework, CDOs will be responsible for evaluating, designing and implementing cloud security that is compatible with compliance and integration efforts. As mentioned earlier, with the trend of working with CSBs on the rise, the need for more requirements, security and management will be necessary more than ever.

Last, according to IDC, the global Big Data technology and services market is expected to grow at a 31.7 percent compound annual growth rate. By 2016, it will reach $23.8 billion. With Big Data integration projects on the rise, companies will take advantage of opportunities to build out specific Big Data focused teams to complement solutions and address increasingly complex Big Data challenges. Leading these teams as well as overseeing internal Big Data issues and management, CDOs will be able to support their company as well as customers.

In the end, 2014 will be a dynamically shifting year for IT and the business leadership structure. With increased investments in cloud and cloud services, enterprises will be forced to take a serious look at data integration and management in the cloud to leverage the most effective solution that meets the needs and demands of each specific use case. To create and support this growing demand, the emergence of the chief data officer will be viewed as a necessary component to help champion these changes and provide the vision companies need to succeed. Ultimately, CDOs will be among the prominent new generation of leaders and change-makers who will aid in the growth and prosperity of current and prospective businesses.

More Stories By Bob Renner

Bob Renner is the President and CEO of Liaison Technologies. He has been in this role since 2002 and has successfully executed nine corporate acquisitions in the US and Europe. He acted as Liaison’s Chief Technology Officer in the company’s startup phase from 2000 – 2002.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
Enterprises are adopting Kubernetes to accelerate the development and the delivery of cloud-native applications. However, sharing a Kubernetes cluster between members of the same team can be challenging. And, sharing clusters across multiple teams is even harder. Kubernetes offers several constructs to help implement segmentation and isolation. However, these primitives can be complex to understand and apply. As a result, it’s becoming common for enterprises to end up with several clusters. Thi...
"Infoblox does DNS, DHCP and IP address management for not only enterprise networks but cloud networks as well. Customers are looking for a single platform that can extend not only in their private enterprise environment but private cloud, public cloud, tracking all the IP space and everything that is going on in that environment," explained Steve Salo, Principal Systems Engineer at Infoblox, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventio...
"Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
The question before companies today is not whether to become intelligent, it’s a question of how and how fast. The key is to adopt and deploy an intelligent application strategy while simultaneously preparing to scale that intelligence. In her session at 21st Cloud Expo, Sangeeta Chakraborty, Chief Customer Officer at Ayasdi, provided a tactical framework to become a truly intelligent enterprise, including how to identify the right applications for AI, how to build a Center of Excellence to oper...
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
In his session at 21st Cloud Expo, James Henry, Co-CEO/CTO of Calgary Scientific Inc., introduced you to the challenges, solutions and benefits of training AI systems to solve visual problems with an emphasis on improving AIs with continuous training in the field. He explored applications in several industries and discussed technologies that allow the deployment of advanced visualization solutions to the cloud.
Agile has finally jumped the technology shark, expanding outside the software world. Enterprises are now increasingly adopting Agile practices across their organizations in order to successfully navigate the disruptive waters that threaten to drown them. In our quest for establishing change as a core competency in our organizations, this business-centric notion of Agile is an essential component of Agile Digital Transformation. In the years since the publication of the Agile Manifesto, the conn...
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Large industrial manufacturing organizations are adopting the agile principles of cloud software companies. The industrial manufacturing development process has not scaled over time. Now that design CAD teams are geographically distributed, centralizing their work is key. With large multi-gigabyte projects, outdated tools have stifled industrial team agility, time-to-market milestones, and impacted P&L stakeholders.
"ZeroStack is a startup in Silicon Valley. We're solving a very interesting problem around bringing public cloud convenience with private cloud control for enterprises and mid-size companies," explained Kamesh Pemmaraju, VP of Product Management at ZeroStack, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Codigm is based on the cloud and we are here to explore marketing opportunities in America. Our mission is to make an ecosystem of the SW environment that anyone can understand, learn, teach, and develop the SW on the cloud," explained Sung Tae Ryu, CEO of Codigm, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
High-velocity engineering teams are applying not only continuous delivery processes, but also lessons in experimentation from established leaders like Amazon, Netflix, and Facebook. These companies have made experimentation a foundation for their release processes, allowing them to try out major feature releases and redesigns within smaller groups before making them broadly available. In his session at 21st Cloud Expo, Brian Lucas, Senior Staff Engineer at Optimizely, discussed how by using ne...
Vulnerability management is vital for large companies that need to secure containers across thousands of hosts, but many struggle to understand how exposed they are when they discover a new high security vulnerability. In his session at 21st Cloud Expo, John Morello, CTO of Twistlock, addressed this pressing concern by introducing the concept of the “Vulnerability Risk Tree API,” which brings all the data together in a simple REST endpoint, allowing companies to easily grasp the severity of the ...
While some developers care passionately about how data centers and clouds are architected, for most, it is only the end result that matters. To the majority of companies, technology exists to solve a business problem, and only delivers value when it is solving that problem. 2017 brings the mainstream adoption of containers for production workloads. In his session at 21st Cloud Expo, Ben McCormack, VP of Operations at Evernote, discussed how data centers of the future will be managed, how the p...
"NetApp is known as a data management leader but we do a lot more than just data management on-prem with the data centers of our customers. We're also big in the hybrid cloud," explained Wes Talbert, Principal Architect at NetApp, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
"We're focused on how to get some of the attributes that you would expect from an Amazon, Azure, Google, and doing that on-prem. We believe today that you can actually get those types of things done with certain architectures available in the market today," explained Steve Conner, VP of Sales at Cloudistics, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.