Welcome!

@CloudExpo Authors: Jason Bloomberg, Elizabeth White, Roger Strukhoff, Liz McMillan, Pat Romanski

Related Topics: @BigDataExpo, Java IoT, Containers Expo Blog, @CloudExpo, SDN Journal

@BigDataExpo: Article

What Will It Really Take to Provide an Agile Big Data Infrastructure?

Meet CodeFutures Corporation at Cloud Expo

"An agile approach to data is really a requirement of just about any application, but even more so with Big Data," stated Cory Isaacson, CEO/CTO of CodeFutures Corporation, in this exclusive Q&A with @ThingsExpo conference chair Roger Strukhoff. "What the enterprise needs is a data platform that can adapt to changing requirements in a flexible and rapid manner. This has not been the case with existing databases."

Cloud Computing Journal: With the MapDB announcement, it sounds like to some degree you're bringing the Java Programming Language into the 21st century modern enterprise. To what degree do you agree with that statement?

Cory Isaacson: This is a very good assessment, while Java has always been a capable language there have been many barriers when it comes to delivering full-featured database technology. For example, APIs like JDBC have worked for many years, but fast performance, convenience and tight integration in Java applications with the database were not there. With MapDB Java developers now have the convenience and agility of the native Java Collections API, with the power of a very fast database engine.

Cloud Computing Journal: You emphasize a lightweight, agile approach. To what degree is this simply a requirement of Big Data applications and to what degree do you think agility is required in general for the modern enterprise? Does the real-time (or almost real-time) nature of a lot of Big Data also drive a need for agility?

Isaacson: An agile approach to data is really a requirement of just about any application, but even more so with Big Data. What the enterprise needs is a data platform that can adapt to changing requirements in a flexible and rapid manner. This has not been the case with existing databases. For example, the NoSQL engines move toward this direction, but with a Big Data store it is really tough to gain agility.

Added to this need are the burgeoning real-time data requirements. With a real-time data flow, it is critical to know what is happening now; it is not enough to get results from a typical historical time window (such as days or weeks after something has occurred). The reason an agile approach is so critical is because the results needed from real-time requirements are also likely to change at a rapid pace, more than with traditional enterprise or Big Data applications.

Cloud Computing Journal: What benefits will your customers and your product receive from the open-source approach?

Isaacson: MapDB is freely available under the Apache 2.0 license, this allows customers (or anyone) to use the product as they see fit. Because it is open source also means that we receive major feedback from users, enabling extremely fast support and stability in the product. We often hear in days or hours if there is an issue with a pre-release version, then it can be addressed before it makes its way into a final release. The support of the community is vital.

Cloud Computing Journal: You mention support of databases up to 100GB in size - are there "typical" databases of this size that you encounter? In other words, what sorts of applications and initiatives are driving databases of this size?

Isaacson: We have seen users of MapDB use it for everything from pure in-memory to large disk-based databases. So I would not say there is a "typical" size, but the good news is that a developer can comfortably scale their database as needed, from small to very large without needing to be concerned with the details.

Cloud Computing Journal: What sort of increased interest in Big Data have you seen over the past year or so, and what sort of questions do you anticipate from customers at Cloud Expo?

Isaacson: The interest in Big Data is explosive right now, especially given the new real-time element, and new data generators such as the Internet of Things.

Virtually every customer we are working with has some sort of Big Data initiative or requirement; it is becoming tightly integrated into business strategies and planning. Big Data will be a vital commodity in the economy from here on out and it will affect almost every business from large to small.

The types of questions we anticipate at Cloud Expo are:

  • What will it really take to provide an agile Big Data infrastructure?
  • How can real-time data flows be leveraged for real-time strategic advantage?
  • What capabilities will enable application developers to respond faster to business requirements, without the restrictive nature of current database technologies? In other words, how can we make the job for developers easier, while enabling far more powerful Big Data access?

In addition to all of these questions, we expect to get quite a few regarding our upcoming technology releases - we'll have many things to discuss with technologists and managers while at the event.

More Stories By Elizabeth White

News Desk compiles and publishes breaking news stories, press releases and latest news articles as they happen.

Comments (1)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
Internet-of-Things discussions can end up either going down the consumer gadget rabbit hole or focused on the sort of data logging that industrial manufacturers have been doing forever. However, in fact, companies today are already using IoT data both to optimize their operational technology and to improve the experience of customer interactions in novel ways. In his session at @ThingsExpo, Gordon Haff, Red Hat Technology Evangelist, will share examples from a wide range of industries – includin...
Organizations planning enterprise data center consolidation and modernization projects are faced with a challenging, costly reality. Requirements to deploy modern, cloud-native applications simultaneously with traditional client/server applications are almost impossible to achieve with hardware-centric enterprise infrastructure. Compute and network infrastructure are fast moving down a software-defined path, but storage has been a laggard. Until now.
We're entering the post-smartphone era, where wearable gadgets from watches and fitness bands to glasses and health aids will power the next technological revolution. With mass adoption of wearable devices comes a new data ecosystem that must be protected. Wearables open new pathways that facilitate the tracking, sharing and storing of consumers’ personal health, location and daily activity data. Consumers have some idea of the data these devices capture, but most don’t realize how revealing and...
Unless your company can spend a lot of money on new technology, re-engineering your environment and hiring a comprehensive cybersecurity team, you will most likely move to the cloud or seek external service partnerships. In his session at 18th Cloud Expo, Darren Guccione, CEO of Keeper Security, revealed what you need to know when it comes to encryption in the cloud.
"We build IoT infrastructure products - when you have to integrate different devices, different systems and cloud you have to build an application to do that but we eliminate the need to build an application. Our products can integrate any device, any system, any cloud regardless of protocol," explained Peter Jung, Chief Product Officer at Pulzze Systems, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
"We are an all-flash array storage provider but our focus has been on VM-aware storage specifically for virtualized applications," stated Dhiraj Sehgal of Tintri in this SYS-CON.tv interview at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
It's easy to assume that your app will run on a fast and reliable network. The reality for your app's users, though, is often a slow, unreliable network with spotty coverage. What happens when the network doesn't work, or when the device is in airplane mode? You get unhappy, frustrated users. An offline-first app is an app that works, without error, when there is no network connection. In his session at 18th Cloud Expo, Bradley Holt, a Developer Advocate with IBM Cloud Data Services, discussed...
Data is the fuel that drives the machine learning algorithmic engines and ultimately provides the business value. In his session at 20th Cloud Expo, Ed Featherston, director/senior enterprise architect at Collaborative Consulting, will discuss the key considerations around quality, volume, timeliness, and pedigree that must be dealt with in order to properly fuel that engine.
Between 2005 and 2020, data volumes will grow by a factor of 300 – enough data to stack CDs from the earth to the moon 162 times. This has come to be known as the ‘big data’ phenomenon. Unfortunately, traditional approaches to handling, storing and analyzing data aren’t adequate at this scale: they’re too costly, slow and physically cumbersome to keep up. Fortunately, in response a new breed of technology has emerged that is cheaper, faster and more scalable. Yet, in meeting these new needs they...
In addition to all the benefits, IoT is also bringing new kind of customer experience challenges - cars that unlock themselves, thermostats turning houses into saunas and baby video monitors broadcasting over the internet. This list can only increase because while IoT services should be intuitive and simple to use, the delivery ecosystem is a myriad of potential problems as IoT explodes complexity. So finding a performance issue is like finding the proverbial needle in the haystack.
When it comes to cloud computing, the ability to turn massive amounts of compute cores on and off on demand sounds attractive to IT staff, who need to manage peaks and valleys in user activity. With cloud bursting, the majority of the data can stay on premises while tapping into compute from public cloud providers, reducing risk and minimizing need to move large files. In his session at 18th Cloud Expo, Scott Jeschonek, Director of Product Management at Avere Systems, discussed the IT and busin...
According to Forrester Research, every business will become either a digital predator or digital prey by 2020. To avoid demise, organizations must rapidly create new sources of value in their end-to-end customer experiences. True digital predators also must break down information and process silos and extend digital transformation initiatives to empower employees with the digital resources needed to win, serve, and retain customers.
"We are the public cloud providers. We are currently providing 50% of the resources they need for doing e-commerce business in China and we are hosting about 60% of mobile gaming in China," explained Yi Zheng, CPO and VP of Engineering at CDS Global Cloud, in this SYS-CON.tv interview at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
"Once customers get a year into their IoT deployments, they start to realize that they may have been shortsighted in the ways they built out their deployment and the key thing I see a lot of people looking at is - how can I take equipment data, pull it back in an IoT solution and show it in a dashboard," stated Dave McCarthy, Director of Products at Bsquare Corporation, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
@DevOpsSummit taking place June 6-8, 2017 at Javits Center, New York City, is co-located with the 20th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. @DevOpsSummit at Cloud Expo New York Call for Papers is now open.
Predictive analytics tools monitor, report, and troubleshoot in order to make proactive decisions about the health, performance, and utilization of storage. Most enterprises combine cloud and on-premise storage, resulting in blended environments of physical, virtual, cloud, and other platforms, which justifies more sophisticated storage analytics. In his session at 18th Cloud Expo, Peter McCallum, Vice President of Datacenter Solutions at FalconStor, discussed using predictive analytics to mon...
Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like “How is my application doing” but no id...
@GonzalezCarmen has been ranked the Number One Influencer and @ThingsExpo has been named the Number One Brand in the “M2M 2016: Top 100 Influencers and Brands” by Onalytica. Onalytica analyzed tweets over the last 6 months mentioning the keywords M2M OR “Machine to Machine.” They then identified the top 100 most influential brands and individuals leading the discussion on Twitter.
As data explodes in quantity, importance and from new sources, the need for managing and protecting data residing across physical, virtual, and cloud environments grow with it. Managing data includes protecting it, indexing and classifying it for true, long-term management, compliance and E-Discovery. Commvault can ensure this with a single pane of glass solution – whether in a private cloud, a Service Provider delivered public cloud or a hybrid cloud environment – across the heterogeneous enter...
In IT, we sometimes coin terms for things before we know exactly what they are and how they’ll be used. The resulting terms may capture a common set of aspirations and goals – as “cloud” did broadly for on-demand, self-service, and flexible computing. But such a term can also lump together diverse and even competing practices, technologies, and priorities to the point where important distinctions are glossed over and lost.