Click here to close now.

Welcome!

Cloud Expo Authors: Kevin Jackson, Harry Trott, Bart Copeland, Lori MacVittie, Jnan Dash

Related Topics: Big Data Journal, Java, Virtualization, Cloud Expo, SDN Journal

Big Data Journal: Article

What Will It Really Take to Provide an Agile Big Data Infrastructure?

Meet CodeFutures Corporation at Cloud Expo

"An agile approach to data is really a requirement of just about any application, but even more so with Big Data," stated Cory Isaacson, CEO/CTO of CodeFutures Corporation, in this exclusive Q&A with @ThingsExpo conference chair Roger Strukhoff. "What the enterprise needs is a data platform that can adapt to changing requirements in a flexible and rapid manner. This has not been the case with existing databases."

Cloud Computing Journal: With the MapDB announcement, it sounds like to some degree you're bringing the Java Programming Language into the 21st century modern enterprise. To what degree do you agree with that statement?

Cory Isaacson: This is a very good assessment, while Java has always been a capable language there have been many barriers when it comes to delivering full-featured database technology. For example, APIs like JDBC have worked for many years, but fast performance, convenience and tight integration in Java applications with the database were not there. With MapDB Java developers now have the convenience and agility of the native Java Collections API, with the power of a very fast database engine.

Cloud Computing Journal: You emphasize a lightweight, agile approach. To what degree is this simply a requirement of Big Data applications and to what degree do you think agility is required in general for the modern enterprise? Does the real-time (or almost real-time) nature of a lot of Big Data also drive a need for agility?

Isaacson: An agile approach to data is really a requirement of just about any application, but even more so with Big Data. What the enterprise needs is a data platform that can adapt to changing requirements in a flexible and rapid manner. This has not been the case with existing databases. For example, the NoSQL engines move toward this direction, but with a Big Data store it is really tough to gain agility.

Added to this need are the burgeoning real-time data requirements. With a real-time data flow, it is critical to know what is happening now; it is not enough to get results from a typical historical time window (such as days or weeks after something has occurred). The reason an agile approach is so critical is because the results needed from real-time requirements are also likely to change at a rapid pace, more than with traditional enterprise or Big Data applications.

Cloud Computing Journal: What benefits will your customers and your product receive from the open-source approach?

Isaacson: MapDB is freely available under the Apache 2.0 license, this allows customers (or anyone) to use the product as they see fit. Because it is open source also means that we receive major feedback from users, enabling extremely fast support and stability in the product. We often hear in days or hours if there is an issue with a pre-release version, then it can be addressed before it makes its way into a final release. The support of the community is vital.

Cloud Computing Journal: You mention support of databases up to 100GB in size - are there "typical" databases of this size that you encounter? In other words, what sorts of applications and initiatives are driving databases of this size?

Isaacson: We have seen users of MapDB use it for everything from pure in-memory to large disk-based databases. So I would not say there is a "typical" size, but the good news is that a developer can comfortably scale their database as needed, from small to very large without needing to be concerned with the details.

Cloud Computing Journal: What sort of increased interest in Big Data have you seen over the past year or so, and what sort of questions do you anticipate from customers at Cloud Expo?

Isaacson: The interest in Big Data is explosive right now, especially given the new real-time element, and new data generators such as the Internet of Things.

Virtually every customer we are working with has some sort of Big Data initiative or requirement; it is becoming tightly integrated into business strategies and planning. Big Data will be a vital commodity in the economy from here on out and it will affect almost every business from large to small.

The types of questions we anticipate at Cloud Expo are:

  • What will it really take to provide an agile Big Data infrastructure?
  • How can real-time data flows be leveraged for real-time strategic advantage?
  • What capabilities will enable application developers to respond faster to business requirements, without the restrictive nature of current database technologies? In other words, how can we make the job for developers easier, while enabling far more powerful Big Data access?

In addition to all of these questions, we expect to get quite a few regarding our upcoming technology releases - we'll have many things to discuss with technologists and managers while at the event.

More Stories By Elizabeth White

News Desk compiles and publishes breaking news stories, press releases and latest news articles as they happen.

Comments (1)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
SYS-CON Events announced today that CodeFutures, a leading supplier of database performance tools, has been named a “Sponsor” of SYS-CON's 16th International Cloud Expo®, which will take place on June 9–11, 2015, at the Javits Center in New York, NY. CodeFutures is an independent software vendor focused on providing tools that deliver database performance tools that increase productivity during database development and increase database performance and scalability during production.
The IoT market is projected to be $1.9 trillion tidal wave that’s bigger than the combined market for smartphones, tablets and PCs. While IoT is widely discussed, what not being talked about are the monetization opportunities that are created from ubiquitous connectivity and the ensuing avalanche of data. While we cannot foresee every service that the IoT will enable, we should future-proof operations by preparing to monetize them with extremely agile systems.
There’s Big Data, then there’s really Big Data from the Internet of Things. IoT is evolving to include many data possibilities like new types of event, log and network data. The volumes are enormous, generating tens of billions of logs per day, which raise data challenges. Early IoT deployments are relying heavily on both the cloud and managed service providers to navigate these challenges. Learn about IoT, Big Data and deployments processing massive data volumes from wearables, utilities and ot...
Even as cloud and managed services grow increasingly central to business strategy and performance, challenges remain. The biggest sticking point for companies seeking to capitalize on the cloud is data security. Keeping data safe is an issue in any computing environment, and it has been a focus since the earliest days of the cloud revolution. Understandably so: a lot can go wrong when you allow valuable information to live outside the firewall. Recent revelations about government snooping, along...
In his session at DevOps Summit, Tapabrata Pal, Director of Enterprise Architecture at Capital One, will tell a story about how Capital One has embraced Agile and DevOps Security practices across the Enterprise – driven by Enterprise Architecture; bringing in Development, Operations and Information Security organizations together. Capital Ones DevOpsSec practice is based upon three "pillars" – Shift-Left, Automate Everything, Dashboard Everything. Within about three years, from 100% waterfall, C...
RingCentral Inc., has unveiled the RingCentral Connect Platform™, a set of tools and services to build, deploy, and manage custom integrations using RingCentral APIs. With this platform, developers can build out-of-the-box integrations with RingCentral to add powerful communication capabilities to business applications. "This is a significant step forward because businesses want to better connect with customers – and communications is at the heart of every customer interaction," said Vlad Shm...
SYS-CON Media announced that IBM, which offers the world’s deepest portfolio of technologies and expertise that are transforming the future of work, has launched ad campaigns on SYS-CON’s numerous online magazines such as Cloud Computing Journal, Virtualization Journal, SOA World Magazine, and IoT Journal. IBM’s campaigns focus on vendors in the technology marketplace, the future of testing, Big Data and analytics, and mobile platforms.
There has been a lot of discussion recently in the DevOps space over whether there is a unique form of DevOps for large enterprises or is it just vendors looking to sell services and tools. In his session at DevOps Summit, Chris Riley, a technologist, discussed whether Enterprise DevOps is a unique species or not. What makes DevOps adoption in the enterprise unique or what doesn’t? Unique or not, what does this mean for adopting DevOps in enterprise size organizations? He also explored differe...
“In the past year we've seen a lot of stabilization of WebRTC. You can now use it in production with a far greater degree of certainty. A lot of the real developments in the past year have been in things like the data channel, which will enable a whole new type of application," explained Peter Dunkley, Technical Director at Acision, in this SYS-CON.tv interview at @ThingsExpo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
NaviSite, Inc., a Time Warner Cable company, has opened a new enterprise-class data center located in Santa Clara, California. The new data center will enable NaviSite to meet growing demands for its enterprise-class Cloud and Managed Services from existing and new customers. This facility, which is owned by data center solution provider Digital Realty, will join NaviSite’s fabric of nine existing data centers across the U.S. and U.K., all of which are designed to provide a resilient, secure, hi...
SYS-CON Events announced today that Intelligent Systems Services will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Established in 1994, Intelligent Systems Services Inc. is located near Washington, DC, with representatives and partners nationwide. ISS’s well-established track record is based on the continuous pursuit of excellence in designing, implementing and supporting nationwide clients’ mission-cri...
PubNub on Monday has announced that it is partnering with IBM to bring its sophisticated real-time data streaming and messaging capabilities to Bluemix, IBM’s cloud development platform. “Today’s app and connected devices require an always-on connection, but building a secure, scalable solution from the ground up is time consuming, resource intensive, and error-prone,” said Todd Greene, CEO of PubNub. “PubNub enables web, mobile and IoT developers building apps on IBM Bluemix to quickly add sc...
The major cloud platforms defy a simple, side-by-side analysis. Each of the major IaaS public-cloud platforms offers their own unique strengths and functionality. Options for on-site private cloud are diverse as well, and must be designed and deployed while taking existing legacy architecture and infrastructure into account. Then the reality is that most enterprises are embarking on a hybrid cloud strategy and programs. In this Power Panel at 15th Cloud Expo (http://www.CloudComputingExpo.com...
Data-intensive companies that strive to gain insights from data using Big Data analytics tools can gain tremendous competitive advantage by deploying data-centric storage. Organizations generate large volumes of data, the vast majority of which is unstructured. As the volume and velocity of this unstructured data increases, the costs, risks and usability challenges associated with managing the unstructured data (regardless of file type, size or device) increases simultaneously, including end-to-...
The truth is, today’s databases are anything but agile – they are effectively static repositories that are cumbersome to work with, difficult to change, and cannot keep pace with application demands. Performance suffers as a result, and it takes far longer than it should to deliver new features and capabilities needed to make your organization competitive. As your application and business needs change, data repositories and structures get outmoded rapidly, resulting in increased work for applica...
The excitement around the possibilities enabled by Big Data is being tempered by the daunting task of feeding the analytics engines with high quality data on a continuous basis. As the once distinct fields of data integration and data management increasingly converge, cloud-based data solutions providers have emerged that can buffer your organization from the complexities of this continuous data cleansing and management so that you’re free to focus on the end goal: actionable insight.
DevOps tends to focus on the relationship between Dev and Ops, putting an emphasis on the ops and application infrastructure. But that’s changing with microservices architectures. In her session at DevOps Summit, Lori MacVittie, Evangelist for F5 Networks, will focus on how microservices are changing the underlying architectures needed to scale, secure and deliver applications based on highly distributed (micro) services and why that means an expansion into “the network” for DevOps.
There is no doubt that Big Data is here and getting bigger every day. Building a Big Data infrastructure today is no easy task. There are an enormous number of choices for database engines and technologies. To make things even more challenging, requirements are getting more sophisticated, and the standard paradigm of supporting historical analytics queries is often just one facet of what is needed. As Big Data growth continues, organizations are demanding real-time access to data, allowing immed...
With several hundred implementations of IoT-enabled solutions in the past 12 months alone, this session will focus on experience over the art of the possible. Many can only imagine the most advanced telematics platform ever deployed, supporting millions of customers, producing tens of thousands events or GBs per trip, and hundreds of TBs per month. With the ability to support a billion sensor events per second, over 30PB of warm data for analytics, and hundreds of PBs for an data analytics arc...
Between the compelling mockups and specs produced by your analysts and designers, and the resulting application built by your developers, there is a gulf where projects fail, costs spiral out of control, and applications fall short of requirements. In his session at DevOps Summit, Charles Kendrick, CTO and Chief Architect at Isomorphic Software, will present a new approach where business and development users collaborate – each using tools appropriate to their goals and expertise – to build mo...