|By Roger Strukhoff||
|December 5, 2011 05:15 AM EST||
Hadoop and NoSQL are entering more conversations about enterprise IT and Cloud Computing. Mongo is now more than a guy who "like candy" and is "only pawn in game of life." The usual brilliant explosion of innovation is ongoing in this space, which is both a sympton and a driver of the new era of Big Data.
Facebook reports it now handles 30 petabytes of data (or 30 million gigabytes). Other numbers of that magnitude are appearing all over the place, along with estimates of daily data flows that seem to increase by a magnitude every few years.
All this should be good for manufacturers of chips, storage, and networks, even as the general principle of Moore's Law relentlessly drives per-unit prices down. It should be good for software developers as well, as multiple newish skills come to the fore.
The parent company of Cloud Computing Journal has announced it will be co-locating the First International Big Data Expo to Cloud Expo New York June 11-14. The announcement came before the doors even opened at the recent Cloud Expo in Silicon Valley, as the company's far-seeing chairman took in key input from his sponsors and advisors.
Big Data and Cloud Computing share some part of each other's circle in a Boolean diagram - specifically how much is not important, although Captain Obvious tells me that Cloud Computing is more important to Big Data than Big Data is to Cloud Computing.
In The Year -1 BCE...
Enterprise IT is really somewhere around Year Zero or Year One with Cloud Computing, even as all vendors are offering Cloud-something by now. We are thus at Year Minus-2 or thereabouts with the new conception of Big Data.
The coming year promises to be a boon for the private cloud, as companies seek to virtualize and optimize, track usage more effectively, and integrate proliferating mobile devices into the mix.
Meanwhile, simultaneously, those pesky mobile thingys - smartphones and tablets - are helping to create the modern-day Big Data monster. Yet they are not the real culprit per se. Rather, let's point our fingers at online transactions/interactions, point-of-purchase scans, and especially, all the fascistic monitoring software embedded in our browsers and phones.
The key differentiator is that cloud is something you do, but Big Data is something you have. The smartest technology companies such as Google, Amazon, and Facebook understood the implications of mass scaling from the get-go, and have had rare glitches in serving continuously expanding mass data to the masses. Walmart has also kept on top of things as the Big Data generated by about 1 million transactions per hour has evolved.
But what about everybody else? How prepared are most of the Fortune 1500 and the millions of SMBs for the Big Data that's flowing into their IT departments? Add social networking to the mix - the need to address, respond, and cultivate online communities who are blasting their informed and uninformed opinions your way every second - and Big Data emerges as a Big Problem. Or is that Big Opportunity?
Follow me on Twitter
SYS-CON Events announced today that GENBAND, a leading developer of real time communications software solutions, has been named “Silver Sponsor” of SYS-CON's WebRTC Summit, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. The GENBAND team will be on hand to demonstrate their newest product, Kandy. Kandy is a communications Platform-as-a-Service (PaaS) that enables companies to seamlessly integrate more human communications into their Web and mobile applicatio...
Feb. 28, 2015 05:00 PM EST Reads: 1,357
VictorOps is making on-call suck less with the only collaborative alert management platform on the market. With easy on-call scheduling management, a real-time incident timeline that gives you contextual relevance around your alerts and powerful reporting features that make post-mortems more effective, VictorOps helps your IT/DevOps team solve problems faster.
Feb. 28, 2015 05:00 PM EST Reads: 1,158
Skeuomorphism usually means retaining existing design cues in something new that doesn’t actually need them. However, the concept of skeuomorphism can be thought of as relating more broadly to applying existing patterns to new technologies that, in fact, cry out for new approaches. In his session at DevOps Summit, Gordon Haff, Senior Cloud Strategy Marketing and Evangelism Manager at Red Hat, will discuss why containers should be paired with new architectural practices such as microservices ra...
Feb. 28, 2015 04:00 PM EST Reads: 1,381
Roberto Medrano, Executive Vice President at SOA Software, had reached 30,000 page views on his home page - http://RobertoMedrano.SYS-CON.com/ - on the SYS-CON family of online magazines, which includes Cloud Computing Journal, Internet of Things Journal, Big Data Journal, and SOA World Magazine. He is a recognized executive in the information technology fields of SOA, internet security, governance, and compliance. He has extensive experience with both start-ups and large companies, having been ...
Feb. 28, 2015 04:00 PM EST Reads: 1,107
Companies today struggle to manage the types and volume of data their customers and employees generate and use every day. With billions of requests daily, operational consistency can be elusive. In his session at Big Data Expo, Dave McCrory, CTO at Basho Technologies, will explore how a distributed systems solution, such as NoSQL, can give organizations the consistency and availability necessary to succeed with on-demand data, offering high availability at massive scale.
Feb. 28, 2015 03:45 PM EST Reads: 2,209
From telemedicine to smart cars, digital homes and industrial monitoring, the explosive growth of IoT has created exciting new business opportunities for real time calls and messaging. In his session at @ThingsExpo, Ivelin Ivanov, CEO and Co-Founder of Telestax, shared some of the new revenue sources that IoT created for Restcomm – the open source telephony platform from Telestax. Ivelin Ivanov is a technology entrepreneur who founded Mobicents, an Open Source VoIP Platform, to help create, de...
Feb. 28, 2015 03:30 PM EST Reads: 3,984
The industrial software market has treated data with the mentality of “collect everything now, worry about how to use it later.” We now find ourselves buried in data, with the pervasive connectivity of the (Industrial) Internet of Things only piling on more numbers. There’s too much data and not enough information. In his session at @ThingsExpo, Bob Gates, Global Marketing Director, GE’s Intelligent Platforms business, to discuss how realizing the power of IoT, software developers are now focu...
Feb. 28, 2015 03:15 PM EST Reads: 1,248
Security can create serious friction for DevOps processes. We've come up with an approach to alleviate the friction and provide security value to DevOps teams. In her session at DevOps Summit, Shannon Lietz, Senior Manager of DevSecOps at Intuit, will discuss how DevSecOps got started and how it has evolved. Shannon Lietz has over two decades of experience pursuing next generation security solutions. She is currently the DevSecOps Leader for Intuit where she is responsible for setting and driv...
Feb. 28, 2015 03:00 PM EST Reads: 2,162
Operational Hadoop and the Lambda Architecture for Streaming Data Apache Hadoop is emerging as a distributed platform for handling large and fast incoming streams of data. Predictive maintenance, supply chain optimization, and Internet-of-Things analysis are examples where Hadoop provides the scalable storage, processing, and analytics platform to gain meaningful insights from granular data that is typically only valuable from a large-scale, aggregate view. One architecture useful for capturing...
Feb. 28, 2015 02:00 PM EST Reads: 1,221
SYS-CON Events announced today that Vitria Technology, Inc. will exhibit at SYS-CON’s @ThingsExpo, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Vitria will showcase the company’s new IoT Analytics Platform through live demonstrations at booth #330. Vitria’s IoT Analytics Platform, fully integrated and powered by an operational intelligence engine, enables customers to rapidly build and operationalize advanced analytics to deliver timely business outcomes ...
Feb. 28, 2015 01:45 PM EST Reads: 1,152
Thanks to Docker, it becomes very easy to leverage containers to build, ship, and run any Linux application on any kind of infrastructure. Docker is particularly helpful for microservice architectures because their successful implementation relies on a fast, efficient deployment mechanism – which is precisely one of the features of Docker. Microservice architectures are therefore becoming more popular, and are increasingly seen as an interesting option even for smaller projects, instead of bein...
Feb. 28, 2015 01:15 PM EST Reads: 2,402
DevOps is about increasing efficiency, but nothing is more inefficient than building the same application twice. However, this is a routine occurrence with enterprise applications that need both a rich desktop web interface and strong mobile support. With recent technological advances from Isomorphic Software and others, it is now feasible to create a rich desktop and tuned mobile experience with a single codebase, without compromising performance or usability.
Feb. 28, 2015 01:15 PM EST Reads: 1,032
SYS-CON Events announced today Arista Networks will exhibit at SYS-CON's DevOps Summit 2015 New York, which will take place June 9-11, 2015, at the Javits Center in New York City, NY. Arista Networks was founded to deliver software-driven cloud networking solutions for large data center and computing environments. Arista’s award-winning 10/40/100GbE switches redefine scalability, robustness, and price-performance, with over 3,000 customers and more than three million cloud networking ports depl...
Feb. 28, 2015 01:00 PM EST Reads: 1,498
The speed of software changes in growing and large scale rapid-paced DevOps environments presents a challenge for continuous testing. Many organizations struggle to get this right. Practices that work for small scale continuous testing may not be sufficient as the requirements grow. In his session at DevOps Summit, Marc Hornbeek, Sr. Solutions Architect of DevOps continuous test solutions at Spirent Communications, will explain the best practices of continuous testing at high scale, which is r...
Feb. 28, 2015 01:00 PM EST Reads: 1,107
Software is eating the world. Companies that were not previously in the technology space now find themselves competing with Google and Amazon on speed of innovation. As the innovation cycle accelerates, companies must embrace rapid and constant change to both applications and their infrastructure, and find a way to deliver speed and agility of development without sacrificing reliability or efficiency of operations. In her Day 2 Keynote DevOps Summit, Victoria Livschitz, CEO of Qubell, discussed...
Feb. 28, 2015 12:30 PM EST Reads: 3,835
Feb. 28, 2015 12:00 PM EST Reads: 2,506
Feb. 28, 2015 12:00 PM EST Reads: 2,316
The explosion of connected devices / sensors is creating an ever-expanding set of new and valuable data. In parallel the emerging capability of Big Data technologies to store, access, analyze, and react to this data is producing changes in business models under the umbrella of the Internet of Things (IoT). In particular within the Insurance industry, IoT appears positioned to enable deep changes by altering relationships between insurers, distributors, and the insured. In his session at @Things...
Feb. 28, 2015 12:00 PM EST Reads: 1,162
NaviSite, Inc., a Time Warner Cable company, has opened a new enterprise-class data center located in Santa Clara, California. The new data center will enable NaviSite to meet growing demands for its enterprise-class Cloud and Managed Services from existing and new customers. This facility, which is owned by data center solution provider Digital Realty, will join NaviSite’s fabric of nine existing data centers across the U.S. and U.K., all of which are designed to provide a resilient, secure, hi...
Feb. 28, 2015 12:00 PM EST Reads: 941
SYS-CON Events announced today that Open Data Centers (ODC), a carrier-neutral colocation provider, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place June 9-11, 2015, at the Javits Center in New York City, NY. Open Data Centers is a carrier-neutral data center operator in New Jersey and New York City offering alternative connectivity options for carriers, service providers and enterprise customers.
Feb. 28, 2015 12:00 PM EST Reads: 1,852