|By Maureen O'Gara||
|November 6, 2009 02:20 PM EST||
If you’ve got simply scads of data – and why wouldn’t you? – it’s doubling every 18 months – and are shuttling it to an application for analysis, you’re doing it wrong.
That’s so…so, well, 1980.
According to Aster Data, applications need to go to “Big Data,” not the other way around.
And to do that the company’s got a massively parallel data-application server that can embed applications inside a massively scalable MPP data warehouse and analyze petabytes of data – or terabytes, if that’s all you’ve got – ultra-fast.
Apps are automatically parallelized for scale; users can take their existing Java, C, C++, C#, .NET, Perl and Python applications, MapReduce-enable them and push them down into the data.
The widgetry runs on a cluster of commodity boxes. Figure five servers to start although parallelized applications can utilize terabytes of memory and thousands of CPU cores.
This is not the data warehouses, DBMSes and data analytics solutions of the last three decades that have separated data from applications, a technique Aster says results in massive data movement, latency and restricted analysis.
Traditional systems weren’t built to process billions of rows of data in seconds or handle chi-chi stuff like real-time fraud detection, customer behavior modeling, merchandising optimization, affinity marketing, trending and simulations, trading surveillance and customer calling patterns.
They were built for data sampling, an inexact science. They simply fail in today’s big data, analytics-intensive environments, Aster says.
The company’s Aster Data 4.0 brings data and applications together in one system, fully parallelizing both, to deliver ultra-fast analysis on massive data scales. And it’s got customers like comScore, Full Tilt Poker, Telefonica I+D, SAS and MySpace, with the big clutch of data of all, saying it’s right.
Aster’s Massively Parallel Data-Application Server 4.0, based on research done at Stanford University before commercialization started a couple of years ago, lets companies embed application logic in Aster’s MPP database, which includes MapReduce. It was Aster that brought MapReduce to SQL, a trick it’s now building on.
In Aster’s system data management lives independent of the application processing but – and this is important – the data and applications execute as first-class citizens, with their own respective data and application management services.
The Data-Application Server is responsible for managing and coordinating the cluster’s activities and resource sharing. It acts as a host for the application processing and the data managed inside the cluster.
As a data host, it manages incremental scaling, fault tolerance and heterogeneous hardware for application processing and it manages workloads via Aster’s new Dynamic Workload Management (WLM) capability.
Aster says WLM, described as the first dynamic workload management capability available on a MPP system to run on commodity hardware, can support hundreds of concurrent mixed workloads. It manages data storage, transactional correctness, online backups and information lifecycles (ILM).
The separation of data management and application processing is supposed to provide maximum application portability so a wide range of applications can be pushed down into the system.
Aster says this data analysis architecture distinguishes its solution from lightweight implementations of MapReduce, including what some vendors refer to as ‘In-Database MapReduce.
Richard Zwicky, president of Enquisite, the company that provides search optimization software and solutions, says that with Aster Data, response times for large queries has dropped from five minutes to five-10 seconds, and queries that previously weren’t possible now can be executed in 20-30 seconds.
Aster Data is backed by Sequoia Capital, Jafco Ventures, IVP and Cambrian Ventures, as well as Google’s first investor David Cheriton, Ron Conway and Rajeev Motwani.
|MarlenaFernandezBerkowitz 11/09/09 12:49:00 PM EST|
Interesting post from Enquisite CEO Mark Hoffman (former
In this scenarios approach Joe Thykattil, Technology Architect & Sales at TimeWarner / Navisite, presented examples that will allow business-savvy professionals to make informed decisions based on a sound business model. This model covered the technology options in detail as well as a financial analysis. The TCO (Total Cost of Ownership) and ROI (Return on Investment) demonstrated how to start, develop and formulate a business case that will allow both small and large scale projects to achieve...
Jan. 28, 2015 01:00 PM EST Reads: 3,265
IBM has announced a new strategic technology services agreement with Anthem, Inc., a health benefits company in the U.S. IBM has been selected to provide operational services for Anthem's mainframe and data center server and storage infrastructure for the next five years. Among the benefits of the relationship, Anthem has the ability to leverage IBM Cloud solutions that will help increase the ease, availability and speed of adding infrastructure to support new business requirements.
Jan. 28, 2015 01:00 PM EST Reads: 2,357
BMC Software plans to acquire assets of CDB Software, Inc., a mainframe data management company that has developed utilities for managing IBM DB2 databases with virtually no outage. Focusing on the availability of mission-critical applications is strategic for BMC as it continues to help its customers transform IT into a competitive advantage for their business. CDB's technology complements BMC's existing mainframe data management portfolio, which includes software utilities for DB2 administrat...
Jan. 28, 2015 01:00 PM EST Reads: 1,604
Amazon, Google and Facebook are household names in part because of their mastery of Big Data. But what about organizations without billions of dollars to spend on Big Data tools - how can they extract value from their data? In his session at 6th Big Data Expo®, Ali Ghodsi, Co-Founder and Head of Engineering at Databricks, discussed how the zero management cost and scalability of the cloud is addressing the challenges and pain points that data engineers face when working with Big Data. He also s...
Jan. 28, 2015 01:00 PM EST Reads: 3,887
IBM has announced software that allows people to hide or anonymize their personal information on the Web, ensuring protection from identity theft and other misuse. Developed by researchers at IBM's laboratory in Zurich, Switzerland, the software – called Identity Mixer – will enable consumers to purchase goods and services on the Internet without disclosing personal information. As consumers hand over personal details in exchange for downloading music or subscribing to online newsletters, they...
Jan. 28, 2015 01:00 PM EST Reads: 597
The term culture has had a polarizing effect among DevOps supporters. Some propose that culture change is critical for success with DevOps, but are remiss to define culture. Some talk about a DevOps culture but then reference activities that could lead to culture change and there are those that talk about culture change as a set of behaviors that need to be adopted by those in IT. There is no question that businesses successful in adopting a DevOps mindset have seen departmental culture change, ...
Jan. 28, 2015 12:45 PM EST Reads: 3,643
The Internet of Things will greatly expand the opportunities for data collection and new business models driven off of that data. In her session at @ThingsExpo, Esmeralda Swartz, CMO of MetraTech, discussed how for this to be effective you not only need to have infrastructure and operational models capable of utilizing this new phenomenon, but increasingly service providers will need to convince a skeptical public to participate. Get ready to show them the money!
Jan. 28, 2015 12:30 PM EST Reads: 4,606
DevOps Summit 2015 New York, co-located with the 16th International Cloud Expo - to be held June 9-11, 2015, at the Javits Center in New York City, NY - announces that it is now accepting Keynote Proposals. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete...
Jan. 28, 2015 12:15 PM EST Reads: 4,081
Connected devices and the Internet of Things are getting significant momentum in 2014. In his session at Internet of @ThingsExpo, Jim Hunter, Chief Scientist & Technology Evangelist at Greenwave Systems, examined three key elements that together will drive mass adoption of the IoT before the end of 2015. The first element is the recent advent of robust open source protocols (like AllJoyn and WebRTC) that facilitate M2M communication. The second is broad availability of flexible, cost-effective ...
Jan. 28, 2015 12:00 PM EST Reads: 4,103
The Internet of Things will put IT to its ultimate test by creating infinite new opportunities to digitize products and services, generate and analyze new data to improve customer satisfaction, and discover new ways to gain a competitive advantage across nearly every industry. In order to help corporate business units to capitalize on the rapidly evolving IoT opportunities, IT must stand up to a new set of challenges. In his session at @ThingsExpo, Jeff Kaplan, Managing Director of THINKstrateg...
Jan. 28, 2015 11:45 AM EST Reads: 4,420
Cloud and Big Data present unique dilemmas: embracing the benefits of these new technologies while maintaining the security of your organization's assets. When an outside party owns, controls and manages your infrastructure and computational resources, how can you be assured that sensitive data remains private and secure? How do you best protect data in mixed use cloud and big data infrastructure sets? Can you still satisfy the full range of reporting, compliance and regulatory requirements? In...
Jan. 28, 2015 11:45 AM EST Reads: 3,882
"Our premise is Docker is not enough. That's not a bad thing - we actually love Docker. At ActiveState all our products are based on open source technology and Docker is an up-and-coming piece of open source technology," explained Bart Copeland, President & CEO of ActiveState Software, in this SYS-CON.tv interview at DevOps Summit at Cloud Expo®, held Nov 4-6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
Jan. 28, 2015 11:45 AM EST Reads: 3,921
Eighty-five percent of companies store information in some sort of unstructured manner. In this demo at 15th Cloud Expo, Mark Fronczak, Product Manager at Solgenia, discussed their enterprise content management solution, which was created to help companies organize and take control of their digital assets.
Jan. 28, 2015 11:30 AM EST Reads: 2,824
The 3rd International Internet of @ThingsExpo, co-located with the 16th International Cloud Expo - to be held June 9-11, 2015, at the Javits Center in New York City, NY - announces that its Call for Papers is now open. The Internet of Things (IoT) is the biggest idea since the creation of the Worldwide Web more than 20 years ago.
Jan. 28, 2015 11:30 AM EST Reads: 4,874
The BPM world is going through some evolution or changes where traditional business process management solutions really have nowhere to go in terms of development of the road map. In this demo at 15th Cloud Expo, Kyle Hansen, Director of Professional Services at AgilePoint, shows AgilePoint’s unique approach to dealing with this market circumstance by developing a rapid application composition or development framework.
Jan. 28, 2015 11:30 AM EST Reads: 3,376
Fundamentally, SDN is still mostly about network plumbing. While plumbing may be useful to tinker with, what you can do with your plumbing is far more intriguing. A rigid interpretation of SDN confines it to Layers 2 and 3, and that's reasonable. But SDN opens opportunities for novel constructions in Layers 4 to 7 that solve real operational problems in data centers. "Data center," in fact, might become anachronistic - data is everywhere, constantly on the move, seemingly always overflowing. Net...
Jan. 28, 2015 11:15 AM EST Reads: 3,562
Leysin American School is an exclusive, private boarding school located in Leysin, Switzerland. Leysin selected an OpenStack-powered, private cloud as a service to manage multiple applications and provide development environments for students across the institution. Seeking to meet rigid data sovereignty and data integrity requirements while offering flexible, on-demand cloud resources to users, Leysin identified OpenStack as the clear choice to round out the school's cloud strategy. Additional...
Jan. 28, 2015 11:15 AM EST Reads: 3,867
The move in recent years to cloud computing services and architectures has added significant pace to the application development and deployment environment. When enterprise IT can spin up large computing instances in just minutes, developers can also design and deploy in small time frames that were unimaginable a few years ago. The consequent move toward lean, agile, and fast development leads to the need for the development and operations sides to work very closely together. Thus, DevOps become...
Jan. 28, 2015 11:00 AM EST Reads: 4,600
DevOps is all about agility. However, you don't want to be on a high-speed bus to nowhere. The right DevOps approach controls velocity with a tight feedback loop that not only consists of operational data but also incorporates business context. With a business context in the decision making, the right business priorities are incorporated, which results in a higher value creation. In his session at DevOps Summit, Todd Rader, Solutions Architect at AppDynamics, discussed key monitoring techniques...
Jan. 28, 2015 11:00 AM EST Reads: 4,239