Welcome!

@CloudExpo Authors: Yeshim Deniz, Elizabeth White, Pat Romanski, Liz McMillan, Zakia Bouachraoui

Related Topics: @CloudExpo, Microservices Expo

@CloudExpo: Blog Post

Using Amazon Elastic MapReduce in the Automotive Industry

Using Cloud to improve the Go-to-Market cycle in the automotive industry

While most of the case studies and value proposition for the Cloud is seen as a cost-reduction option for the enterprise by moving the fixed capacity infrastructure to a dynamic structure, there is also an element in cloud regarding its ability to perform processing of large amounts of information using highly parallel processes on scalable computing infrastructure.

Some of the major advantages of utilizing the Cloud for processing complex jobs are:

  • Enable quicker innovation through access to additional compute resources in minutes instead of months.
  • Scale compute resources to the size appropriate for each workload.

Amazon Elastic MapReduce
Amazon Elastic MapReduce is a web service that enables businesses, researchers, data analysts, and developers to easily and cost-effectively process vast amounts of data. It utilizes a hosted Hadoop framework running on the web-scale infrastructure of Amazon Elastic Compute Cloud (Amazon EC2) and Amazon Simple Storage Service (Amazon S3).

Five Automobile Scenarios for Amazon Elastic MapReduce
Using Amazon Elastic MapReduce, you can instantly provision as much or as little capacity as you like to perform data-intensive tasks for applications such as web indexing, data mining, log file analysis, data warehousing, machine learning, financial analysis, scientific simulation, and bioinformatics research.

However, the following specific scenarios in the large automobile manufacturing companies will serve as best candidates for adopting high-performance computing using Amazon Elastic MapReduce.

1. Vehicle Model and Option Validation
Processing logic inside vehicle manufacturing, there are complex algorithms related to:

  • Building the base vehicle configuration data
  • Evaluating multiple models
  • Defining and validating which vehicle options can be installed on a vehicle
  • Which options to use to ensure compatibility
  • There are also restrictions associated with a valid build of a vehicle

While the logic behind the vehicle validation is beyond the scope of this article, this complex algorithm is time-consuming and once tailored properly can be a valid candidate for Amazon Elastic MapReduce.

2. Vehicle Mass Analysis
The automobile industry is facing numerous challenges today. Clearly at the top of the list is the need to reduce vehicle weight. Several advanced algorithms, "What If Analysis," play vital role in mass reduction during the product design and development process.

In the vehicle development process, engineers design, analyze, test and then redesign a product. Design processes that incorporate optimization tools can evaluate hundreds of design concepts under multiple load conditions simultaneously. This ensures that the resulting design is then optimized for mass analysis while meeting all design and manufacturing targets.

Algorithms and processing associated with vehicle mass analysis can be a valid candidate for high-performance computing framework like Amazon Elastic MapReduce.

3. Emission Reporting
Regarding pollution control, to reduce the environment effects due to vehicle emissions, stricter controls and reporting is enforced by the EPA (Environmental Protection Agency) and by other similar agencies on the OEM. This, in turn, forces several advanced calculations to be done by automobile manufacturers.

For example there are complex calculations for:

  • Vehicle pollution generated on a given trip (carbon monoxide, NOx, hydrocarbons, CO2)
  • Monthly CO2 emissions and carbon footprint

Again these complex calculations on large volumes  of data making it ideal candidate.

4. Recyclability and Recoverability
To support the statutory requirements especially in Europe for the end-of-life of a vehicle and related environmental issues, there are again complex calculations involved to:

  • Analyze parts, components and vehicles in terms of their recyclability and recoverability (the ease with which parts can be recycled at the end of life)
  • Life-cycle analysis studies
  • Recyclability calculations
  • Recovery weight calculations

Like the candidates above, this is again a candidate for MapReduce algorithms.

5. Warranty Claim Analysis
While several leading OEMs faced crisis due to recalls resulting out from vehicle faults, analyzing customer satisfaction surveys and warranty claims is very important to bring quality into the vehicle design. Several large organizations invest in large processing power to analyze warranty claims; again this will be an ideal candidate for the MapReduce algorithms implemented by Amazon High Performance Computing.

Summary and Challenges
While the automotive scenarios are good candidates for implementing the Amazon Elastic MapReduce functionality, it requires more design and analysis in terms of:

  • Develop your data processing application. Amazon Elastic MapReduce enables job flows to be developed in SQL-like languages, such as Hive and Pig, making it easy to write data analytical scripts without in-depth knowledge of the MapReduce development paradigm. If desired, more sophisticated applications can be authored in your choice of Cascading, Java, Ruby, Perl, Python,PHP, R, or C++.
  • Upload your data and your processing application into Amazon S3. Amazon S3 provides reliable, scalable, easy-to-use storage for your input and output data.

More Stories By Srinivasan Sundara Rajan

Highly passionate about utilizing Digital Technologies to enable next generation enterprise. Believes in enterprise transformation through the Natives (Cloud Native & Mobile Native).

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


CloudEXPO Stories
Nicolas Fierro is CEO of MIMIR Blockchain Solutions. He is a programmer, technologist, and operations dev who has worked with Ethereum and blockchain since 2014. His knowledge in blockchain dates to when he performed dev ops services to the Ethereum Foundation as one the privileged few developers to work with the original core team in Switzerland.
Most DevOps journeys involve several phases of maturity. Research shows that the inflection point where organizations begin to see maximum value is when they implement tight integration deploying their code to their infrastructure. Success at this level is the last barrier to at-will deployment. Storage, for instance, is more capable than where we read and write data. In his session at @DevOpsSummit at 20th Cloud Expo, Josh Atwell, a Developer Advocate for NetApp, will discuss the role and value extensible storage infrastructure has in accelerating software development activities, improve code quality, reveal multiple deployment options through automated testing, and support continuous integration efforts. All this will be described using tools common in DevOps organizations.
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like "How is my application doing" but no idea how to get a proper answer.
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
@DevOpsSummit at Cloud Expo, taking place November 12-13 in New York City, NY, is co-located with 22nd international CloudEXPO | first international DXWorldEXPO and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete at launch. DevOps may be disruptive, but it is essential.