Welcome!

@CloudExpo Authors: Automic Blog, Pat Romanski, Liz McMillan, Kevin Jackson, Elizabeth White

Related Topics: @CloudExpo, Machine Learning , Artificial Intelligence, @DXWorldExpo, @ThingsExpo

@CloudExpo: Article

AI-Defined Infrastructure | @CloudExpo #AI #DX #IoT #ArtificialIntelligence

The Foundation for New Generation Business Models and Applications

In 2016, artificial intelligence (AI) reached its climax. Research and advisory firm Tractica predicted that the annual worldwide AI revenue will grow from $643.7 million in 2016 to $38.8 billion by 2025. The revenue for enterprise AI applications will increase from $358 million in 2016 to $31.2 billion by 2025, representing a compound annual growth rate (CAGR) of 64.3%. Thus, IT and business decision makers must face up to the potentials of AI already today. For each kind of organization this leads to the question, which type of technologies or infrastructure they can leverage to operate an AI-ready enterprise stack.

What Is Artificial Intelligence (AI)?
In 1955, Prof. John McCarthy defined AI as "The goal of AI is to develop machines that behave as though they were intelligent." Discussing "intelligent" in this context, we are talking about a vigorous system. A system that must be considered as a raw IQ container, a system that needs unstructured input to train its senses, a system that needs a semantic understanding of the world to be able to take further actions. A system that needs a detailed map of its context to act independently and transfer experience from one context to another, a system that is equipped with all the necessities to develop, foster and maintain knowledge.

It is our responsibility to share our knowledge with these machines as we would share it with our children, spouses or colleagues. This is the only way to transform these machines, made of hard- and software, into a status we would describe as "smart", helping them to become more intelligent by learning on a daily basis, building the groundwork to create a self-learning system. In doing so, research distinguishes three types of AIs:

  • Strong AI: A strong AI (or superintelligence) is a self-aware machine with ideal thoughts, feelings, consciousness and all the necessary links. For all those who are already looking forward to a reality á la "Her" or "Ex_Machina" still need to wait. Large neural networks have millions of neurons. Brains have billions of neurons. Neural networks only simulate the electrical system in a brain, the brain also has a chemical, potentially a quantum mechanics based system. The layer based modelling of deep learning networks is to simplify training, the brain has no such restrictions. Neural networks are about as far away from a brain that thinks as a snail is from a supersonic jet. Thus, a strong AI doesn't exist yet and is very far away.
  • Narrow AI: Most business cases in AI focus on solving particular very pointed challenges. These narrow AIs are great at optimizing specific tasks like recommending songs on Pandora ormanaging analyses to improve tomato growth in a greenhouse.
  • General AI: A general AI can handle tasks from different areas and origins with the ability to shorten training time from one area to the next by applying experience gathered in one area and applied in a different area. This knowledge transfer is only possible if there is a semantic connection between these areas. The stronger and denser this connection, the faster and easier knowledge transition is achieved. In comparison to a narrow AI, a general AI has all the necessary knowledge and abilities to improve not only tomato growth in a greenhouse but cucumber, eggplant, peppers, radishes and kohlrabi as well. Thus, a general AI is a system, that can handle more than just one specific task.

However, one thing is obvious. Without technologies, such as cloud computing, AI wouldn't have achieved its boom particularly today. Both cloud services and progress in machine intelligence have made it easier for organizations to apply AI-based functionalities to interact closer with its customers. More and more companies like Airbnb, Netflix, Uber or Expedia are already using cloud-based systems to process AI relevant tasks that draw on an intensive utilization of CPU/ GPU as well as services for comprehensive computing and analysis tasks.

In the context of their AI strategy, companies should evaluate AI services from different cloud providers. Another part of their strategy should contain an AI-defined infrastructure. The foundation for this kind of infrastructure is a general AI that unifies three typical human characteristics, which empower an organization to autonomously operate its IT and business processes.

  • Learning: The general AI receives best practices and reasoning from experts based on ongoing learning units. For this purpose, the knowledge is taught in granular pieces that consist of discrete parts of a process. In the context of a greenhouse, the experts teach the AI any process step by step, e.g., how to grow cucumbers, eggplants or paprika. In doing so, they share their context-based knowledge with the AI that includes among others "what has to be done" and "why this has to be done".
  • Understanding: By creating a semantic data graph the general AI gets an understanding of the world in which the organization is acting with its IT and business objectives. Thus, the semantic data graph of a greenhouse would consolidate different contexts (e.g., information, characteristics and specifics of the greenhouse, cucumber culture, eggplant culture and paprika culture) and enrich (compare learning) it on an ongoing basis. The IT of an organization plays an important role, since all data are running together here.
  • Solving: With the concept of machine reasoning, problems are solved in ambiguous and changing environments. The general AI dynamically reacts to the ever-changing context, selecting the best course of action. Based on the trained knowledge (learning) and the creation of the semantic graph (understanding) the general AI can grow more than one single type of vegetable in a greenhouse. This is ensured with the growing amount of trained knowledge pieces that lead to a knowledge pool that is further optimized by machine selection of best knowledge combinations for problem resolution. This type of collaborative learning improves process time task by task. However, the number of possible permutations grows exponentially with added knowledge. Connected to a knowledge core, the General AI continuously optimizes performance by eliminating unnecessary steps and even changing routes based on other contextual learning. Thus, the bigger the semantic data graph gets, the better and more dynamically further types of vegetables can be cultured.

What Requirements Concerning Infrastructure Environments Does an AI Have?
Right now, AI is the technology that has the potential not only to improve existing infrastructure like cloud environments but expedite a new generation of infrastructure technologies as well. As an important technology trend, AI has influenced a new generation of development frameworks as well as a new generation of hardware technologies to run scalable AI applications.

Mobile and IoT applications have only minor requirements concerning runtime environments to an infrastructure. However, it is critical to provide appropriate services to build a backend for those types of applications. By contrast, AI applications do not only expect sophisticated backend services but also optimized runtime environments that are adapted for GPU intensive requirements of AI solutions. AI applications challenge the infrastructure with regards to the simultaneous task processing in very short time cycles. For accelerating deep learning applications in particular GPU processors are employed. GPU optimized applications distribute CPU-intensive areas of an application to the GPU and let the ordinary computations handle by the CPU. In doing so, the execution of the entire application is accelerated. The advantage of a GPU towards a CPU is reflected in the respective architectures. A CPU is exclusively designed for serial data processing and only has a few cores. A GPU, however, is composed of a parallel architecture with a vast number of small cores that process the tasks simultaneously. According to NVIDIA, the application throughput of a GPU is 10 to 100 times higher in comparison to a CPU. Thus, an infrastructure should be able to provide a deep learning framework such as TensorFlow and Torch over hundreds or thousands of nodes on a demand basis that immediately are deployed with the optimal CPU configuration.

The following list (in a partial state) deals with the requirements for infrastructure to support AI applications:

  • Support of current frameworks: Infrastructure must be able to support AI application based on AI frameworks like TensorFlow, Caffe, Theano and Torch the same way as web applications and backend processes. Thus, an infrastructure should not exclusively focus on AI frameworks but design the portfolio in the interests of a developer.
  • GPU optimized environment: An infrastructure has to make sure that every AI process can be processed. Thus, it must support GPU environments in order to provide fast computational power. Microsoft was the frontrunner in this area by offering its N-series GPU instances.
  • Management environment and tools: One of the biggest challenges of current infrastructure environments is the drawback of management tools for running AI frameworks. Here, in particular, the direct interaction between AI frameworks and the infrastructure is necessary to ensure the best balance and thus deliver the best performance.
  • AI-integrated infrastructure services: Infrastructure provider must and will not only support AI functionalities but integrate AI as a central part of their infrastructure and service stacks. This type of an AI-defined Infrastructure won't only increase the intelligence of cloud services and applications but also simplify the setup and operations of the infrastructure by the customer.
  • Machine Reasoning: Infrastructure providers who provide their customers with technologies for machine reasoning are helping them to solve problems in ambiguous and changing environments. Based on machine reasoning the AI environment is able to dynamically react to the ever-changing context, selecting the best course of action. This is ensured by selecting the best knowledge combinations for problem resolution. In the end, the results are optimized with machine learning algorithms.

Infrastructure Environments and Technologies for AI
In the course of years, cloud platform provider made enormous investments into AI functionalities and services. The leading public cloud provider in particular Amazon, Microsoft and Google are in the lead. But also several PaaS providers extended their offerings with AI services. The current AI technology landscape consists of the following three main categories:

  • Cloud machine learning (ML) platforms:Technologies like AWS Machine Learning or Google Machine Learning make it possible to use machine learning models based on proprietary technologies. Because even if Google Cloud ML sets on TensorFlow, most of the other cloud based ML services do not allow to execute AI applications that e.g. have been written in Theano, Torch, TensorFlow or Caffe.
  • AI cloud services:Technologies like Microsoft Cognitive Services, Google Cloud Vision or Natural Language APIs enable the use of complex AI abilities based on a simple API call. This allows organizations to develop applications with AI capabilities without investing into and owning the necessary AI infrastructure.
  • Technologies for private and public cloud environments: Technologies like HIRO are designed to run on top of public cloud environments like Amazon Web Services as well as private clouds such as OpenStack or VMware. They enable organizations to develop and operate transcontextual AI-based business models based on a general AI.

Further AI relevant categories and vendors are:

  • Machine Learning: Rapidminer, Context Relevant, H20, Datarpm, LiftIngniter, Spark Beyond, Yhat, Wise.io, Sense, GraphLab, Alpine, Nutonian
  • Conversational AI/ Bots: Mindfield, SemanticMachines, Maluuba, Mobvoi, KITT AI, Clara, Automat, Wit.ai, Cortical.io, Idibon, Luminoso
  • Vision: Clarifai, Chronocam, Orbital Insight, Pilot.ai, Captricity, Crokstyle
  • Auto: NuTonomy, Drive.ai, AI Motive, Nauto, Nexar, Zoox
  • Robotics: Ubtech, Anki, Rokid, Dispatch
  • Cybersecurity: Cyclance, Sift Science, Spark Cognition, Deep Instict, Shift Technology, Dark Trace
  • BI & Analytics: DataRobot, Trifaca, Tamr, Esigopt, Paxata, Dataminr, CrowdFlower, Logz.io
  • Ad, Sales and CRM: TalkIQ, Deepgram, Persado, Appier, Chors, InsideSales.com, Drawbridge, DigitalGenius, Resci
  • Healthcare: Freenome, Cloud Medx, Zebra, Enlitic, Two AR, iCarbonX, Atomwise, Deep Genomics, Babylon, Lunit
  • Text Analysis: Textio, Fido.ai, Narrative
  • IoT: Nanit, Konux, Verdigris, Sight Machine
  • Commerce: Bloomreach, Mode.ai
  • Fintech & Insurance: Cape Analytics, Kensho, Numerai, Alphasense, Kasisto

At the end of the day, the progressive developments of AI technologies are going to influence infrastructure environments and let them shift from a supporting mode towards a model where AI applications get the equal support like today's web applications and services.

The Future Is an AI-enabled Enterprise
An AI-enabled Infrastructure is an essential part of today's enterprise stack and builds the foundation for the AI-enabled enterprise. Because one thing is obvious. There are multiple challenges established companies are facing nowadays. Like the often-quoted war for talent or the inability of many large corporates to change effectively. But there is still an underestimated threat called competition - not from their own peers - but from high-tech companies like Amazon, Google, Facebook, etc., that are unstoppably marching into their markets. These high-tech companies invade the well-known competitive space of established companies with unimaginable financial resources and by hijacking the consumer life cycle.

Amazon is just one example who already has started to cut out the middleman within the own supply chain. We can be sure that business models of companies like DHL, UPS or FedEx are going to look different in the future - hint: Amazon Prime Air. Furthermore, Amazon has arranged everything to become a complete end-to-end provider of goods - digital as well as non-digital. It's likely that it won't be long until Facebook gets its banking license. Access to potential customers, enough information about its users and the necessary financial resources already exist. Consequently, established companies need to have powerful answers if they still want to exist tomorrow.

AI is one of these answers in the corporate toolkit to help overcome these competitive threats. However, time is running out for established companies. High-tech companies have already become uncatchable.

More Stories By Rene Buest

Rene Buest is Director of Market Research & Technology Evangelism at Arago. Prior to that he was Senior Analyst and Cloud Practice Lead at Crisp Research, Principal Analyst at New Age Disruption and member of the worldwide Gigaom Research Analyst Network. At this time he was considered a top cloud computing analyst in Germany and one of the worldwide top analysts in this area. In addition, he was one of the world’s top cloud computing influencers and belongs to the top 100 cloud computing experts on Twitter and Google+. Since the mid-90s he is focused on the strategic use of information technology in businesses and the IT impact on our society as well as disruptive technologies.

Rene Buest is the author of numerous professional technology articles. He regularly writes for well-known IT publications like Computerwoche, CIO Magazin, LANline as well as Silicon.de and is cited in German and international media – including New York Times, Forbes Magazin, Handelsblatt, Frankfurter Allgemeine Zeitung, Wirtschaftswoche, Computerwoche, CIO, Manager Magazin and Harvard Business Manager. Furthermore he is speaker and participant of experts rounds. He is founder of CloudUser.de and writes about cloud computing, IT infrastructure, technologies, management and strategies. He holds a diploma in computer engineering from the Hochschule Bremen (Dipl.-Informatiker (FH)) as well as a M.Sc. in IT-Management and Information Systems from the FHDW Paderborn.

@CloudExpo Stories
Nordstrom is transforming the way that they do business and the cloud is the key to enabling speed and hyper personalized customer experiences. In his session at 21st Cloud Expo, Ken Schow, VP of Engineering at Nordstrom, discussed some of the key learnings and common pitfalls of large enterprises moving to the cloud. This includes strategies around choosing a cloud provider(s), architecture, and lessons learned. In addition, he covered some of the best practices for structured team migration an...
Digital transformation is about embracing digital technologies into a company's culture to better connect with its customers, automate processes, create better tools, enter new markets, etc. Such a transformation requires continuous orchestration across teams and an environment based on open collaboration and daily experiments. In his session at 21st Cloud Expo, Alex Casalboni, Technical (Cloud) Evangelist at Cloud Academy, explored and discussed the most urgent unsolved challenges to achieve f...
Recently, WebRTC has a lot of eyes from market. The use cases of WebRTC are expanding - video chat, online education, online health care etc. Not only for human-to-human communication, but also IoT use cases such as machine to human use cases can be seen recently. One of the typical use-case is remote camera monitoring. With WebRTC, people can have interoperability and flexibility for deploying monitoring service. However, the benefit of WebRTC for IoT is not only its convenience and interopera...
SYS-CON Events announced today that Synametrics Technologies will exhibit at SYS-CON's 22nd International Cloud Expo®, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Synametrics Technologies is a privately held company based in Plainsboro, New Jersey that has been providing solutions for the developer community since 1997. Based on the success of its initial product offerings such as WinSQL, Xeams, SynaMan and Syncrify, Synametrics continues to create and hone inn...
"WineSOFT is a software company making proxy server software, which is widely used in the telecommunication industry or the content delivery networks or e-commerce," explained Jonathan Ahn, COO of WineSOFT, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
The dynamic nature of the cloud means that change is a constant when it comes to modern cloud-based infrastructure. Delivering modern applications to end users, therefore, is a constantly shifting challenge. Delivery automation helps IT Ops teams ensure that apps are providing an optimal end user experience over hybrid-cloud and multi-cloud environments, no matter what the current state of the infrastructure is. To employ a delivery automation strategy that reflects your business rules, making r...
There is a huge demand for responsive, real-time mobile and web experiences, but current architectural patterns do not easily accommodate applications that respond to events in real time. Common solutions using message queues or HTTP long-polling quickly lead to resiliency, scalability and development velocity challenges. In his session at 21st Cloud Expo, Ryland Degnan, a Senior Software Engineer on the Netflix Edge Platform team, will discuss how by leveraging a reactive stream-based protocol,...
Modern software design has fundamentally changed how we manage applications, causing many to turn to containers as the new virtual machine for resource management. As container adoption grows beyond stateless applications to stateful workloads, the need for persistent storage is foundational - something customers routinely cite as a top pain point. In his session at @DevOpsSummit at 21st Cloud Expo, Bill Borsari, Head of Systems Engineering at Datera, explored how organizations can reap the bene...
The past few years have brought a sea change in the way applications are architected, developed, and consumed—increasing both the complexity of testing and the business impact of software failures. How can software testing professionals keep pace with modern application delivery, given the trends that impact both architectures (cloud, microservices, and APIs) and processes (DevOps, agile, and continuous delivery)? This is where continuous testing comes in. D
Most technology leaders, contemporary and from the hardware era, are reshaping their businesses to do software. They hope to capture value from emerging technologies such as IoT, SDN, and AI. Ultimately, irrespective of the vertical, it is about deriving value from independent software applications participating in an ecosystem as one comprehensive solution. In his session at @ThingsExpo, Kausik Sridhar, founder and CTO of Pulzze Systems, discussed how given the magnitude of today's application ...
Sanjeev Sharma Joins June 5-7, 2018 @DevOpsSummit at @Cloud Expo New York Faculty. Sanjeev Sharma is an internationally known DevOps and Cloud Transformation thought leader, technology executive, and author. Sanjeev's industry experience includes tenures as CTO, Technical Sales leader, and Cloud Architect leader. As an IBM Distinguished Engineer, Sanjeev is recognized at the highest levels of IBM's core of technical leaders.
Digital Transformation (DX) is not a "one-size-fits all" strategy. Each organization needs to develop its own unique, long-term DX plan. It must do so by realizing that we now live in a data-driven age, and that technologies such as Cloud Computing, Big Data, the IoT, Cognitive Computing, and Blockchain are only tools. In her general session at 21st Cloud Expo, Rebecca Wanta explained how the strategy must focus on DX and include a commitment from top management to create great IT jobs, monitor ...
The 22nd International Cloud Expo | 1st DXWorld Expo has announced that its Call for Papers is open. Cloud Expo | DXWorld Expo, to be held June 5-7, 2018, at the Javits Center in New York, NY, brings together Cloud Computing, Digital Transformation, Big Data, Internet of Things, DevOps, Machine Learning and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding busin...
"Digital transformation - what we knew about it in the past has been redefined. Automation is going to play such a huge role in that because the culture, the technology, and the business operations are being shifted now," stated Brian Boeggeman, VP of Alliances & Partnerships at Ayehu, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Continuous Delivery makes it possible to exploit findings of cognitive psychology and neuroscience to increase the productivity and happiness of our teams. In his session at 22nd Cloud Expo | DXWorld Expo, Daniel Jones, CTO of EngineerBetter, will answer: How can we improve willpower and decrease technical debt? Is the present bias real? How can we turn it to our advantage? Can you increase a team’s effective IQ? How do DevOps & Product Teams increase empathy, and what impact does empath...
You know you need the cloud, but you're hesitant to simply dump everything at Amazon since you know that not all workloads are suitable for cloud. You know that you want the kind of ease of use and scalability that you get with public cloud, but your applications are architected in a way that makes the public cloud a non-starter. You're looking at private cloud solutions based on hyperconverged infrastructure, but you're concerned with the limits inherent in those technologies. What do you do?
In his session at 21st Cloud Expo, Raju Shreewastava, founder of Big Data Trunk, provided a fun and simple way to introduce Machine Leaning to anyone and everyone. He solved a machine learning problem and demonstrated an easy way to be able to do machine learning without even coding. Raju Shreewastava is the founder of Big Data Trunk (www.BigDataTrunk.com), a Big Data Training and consulting firm with offices in the United States. He previously led the data warehouse/business intelligence and B...
Cloud Expo | DXWorld Expo have announced the conference tracks for Cloud Expo 2018. Cloud Expo will be held June 5-7, 2018, at the Javits Center in New York City, and November 6-8, 2018, at the Santa Clara Convention Center, Santa Clara, CA. Digital Transformation (DX) is a major focus with the introduction of DX Expo within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive ov...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
Smart cities have the potential to change our lives at so many levels for citizens: less pollution, reduced parking obstacles, better health, education and more energy savings. Real-time data streaming and the Internet of Things (IoT) possess the power to turn this vision into a reality. However, most organizations today are building their data infrastructure to focus solely on addressing immediate business needs vs. a platform capable of quickly adapting emerging technologies to address future ...