Welcome!

@CloudExpo Authors: Roger Strukhoff, Yeshim Deniz, Pat Romanski, Zakia Bouachraoui, Elizabeth White

Related Topics: @CloudExpo, @DXWorldExpo

@CloudExpo: Blog Post

Handwriting Recognition in Healthcare | @CloudExpo #API #CognitiveComputing

A use case handwriting recognition application is not only applicable for healthcare but for manufacturing, hospitality & retail

While some existing apps allow the doctors to write using their stylus pen, what is needed is an integrated solution that includes handwriting recognition, voice, face recognition and other cognitive intelligence as part of health care applications.

 

The Need for Handwriting Recognition in Healthcare

  • Studies point to the fact that more than 70% of people spend more than one hour a day using pen
  • Today, 80 percent of physicians still rely on traditional pen and paper to capture patient information, as well as for treatment-related information
  • Hand Written notes that are not electronically captured pose a great challenge to HIPAA compliance
  • There are not very many integrated Healthcare Enterprise Application that integrates handwritten notes with Health care back end systems
  • Implementing text recognition with your EHR software may be one of the most beneficial methods to save your staff time and effort.
  • While some existing apps allow doctors to write using their stylus pen, what is needed is an integrated solution that includes handwriting recognition, voice , face recognition and other cognitive intelligence as part of health care applications.

Introduction To Windows 10 Ink
Recently Windows 10 platform has released an anniversary update, and one of the key components of that is the introduction of Windows ink. While the concept of using a stylus pen to written to your tablet device is not really new, but what is unique about Windows ink is the kind of developer support and the ability to create new set of transformational applications using Universal Windows Platform Apps (UWP).

  • The Windows Ink platform, together with a pen device, provides a natural way to create digital handwritten notes, drawings, and annotations.
  • As part of Windows UWP, A XAML UI platform control that, by default, receives and displays all input from a pen as either an ink stroke or an erase stroke.
  • Handwriting Recognition can, convert ink strokes to text using handwriting recognition, or to shapes using custom recognition
  • UWP apps that support Windows Ink can serialize and deserialize ink strokes to an Ink Serialized Format (ISF) file. The ISF file is a GIF image with additional metadata for all ink stroke properties and behaviors.
  • By integrating Windows 10 ink with existing UWP applications, next generation user experience can be created.

Extending the Solution with Azure Cognitive Services
As the patient centric applications naturally have to deal with humans, they can be highly extended by adding cognitive services on top of them. Cognitive Services enable natural and contextual interaction with tools that augment users' experiences using the power of machine-based intelligence. Tap into an ever-growing collection of powerful artificial intelligence algorithms for vision, speech, language, and knowledge.

  • For example, Face API can help with Face Recognition, such that patient identification can be found by the application, even when the patient is not in a position to talk or express.
  • Also most of the times, Doctors would like to get the true emotion of patients based on certain medical procedures, these kind of tests are also possible with Emotion API .
  • OCR solution that is available as part of Computer Vision API may also be useful in recognizing certain medication related receipts and other paper documents related to treatment.
  • It is very clear that by integration with Cognitive Services a patient centric handwriting recognition application can be extended to very many use cases.

A blue print of a healthcare application that can utilize the power of Windows 10 ink, Azure Cognitive Services with integration with back end enterprise health care application is mentioned below.

Summary

  • Windows 10 packs with many features that goes beyond the personal computing and will play an active role in Enterprise End User Access
  • Platform Services provided by Azure Cloud Platform like Azure App Service, Cognitive Services will extend the use cases with advanced user experience.
  • Windows 10 Universal app development provides a consistent user experience across devices like PC, Surface Tablets, HD TVs and gaming consoles.
  • The mentioned use case handwriting recognition application is not just applicable for healthcare alone but in many situations of manufacturing, hospitality, retail and other domains too.

More Stories By Srinivasan Sundara Rajan

Highly passionate about utilizing Digital Technologies to enable next generation enterprise. Believes in enterprise transformation through the Natives (Cloud Native & Mobile Native).

CloudEXPO Stories
As you know, enterprise IT conversation over the past year have often centered upon the open-source Kubernetes container orchestration system. In fact, Kubernetes has emerged as the key technology -- and even primary platform -- of cloud migrations for a wide variety of organizations. Kubernetes is critical to forward-looking enterprises that continue to push their IT infrastructures toward maximum functionality, scalability, and flexibility. As they do so, IT professionals are also embracing the reality of Serverless architectures, which are critical to developing and operating real-time applications and services. Serverless is particularly important as enterprises of all sizes develop and deploy Internet of Things (IoT) initiatives.
Signs of a shift in the usage of public clouds are everywhere. Previously, as organizations outgrew old IT methods, the natural answer was to try the public cloud approach; however, the public platform alone is not a complete solution. Complaints include unpredictable/escalating costs and mounting security concerns in the public cloud. Ultimately, public cloud adoption can ultimately mean a shift of IT pains instead of a resolution. That's why the move to hybrid, custom, and multi-cloud will become more and more prevalent. At the heart of this technology trend exists a custom solution to meet the needs and concerns of enterprise organizations, including compliance, security, and cost issues. The "new normal" of enterprise clients is a world of hybrid and multi-cloud solutions, and it is slowly changing the IT technology landscape. Better tools, better management, and easier adoption a...
The Japan External Trade Organization (JETRO) is a non-profit organization that provides business support services to companies expanding to Japan. With the support of JETRO's dedicated staff, clients can incorporate their business; receive visa, immigration, and HR support; find dedicated office space; identify local government subsidies; get tailored market studies; and more.
Signs of a shift in the usage of public clouds are everywhere Previously, as organizations outgrew old IT methods, the natural answer was to try the public cloud approach; however, the public platform alone is not a complete solutionThe move to hybrid, custom, and multi-cloud will become more and more prevalent At the heart of this technology trend exists a custom solution to meet the needs and concerns of these organizations, including compliance, security, and cost issues Blending Service and Deployment Models
While a hybrid cloud can ease that transition, designing and deploy that hybrid cloud still offers challenges for organizations concerned about lack of available cloud skillsets within their organization. Managed service providers offer a unique opportunity to fill those gaps and get organizations of all sizes on a hybrid cloud that meets their comfort level, while delivering enhanced benefits for cost, efficiency, agility, mobility, and elasticity.