From left are Professor Jiyun Kim and Jin Pyo Lee in the Department of Material Science and Engineering at UNIST.
CREDIT: UNIST
A groundbreaking technology that can recognize human emotions in real time has been developed by Professor Jiyun Kim and his research team in the Department of Material Science and Engineering at UNIST. This innovative technology is poised to revolutionize various industries, including next-generation wearable systems that provide services based on emotions.
Understanding and accurately extracting emotional information has long been a challenge due to the abstract and ambiguous nature of human affects such as emotions, moods, and feelings. To address this, the research team has developed a multi-modal human emotion recognition system that combines verbal and non-verbal expression data to efficiently utilize comprehensive emotional information.
At the core of this system is the personalized skin-integrated facial interface (PSiFI) system, which is self-powered, facile, stretchable, and transparent. It features a first-of-its-kind bidirectional triboelectric strain and vibration sensor that enables the simultaneous sensing and integration of verbal and non-verbal expression data. The system is fully integrated with a data processing circuit for wireless data transfer, enabling real-time emotion recognition.
Utilizing machine learning algorithms, the developed technology demonstrates accurate and real-time human emotion recognition tasks, even when individuals are wearing masks. The system has also been successfully applied in a digital concierge application within a virtual reality (VR) environment.
The technology is based on the phenomenon of “friction charging,” where objects separate into positive and negative charges upon friction. Notably, the system is self-generating, requiring no external power source or complex measuring devices for data recognition.
Professor Kim commented, “Based on these technologies, we have developed a skin-integrated face interface (PSiFI) system that can be customized for individuals.” The team utilized a semi-curing technique to manufacture a transparent conductor for the friction charging electrodes. Additionally, a personalized mask was created using a multi-angle shooting technique, combining flexibility, elasticity, and transparency.
The research team successfully integrated the detection of facial muscle deformation and vocal cord vibrations, enabling real-time emotion recognition. The system’s capabilities were demonstrated in a virtual reality “digital concierge” application, where customized services based on users’ emotions were provided.
Jin Pyo Lee, the first author of the study, stated, “With this developed system, it is possible to implement real-time emotion recognition with just a few learning steps and without complex measurement equipment. This opens up possibilities for portable emotion recognition devices and next-generation emotion-based digital platform services in the future.”
The research team conducted real-time emotion recognition experiments, collecting multimodal data such as facial muscle deformation and voice. The system exhibited high emotional recognition accuracy with minimal training. Its wireless and customizable nature ensures wearability and convenience.
Furthermore, the team applied the system to VR environments, utilizing it as a “digital concierge” for various settings, including smart homes, private movie theaters, and smart offices. The system’s ability to identify individual emotions in different situations enables the provision of personalized recommendations for music, movies, and books.
Professor Kim emphasized, “For effective interaction between humans and machines, human-machine interface (HMI) devices must be capable of collecting diverse data types and handling complex integrated information. This study exemplifies the potential of using emotions, which are complex forms of human information, in next-generation wearable systems.”
Original Article: World’s first real-time wearable human emotion recognition technology developed!
More from: Ulsan National Institute of Science and Technology | Nanyang Technological University
The Latest Updates from Bing News
Go deeper with Bing News on:
Multi-modal human emotion recognition system
- Nvidia-backed AI startup releases avatars that express human emotion
Synthesia, an AI startup supported by Nvidia, is enhancing AI avatars to accurately express human emotions and movements in corporate settings, catering to diverse industries globally with its latest ...
- Study explores why human-inspired machines can be perceived as eerie
Artificial intelligence (AI) algorithms and robots are becoming increasingly advanced, exhibiting capabilities that vaguely resemble those of humans. The growing similarities between AIs and humans ...
- Nvidia-backed Startup Synthesia Releases AI Avatars That Represent Human Emotions
Synthesia, an artificial intelligence firm backed by Nvidia, unveiled today, a new line of AI-generated digital avatars that can comprehend user-submitted language and translate it to depict human ...
- Emotion Recognition AI: The Next Big Thing in Marketing?
In today's digital age, understanding customer behavior is more than just analyzing data and trends; it's about tapping into their emotions. That's where ...
- Impaired recognition and experience of disgust following brain injury
It is important to investigate the fundamental predictions of the multi-modal ... of human beings did not reflect impaired knowledge of the concept of disgust. NK's ability to identify emotion ...
Go deeper with Bing News on:
Portable emotion recognition devices
- Apple acquires French computer vision, facial analysis startup
Datakalab has described itself as “experts in low power, runtime efficient, and deep learning algorithms” that can work effectively on portable devices.
- Apple to Bring On-Device AI with French Startup Acquisition
Apple acquired Datakalab, a French Artificial Intelligence startup amid its plans to deliver on-device AI tools.
- Apple Acquires French Firm That Specializes in On-Device AI Processing
Apple’s campaign to deliver on-device AI tools on the iPhone advances, as the Cupertino firm has purchased Paris-based artificial intelligence startup Datakalab. The firm specializes in algorithm ...
- Apple acquires this French company for on-device AI processing: How this may help iPhone 16 models
Apple acquires Paris-based Datakalab to enhance iPhone 16 with on-device AI tools. iOS 18 to showcase new AI features at WWDC 2024. Datakalab's expert ...
- Apple Buys French AI Firm to Boost Privacy-Focused On-Device Processing
Apple has acquired Datakalab, a French AI firm specializing in on-device processing, aligning with its commitment to enhance privacy and data security. The acquisition underscores Apples strategy to ...