# US 2024/0177406 A1 · Interactive wearable electronic device with facial expression and face recognition and prompting functions and processing method for interactive wearable electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0177406 A1
- Document ID: US20240177406A1
- Status: Published application
- Kind: A1
- Application number: 18/518,527
- Filed: 2023-11-23
- Published: 2024-05-30
- Earliest claimed: 2022-11-25
- Assignees: National Dong Hwa University
- Applicants: National Dong Hwa University
- Inventors: JEN-YEU CHEN; CHIEH-MING YANG; FIRDAUS GOLAM
- Web page: https://patentgrep.com/patent/US20240177406A1

## CPC

- G06T 15/205: {Image-based rendering}
- G02B 27/0101: {characterised by optical features (G02B27/0172 takes precedence)}
- G02B 27/017: {Head mounted}
- G06V 10/82: using neural networks
- G06V 20/20: in augmented reality scenes
- G06V 30/10: Character recognition
- G06V 40/172: {Classification, e.g. identification}
- G06V 40/174: {Facial expression recognition}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An interactive wearable electronic device with facial expression and face recognition and prompting functions and a processing method for the interactive wearable electronic device are provided. The interactive wearable electronic device includes a controller, an image capture device and a display device. The controller detects whether there is a character image among a plurality of captured images. When the plurality of captured images include the character image, the controller performs a face recognition process on the character image to generate a character recognition text. When the plurality of captured images include the character image, the controller performs an emotion recognition process on the character image to provide an emotion image corresponding to the character image.

## Claims

### Claim 1

An interactive wearable electronic device, suitable for being worn on a user, wherein the interactive wearable electronic device comprises facial expression and face recognition and prompting functions, and the interactive wearable electronic device further comprises an artificial intelligence process, the interactive wearable electronic device comprising:
a controller;
an image capture device, electrically connected to the controller and configured to capture a plurality of captured images; and
a display device, electrically connected to the controller and configured to display a plurality of augmented reality images to interact with the user;
wherein the controller detects whether there is a character image among the plurality of captured images through the artificial intelligence process, and when the plurality of captured images comprise the character image, the controller performs a face recognition process on the character image through the artificial intelligence process, to generate a character recognition text, and the controller displays the character recognition text on the display device; and
wherein when the plurality of captured images comprise the character image, the controller performs an emotion recognition process on the character image through the artificial intelligence process, to provide an emotion image corresponding to the character image to be displayed on the display device.

### Claim 2 (depends on 1)

The interactive wearable electronic device according to claim 1, further comprising:
a battery cell, electrically connected to the controller and configured to provide electric energy;
a communication circuit, electrically connected to the controller;
a storage circuit, electrically connected to the controller; and
a loudspeaker, electrically connected to the controller;
wherein the storage circuit comprises an image database configured to store a plurality of acquaintance images.

### Claim 3 (depends on 2)

The interactive wearable electronic device according to claim 2, wherein the character recognition text, the character image and the emotion image are displayed on one side of the display device, and the character recognition text is disposed on one side of the character image.

### Claim 4 (depends on 3)

The interactive wearable electronic device according to claim 3, wherein the controller provides a plurality of sticker images, the user selects one of the plurality of sticker images to be provided on the character image to form an integrated character image, and the controller provides a character audio according to the character image and adds the character audio into the integrated character image.

### Claim 5 (depends on 4)

The interactive wearable electronic device according to claim 4, wherein the plurality of sticker images comprise an eye sticker image, an ear sticker image, a nose sticker image, a beard sticker image, or a body part image.

### Claim 6 (depends on 5)

The interactive wearable electronic device according to claim 5, wherein the user uses a hand part to point to the character image or the integrated character image, and the controller plays the character audio or the integrated character audio through the loudspeaker to notify the user.

### Claim 7 (depends on 6)

The interactive wearable electronic device according to claim 6, wherein the communication circuit is a wireless communication unit connected to a server or a mobile device.

### Claim 8

An interactive wearable electronic device processing method, suitable for an interactive wearable electronic device, wherein the interactive wearable electronic device comprises a controller, a display device and an image capture device, the interactive wearable electronic device processing method comprising the following steps:
using the image capture device to capture a captured image, and detecting, by the controller, whether there is a character image among the captured image through an artificial intelligence process, and when the captured image comprises the character image, performing, by the controller, a character image recognition process on the character image through the artificial intelligence process;
performing, by the controller, a face recognition process on the character image through the artificial intelligence process for character recognition to generate a character recognition text; and
performing, by the controller, an emotion recognition process on the character image through the artificial intelligence process to generate an emotion image corresponding to the character image, and displaying, by the controller, the emotion image, the character image and the character recognition text on the display device.

### Claim 9 (depends on 8)

The interactive wearable electronic device processing method according to claim 8, further comprising the following steps:
capturing, by the controller, a face image of a user through the artificial intelligence process, together with the character image and the emotion image in a same time interval for analysis, to generate an interactive state information.
