# US 2022/0036427 A1 · Method for managing immersion level and electronic device supporting same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0036427 A1
- Document ID: US20220036427A1
- Status: Published application
- Kind: A1
- Application number: 17/298,421
- Filed: 2019-11-20
- Published: 2022-02-03
- Earliest claimed: 2018-11-30
- Inventors: Dang Chan OH
- Web page: https://patentgrep.com/patent/US20220036427A1

## CPC

- G06Q 30/0631: {Recommending goods or services}
- A61B 5/00: Measuring for diagnostic purposes (radiation diagnosis A61B6/00; diagnosis by ultrasonic, sonic or infrasonic waves A61B8/00); Identification of persons
- A61B 5/16: Devices for psychotechnics (using teaching or educational appliances G09B1/00 - G09B7/00); Testing reaction times {; Devices for evaluating the psychological state}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships}
- G06V 40/176: {Dynamic expression}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An electronic device including a display, a camera, and a processor is proposed. The processor may be set to activate the camera while outputting a content-playback screen on the display when a playback of content is requested, obtain a face-related image of a user by using the activated camera, extract eye-blink information, information on a change in outer corners of eyes and information on a change in corners of mouth from the face-related image, and calculate an immersion level of the user with the content on the basis of the eye-blink information, the information on the change in outer corners of eyes, and the information on the change in corners of mouth.

## Claims

### Claim 1

An electronic device comprising:
a display for outputting content;
a camera for collecting a user-related image; and
a processor functionally connected to the display and the camera,
wherein the processor is set to activate the camera while outputting a content-playback screen on the display when a playback of the content is requested, obtain a face-related image of a user by using the activated camera, extract eye-blink information, information on a change in outer corners of eyes, and information on a change in corners of mouth from the face-related image, and calculate an immersion level of the user with the content on the basis of the eye-blink information, the information on the change in outer corners of eyes, and the information on the change in corners of mouth.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the processor is set to calculate an immersion-level score on the basis of the eye-blink information, generate emotion information of the user on the basis of the information on the change in outer corners of eyes and the information on the change in corners of mouth, and correct the immersion-level score on the basis of the emotion information.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein the processor is set to increase the immersion-level score calculated on the basis of the eye-blink information by a specified value when the emotion information indicates an interested emotional state.

### Claim 4 (depends on 2)

The electronic device of claim 2, wherein the processor is set to lower the immersion-level score calculated on the basis of the eye-blink information by a specified value when the emotion information indicates an expressionless state.

### Claim 5 (depends on 1)

The electronic device of claim 1, further comprising:
a communication circuit for establishing a communication channel with a service device for providing the content.

### Claim 6 (depends on 5)

The electronic device of claim 5, wherein the processor is set to transmit an immersion-level score to the service device through the communication circuit, receive a content recommendation list generated on the basis of the immersion-level score from the service device, and output the received content recommendation list on the display.

### Claim 7

A method for managing an immersion level, the method comprising:
receiving a playback request of content by a terminal device;
activating the camera while outputting a content-playback screen according to the playback request of the content;
obtaining a face-related image of a user by using the activated camera;
calculating the immersion level of the user for the content on the basis of the face-related image;
providing information of the calculated immersion level to a designated service device; and
outputting a content recommendation list by receiving the content recommendation list, which is generated on the basis of the information of the immersion level, from the service device.

### Claim 8 (depends on 7)

The method of claim 7, wherein the calculating of the immersion level comprises:
extracting eye-blink information, information on a change in outer corners of eyes and information on a change in corners of mouth from the face-related image;
calculating an immersion-level score on the basis of the eye-blink information;
generating emotion information of the user on the basis of the information on the change in outer corners of eyes and the information on the change in corners of mouth; and
correcting the immersion-level score on the basis of the emotion information.

### Claim 9 (depends on 8)

The method of claim 8, wherein the correcting of the immersion-level score comprises:
increasing the immersion-level score calculated on the basis of the eye-blink information by a specified value when the emotion information indicates an interested emotional state; or
lowering the immersion-level score calculated on the basis of the eye-blink information by the specified value when the emotion information indicates an expressionless state.

### Claim 10

A service device comprising:
a server communication circuit; and
a server processor functionally connected to the server communication circuit,
wherein the server processor is set to establish a communication channel with a terminal device by using the server communication circuit, provide specified content to the terminal device in response to a request of the terminal device, receive immersion-level information of a user related to the specified content from the terminal device, generate a content recommendation list on the basis of the immersion-level information, and transmit the content recommendation list to the terminal device.

### Claim 11 (depends on 10)

The service device of claim 10, wherein the server processor is set such that the higher the immersion-level score is, the higher a user rating for the content is, and the lower the immersion-level score is, the lower the user rating for the content is.

### Claim 12 (depends on 11)

The service device of claim 11, wherein the server processor is set to search for other users who have given a same user rating for the content, search for the content in which ratings respectively given by the other users are greater than or equal to a specified value, and generate the content recommendation list on the basis of the searched content.
