# US 2019/0174189 A1 · Video playing method, video playing device, video playing system, apparatus and computer-readable storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0174189 A1
- Document ID: US20190174189A1
- Status: Published application
- Kind: A1
- Application number: 16/046,130
- Filed: 2018-07-26
- Published: 2019-06-06
- Earliest claimed: 2017-12-04
- Assignees: Boe Technology Group Co., Ltd.
- Applicants: BOE Technology Group Co., Ltd.
- Inventors: Lijie Zhang
- Web page: https://patentgrep.com/patent/US20190174189A1

## CPC

- H04N 21/4666: {using neural networks, e.g. processing the feedback provided by the user}
- G06N 3/045: Combinations of networks
- G06N 3/0499: Feedforward networks
- G06N 3/08: Learning methods
- G06N 3/09: Supervised learning
- G11B 27/102: {Programmed access in sequence to addressed parts of tracks of operating record carriers (access by moving the head G11B3/08, G11B5/54, G11B7/085, G11B21/022; by moving the record carrier G11B15/005, G11B17/005, by driving of both record carrier and head G11B15/1816)}
- G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)}
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- H04N 21/42201: {biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user (input arrangements for interaction with the human body based on nervous system activity detection G06F3/015)}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- H04N 21/4532: {involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)}
- H04N 21/45457: {applied to a time segment}
- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

A video playing method, a video playing device, a video playing system, an apparatus, and a computer-readable storage medium are provided. The video playing method includes dividing a video to be played into a plurality of video segments and labelling, respectively, the plurality of video segments with emotion categories of a user as labels according to a pre-stored correspondence between the emotion categories of the user and video contents, and determining whether each video segment is to be played according to the label of the video segment.

## Claims

### Claim 1

A video playing method, comprising:
dividing a video to be played into a plurality of video segments and labelling, respectively, the plurality of video segments with emotion categories of a user as labels according to a pre-stored correspondence between the emotion categories of the user and video contents, and
determining whether each video segment of the plurality of video segments is to be played according to the label of the video segment.

### Claim 2 (depends on 1)

The video playing method according to claim 1, wherein the emotion categories of the user are determined based on a pre-generated first neural network, and
the first neural network is configured to determine the emotion categories of the user based on physical parameters of the user.

### Claim 3 (depends on 2)

The video playing method according to claim 2, wherein the correspondence between the emotion categories of the user and the video contents comprises a second neural network, and
the second neural network is generated by training with samples of the video contents and samples of the emotion categories of the user output from the first neural network.

### Claim 4 (depends on 2)

The video playing method according to claim 2, wherein the physical parameters of the user comprise facial expression and physiological parameters of the user.

### Claim 5 (depends on 4)

The video playing method according to claim 4, wherein the physiological parameters comprise at least one of heart rate, blood pressure, and blood oxygen.

### Claim 6 (depends on 1)

The video playing method according to claim 1, wherein the video content comprises one frame of image or a video segment comprising a plurality of frames of image.

### Claim 7 (depends on 6)

The video playing method according to claim 6, wherein the video content comprises one frame of image, and the step of dividing a video to be played into a plurality of video segments and labelling, respectively, the plurality of video segments with emotion categories of a user as labels according to a pre-stored correspondence between the emotion categories of the user and video contents, comprises:
according to the pre-stored correspondence between the emotion categories of the user and the video contents, acquiring a plurality of frames of image in the video to be played;
as for each frame of image of the acquired plurality of frames of image, causing the frame of image together with a predetermined number of frames of image immediately before and after the frame of image to be divided into a same video segment; acquiring an emotion category of the user corresponding to the frame of image, and labelling the video segment to which the frame of image belongs with the emotion category of the user as a label,
wherein the video segments have different durations, and there is no overlap between every two video segments.

### Claim 8

A video playing device, comprising:
a video analysis portion configured to divide a video to be played into a plurality of video segments and label, respectively, the plurality of video segments with emotion categories of a user as labels to the plurality of video segments according to a pre-stored correspondence between the emotion categories of the user and video contents; and
a video playing control portion configured to determine whether each video segment of the plurality of video segments is to be played according to the label of the video segment.

### Claim 9 (depends on 8)

The video playing device according to claim 8, further comprising a physical parameter acquisition portion and a first neural network generation and application portion, wherein
the physical parameter acquisition portion is configured to acquire physical parameters of the user, and
the first neural network generation and application portion is configured to generate a first neural network for representing a correspondence between physical parameters of the user and emotion categories of the user by using the acquired physical parameters of the user, and determine emotion categories of the user by using the generated first neural network.

### Claim 10 (depends on 9)

The video playing device according to claim 9, wherein the correspondence between the emotion categories of the user and the video contents comprises a second neural network, and
the second neural network is generated by training with samples of the video contents and samples of the emotion categories of the user output from the first neural network.

### Claim 11 (depends on 9)

The video playing device according to claim 9, wherein the physical parameter acquisition portion comprises:
a face acquisition component configured to acquire facial expression of the user, and
a physiological parameter acquisition component configured to acquire physiological parameters of the user.

### Claim 12 (depends on 11)

The video playing device according to claim 11, wherein the physiological parameter acquisition component comprises a smart wristband.

### Claim 13 (depends on 11)

The video playing device according to claim 11, wherein the physiological parameters comprise at least one of heart rate, blood pressure, and blood oxygen.

### Claim 14 (depends on 8)

The video playing device according to claim 8, wherein the video content is one frame of image or a video segment comprising a plurality of frames of image.

### Claim 15 (depends on 14)

The video playing device according to claim 14, wherein the video content comprises one frame of image,
the video analysis portion is configured to, according to the pre-stored correspondence between the emotion categories of the user and the video contents, acquire a plurality of frames of image in the video to be played, and
the video analysis portion is further configured to, as for each frame of image of the acquired plurality of frames of image, cause the frame of image together with a predetermined number of frames of image immediately before and after the frame of image to be divided into a same video segment, acquire an emotion category of the user corresponding to the frame of image, and label the video segment to which the frame of image belongs with the emotion category of the user as a label, and
the video segments have different durations, and there is no overlap between every two video segments.

### Claim 16 (depends on 8)

A video playing system comprising the video playing device of claim 8.

### Claim 17 (depends on 16)

The video playing system according to claim 16, wherein the video playing device comprises the first neural network for representing the correspondence between physical parameters of the user and emotion categories of the user; and the video playing system further comprises a first offline training component configured to, in an offline state, generate the first neural network by using the physical parameters of the user.

### Claim 18 (depends on 17)

The video playing system according to claim 17, wherein the correspondence between the emotion categories of the user and the video contents comprises a second neural network; and the video playing system further comprises a second offline training component configured to, in the offline state, generate a second neural network by training with samples of the video contents and samples of the emotion categories of the user output from the first neural network.

### Claim 19 (depends on 1)

An apparatus, comprising:
at least one processor, and
a memory for storing at least one program,
wherein the at least one program, when executed by the at least one processor, performs the video playing method of claim 1.

### Claim 20 (depends on 1)

A computer-readable storage medium storing computer programs, wherein the video playing method of claim 1 is implemented when the computer programs are executed by a processor.
