User interaction method and apparatus, device and medium
AssigneeBeijing Baidu Netcom Science Technology Co., Ltd.
InventorsXiaokun ZHAO, Zhiwei QIN, Kun SONG
Life of this patent
Estimating the term…
Abstract
Provided are a user interaction method and apparatus, a device and a medium, which relates to the field of artificial intelligence. An implementation solution is as follows: acquiring current facial expression information of a user; determining a current smiling level of the user according to the current facial expression information; and performing a corresponding interaction operation according to the current smiling level.
Claims20
A user interaction method, comprising:
- acquiring current facial expression information of a user;
- determining a current smiling level of the user according to the current facial expression information;
- and
- performing a corresponding interaction operation according to the current smiling level.
A user interaction apparatus, comprising:
- an expression acquisition module, which is configured to acquire current facial expression information of a user;
- a level determination module, which is configured to determine a current smiling level of the user according to the current facial expression information;
- and
- an operation performing module, which is configured to perform a corresponding interaction operation according to the current smiling level.
The electronic device of 11, wherein determining the current smiling level of the user according to the current facial expression information comprises:
- determining a current expression coefficient according to the current facial expression information;
- and
- determining the current smiling level of the user according to the current expression coefficient.
The electronic device of 13, wherein determining the current smiling level of the user according to the current expression coefficient comprises:
- acquiring a starting smiling threshold corresponding to the user;
- and
- determining the current smiling level of the user according to the current expression coefficient and the starting smiling threshold.
The electronic device of 14, wherein acquiring the starting smiling threshold corresponding to the user comprises:
- acquiring historical expression coefficients of the user;
- training a smiling threshold recognition model corresponding to the user by using the historical expression coefficients;
- and
- acquiring the starting smiling threshold corresponding to the user according to a training result of the smiling threshold recognition model, wherein the training result comprises expression coefficient ranges of at least two smiling classifications.
The electronic device of 15, wherein acquiring the starting smiling threshold corresponding to the user according to the training result of the smiling threshold recognition model comprises:
- determining a smiling classification having a smallest expression coefficient value in the training result as a normal expression classification;
- and
- determining a maximum value in an expression coefficient range corresponding to the normal expression classification as the starting smiling threshold corresponding to the user.
The electronic device of 14, wherein determining the current smiling level of the user according to the current expression coefficient and the starting smiling threshold comprises:
- determining level value intervals corresponding to at least two preset smiling levels according to the starting smiling threshold;
- and
- determining the current smiling level of the user according to the current expression coefficient and the level value intervals corresponding to the at least two preset smiling levels.
The electronic device of 13, wherein determining the current expression coefficient according to the current facial expression information comprises:
- inputting the current facial expression information into an expression recognition model to obtain the current expression coefficient outputted.
The electronic device of 11, wherein acquiring the current facial expression information of the user comprises:
- capturing, by an augmented reality (AR) engine, facial expression data of the user in real time at a set frequency as the current facial expression information of the user.
The electronic device of 11, wherein performing the corresponding interaction operation comprises at least one of:
- displaying a corresponding like effect picture;
- or
- performing corresponding user feedback information statistics.
Dependencies are inferred from the claim text.