Image processing device, image processing method, and program
AssigneeSony Corporation
InventorsHideki Shimomura, Takayuki Yoshigahara, Yoshihiro Wakita, Seiji Kobayashi
Life of this patent
Estimating the term…
Abstract
There is provided an image processing device including a recognition unit that recognizes exercise of a person reflected in an input image, and a display control unit that superimposes on the input image a virtual object varying according to effectiveness of the exercise recognized by the recognition unit. The image processing device further includes a score calculation unit that calculates a score denoting the effectiveness of the exercise recognized by the recognition unit, and the display control unit superimposes on the input image the virtual object representing greatness of the score calculated by the score calculation unit.
Claims18
An image processing device comprising:
- a processor device that:
- recognizes exercise of a person reflected in an input image, by determining a section on a time axis of frames included in a series of input images to which the input image corresponds;
- determines, for each section of a plurality of sections on the time axis corresponding to a recognized exercise, whether to calculate a score denoting effectiveness of the exercise recognized based on whether or not at least one frame thereof includes a predetermined pose such that (i) a respective score is to be calculated when the at least one frame thereof includes the predetermined pose and (ii) the respective score is not to be calculated when the at least one frame thereof does not include the predetermined pose;
- calculates the score when a determination result indicates that the score is to be calculated;
- and
- superimposes on the input image a virtual object varying according to the effectiveness of the exercise recognized.
An image processing method comprising:
- recognizing exercise of a person reflected in an input image, by determining a section on a time axis of frames included in a series of input images to which the input image corresponds;
- determining, for each section of a plurality of sections on the time axis corresponding to a recognized exercise, whether to calculate a score denoting effectiveness of the exercise recognized based on whether or not at least one frame thereof includes a predetermined pose such that (i) a respective score is to be calculated when the at least one frame thereof includes the predetermined pose and (ii) the respective score is not to be calculated when the at least one frame thereof does not include the predetermined pose;
- calculating the score when a determination result indicates that the score is to be calculated;
- and
- superimposing on the input image a virtual object varying according to the effectiveness of the recognized exercise.
A non-transitory recording medium on which a program is recorded for causing a computer controlling an image processing device to function as:
- a recognition unit that recognizes exercise of a person reflected in an input image, by determining a section on a time axis of frames included in a series of input images to which the input image corresponds;
- a score calculation unit that determines, for each section of a plurality of sections on the time axis corresponding to a recognized exercise, whether to calculate a score denoting effectiveness of the exercise recognized based on whether or not at least one frame thereof includes a predetermined pose such that (i) a respective score is to be calculated when the at least one frame thereof includes the predetermined pose and (ii) the respective score is not to be calculated when the at least one frame thereof does not include the predetermined pose;
- a calculation unit to calculate the score when a determination result from the score calculation unit indicates that the score is to be calculated;
- and
- a display control unit that superimposes on the input image a virtual object varying according to the effectiveness of the exercise recognized by the recognition unit.
Dependencies are inferred from the claim text.