Information processing device and information processing method
AssigneeSony Corporation
InventorsYasuhiro Takeda, Takeshi Fujiki, Junichiro Takagi
Life of this patent
Estimating the term…
Abstract
There is provided an information processing device that includes a communication unit that acquires a moving image being subjected to live distribution as well as manipulation information including a manipulation position concerning location of a sticker on the moving image being displayed on a display unit of a device and information concerning the sticker to be located. The information processing device further includes a control unit that analyzes a region corresponding to the manipulation position on the moving image, and performs processing of locating the sticker on the moving image on a basis of an analysis result and the manipulation information.
Claims17
An information processing device, comprising:
- at least one processor configured to:
- acquire, from a device, a moving image, manipulation information, and specific information, wherein
- the moving image is subjected to live distribution,
- the moving image is associated with acoustic information that includes a sound wave,
- the acquired manipulation information includes a manipulation position corresponding to a location of a sticker on the moving image,
- the moving image is displayed on a display screen of the device, and
- the specific information corresponds to the sticker to be located;
- analyze a region corresponding to the manipulation position on the moving image;
- execute, based on the analyzed region and the acquired manipulation information, a first image processing operation to locate the sticker at a first position on the moving image,
- wherein the first position of the located sticker overlaps an object in the moving image;
- recognize a motion of the object in the moving image;
- change the first position of the located sticker to a second position based on the recognized motion of the object in the moving image,
- wherein the second position of the located sticker does not overlap the object in the moving image;
- change a size of the located sticker based on a magnitude of the sound wave;
- divide a time period corresponding to the moving image into a plurality of segments;
- set, based on a time-series distribution of an amount of the acquired manipulation information, at least one segment of the plurality of segments as an extraction segment, wherein
- the amount of the acquired manipulation information corresponds to a number of tapping operations on the moving image, and
- the amount of the acquired manipulation information in the extraction segment is greater than a threshold value;
- and
- generate a highlight movie image based on the extraction segment.
An information processing method, comprising:
- in an information processing device that comprises at least one processor:
- acquiring, by the at least one processor, a moving image that is subjected to live distribution from a device,
- wherein the moving image is associated with acoustic information that includes a sound wave;
- acquiring, by the at least one processor, manipulation information including a manipulation position corresponding to a location of a sticker on the moving image,
- wherein the moving image is displayed on a display screen of the device;
- acquiring, by the at least one processor, specific information corresponding to the sticker to be located;
- analyzing, by the at least one processor, a region corresponding to the manipulation position on the moving image;
- executing, by the at least one processor based on the analyzed region and the acquired manipulation information, an image processing operation to locate the sticker at a first position on the moving image,
- wherein the first position of the located sticker overlaps an object in the moving image;
- recognizing, by the at least one processor, a motion of the object in the moving image;
- changing, by the at least one processor, the first position of the located sticker to a second position based on the recognized motion of the object in the moving image,
- wherein the second position of the located sticker does not overlap the object in the moving image;
- changing, by the at least one processor, a size of the located sticker based on a magnitude of the sound wave;
- dividing, by the at least one processor, a time period corresponding to the moving image into a plurality of segments;
- setting, by the at least one processor based on a time-series distribution of an amount of the acquired manipulation information, at least one segment of the plurality of segments as an extraction segment, wherein
- the amount of the acquired manipulation information corresponds to a number of tapping operations on the moving image, and
- the amount of the acquired manipulation information in the extraction segment is greater than a threshold value;
- and
- generating, by the at least one processor, a highlight movie image based on the extraction segment.
A non-transitory computer-readable medium having stored thereon, computer-executable instructions which when executed by a computer, cause the computer to execute operations, the operations comprising:
- generating first display information for display of a first moving image on a display screen of the computer,
- wherein the first moving image is associated with acoustic information that includes a sound wave;
- detecting a manipulation on the first moving image displayed on the display screen;
- generating manipulation information and specific information, based on the manipulation detected on the first moving image;
- transmitting the manipulation information and the specific information to a server, wherein
- the manipulation information includes a manipulation position corresponding to a location of a sticker on the first moving image, and
- the specific information corresponds to the sticker to be located on the first moving image;
- receiving a second moving image from the server;
- generating second display information for display of the second moving image on the display screen of the computer, wherein
- an image processing operation is executed on the first moving image, by the server, to locate the sticker at a first position on the first moving image based on an analysis result and the manipulation information, and
- the first position of the located sticker overlaps an object in the first moving image;
- and
- recognizing a motion of the object in the first moving image, wherein
- the analysis result is obtained by analyzing a region on the first moving image,
- the region corresponds to the manipulation position acquired by the server from the computer,
- a position of the located sticker is changed from the first position to a second position by the server based on the recognized motion of the object in the first moving image,
- the second position of the located sticker does not overlap the object in the first moving image,
- a size of the located sticker is changed by the server based on a magnitude of the sound wave,
- a time period corresponding to the first moving image is divided into a plurality of segments by the server,
- at least one segment of the plurality of segments is set, by the server, as an extraction segment based on a time-series distribution of an amount of the manipulation information,
- the amount of the manipulation information corresponds to a number of tapping operations on the first moving image,
- the amount of the manipulation information in the extraction segment is greater than a threshold value, and
- a highlight movie image is generated by the server based on the extraction segment.
Dependencies are inferred from the claim text.