# US 2019/0356912 A1 · Information processing apparatus, information processing method and computer-readable recording medium having stored program therein

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0356912 A1
- Document ID: US20190356912A1
- Status: Published application
- Kind: A1
- Application number: 16/367,332
- Filed: 2019-03-28
- Published: 2019-11-21
- Earliest claimed: 2018-05-18
- Assignees: Fujitsu Limited
- Applicants: Fujitsu Limited
- Inventors: Hidenobu MIYOSHI
- Web page: https://patentgrep.com/patent/US20190356912A1

## CPC

- H04N 19/107: between spatial and temporal predictive coding, e.g. picture refresh
- H04N 19/177: the unit being a group of pictures [GOP]
- H04N 19/139: Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
- H04N 19/172: the region being a picture, frame or field
- H04N 19/179: the unit being a scene or a shot
- H04N 19/577: Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An information processing apparatus includes: a memory; and a processor coupled to the memory and the processor configured to by using image data of an image to be subjected to temporal scalable coding, obtain a motion vector for the image, based on the motion vector, determine whether an image group to be encoded is a still scene, when the image group is determined to be the still scene, add an offset value to an intra-prediction encoding cost of the image included in the image group, based on an intra-prediction encoding cost to which the offset value is added, select an inter-prediction mode in which a predictive image of the image included in the image group is generated by inter-prediction, and by utilizing image data of the predictive image, perform an encoding process on the image data of the image included in the image group.

## Claims

### Claim 1

An information processing apparatus comprising:
a memory; and
a processor coupled to the memory and the processor configured to:
by using image data of an image to be subjected to temporal scalable coding, obtain a motion vector for the image,
based on the motion vector, determine whether an image group to be encoded is a still scene,
when the image group is determined to be the still scene, add an offset value to an intra-prediction encoding cost of the image included in the image group,
based on an intra-prediction encoding cost to which the offset value is added, select an inter-prediction mode in which a predictive image of the image included in the image group is generated by inter-prediction, and
by utilizing image data of the predictive image, perform an encoding process on the image data of the image included in the image group.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1,
wherein the processor is further configured to
determine whether the image is an image corresponding to a picture at a shallowest level in terms of a unit representing an encoding order and a reference relationship of a picture in temporal scalable coding,
when the image is an image corresponding to the picture at the shallowest level, obtain a motion vector for the image, and
based on the motion vector, determine whether the image group is a still scene.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2,
wherein the picture at the shallowest level is a picture with temporary identification (TID) “0” in a structure of pictures (SOP) in temporal scalable coding.

### Claim 4 (depends on 1)

The information processing apparatus according to claim 1,
wherein the processor is further configured to
when the image group is determined to be the still scene, calculate the offset value greater than “0”, and when image group is determined to be not the still scene, set the offset value to “0”.

### Claim 5 (depends on 4)

The information processing apparatus according to claim 4,
wherein the processor is configured to
generate the predictive image by the inter-prediction and, by using the image to be subjected to temporal scalable coding and the predictive image, calculate sum of absolute difference of the image with respect to the predictive image, and
calculate the offset value based on the sum of absolute difference.

### Claim 6 (depends on 5)

The information processing apparatus according to claim 5,
wherein the processor is configured to
calculate the sum of absolute difference on a per-prediction block basis in the image, and
calculate the offset value based on the sum of absolute difference.

### Claim 7 (depends on 5)

The information processing apparatus according to claim 5,
wherein the processor is configured to
calculate the sum of absolute difference for one image on a per-prediction block basis in the image, and
based on mean sum of absolute difference obtained by averaging the sum of absolute difference by the number of prediction blocks corresponding to one image, calculate the offset value.

### Claim 8 (depends on 5)

The information processing apparatus according to claim 5,
wherein the image group is a plurality of images included in a structure of pictures (SOP) in temporal scalable coding, and
wherein the processor is configured to
calculate, in the SOP, the sum of absolute difference between a plurality of images one or a plurality of SOPs preceding the image to be subjected to temporal scalable coding with temporary identification (TID) at the same level as the image to be subjected to temporal scalable coding and the image to be subjected to temporal scalable coding, or the sum of absolute difference between a plurality of images a plurality of SOPs preceding the image to be subjected to temporal scalable coding in the same encoding order as the image to be subjected to temporal scalable coding, and
based on a mean of the sum of absolute difference, calculate the offset value.

### Claim 9 (depends on 5)

The information processing apparatus according to claim 5,
wherein the image group is a plurality of images included in a structure of pictures (SOP) in temporal scalable coding, and
wherein the processor is configured to
calculate, in the SOP, the sum of absolute difference between a plurality of images with temporary identification (TID) “0” and the image to be subjected to temporal scalable coding, and
based on a mean of the sum of absolute difference, calculate the offset value.

### Claim 10 (depends on 4)

The information processing apparatus according to claim 4,
wherein the processor is configured to
when the image group is determined to be the still scene, calculate the offset value greater than “0” for all images included in the image group, and
add the offset value to an intra-prediction encoding cost of the all images included in the image group.

### Claim 11 (depends on 1)

The information processing apparatus according to claim 1,
wherein the processor is configured to
by using a predictive image generated in the inter-prediction mode, calculate an inter-prediction encoding cost, and
based on the intra-prediction encoding cost to which the offset value is added, and the inter-prediction encoding cost, select the inter-prediction mode in which a predictive image of the image included in the image group is generated by inter prediction or an intra-prediction mode in which a predictive image of the image included in the image group is generated by intra-prediction.

### Claim 12

An information processing method executed by a computer, comprising:
by using image data of an image to be subjected to temporal scalable coding, obtaining a motion vector for the image,
based on the motion vector, determining whether an image group to be encoded is a still scene,
when the image group is determined to be the still scene, adding an offset value to an intra-prediction encoding cost of the image included in the image group,
based on an intra-prediction encoding cost to which the offset value is added, selecting an inter-prediction mode in which a predictive image of the image included in the image group is generated by inter-prediction, and
by utilizing image data of the predictive image, performing an encoding process on the image data of the image included in the image group.

### Claim 13

A non-transitory computer-readable recording medium storing therein a program for causing a computer to execute a process, the process comprising:
by using image data of an image to be subjected to temporal scalable coding, obtaining a motion vector for the image,
based on the motion vector, determining whether an image group to be encoded is a still scene,
when the image group is determined to be the still scene, adding an offset value to an intra-prediction encoding cost of the image included in the image group,
based on an intra-prediction encoding cost to which the offset value is added, selecting an inter-prediction mode in which a predictive image of the image included in the image group is generated by inter-prediction, and
by utilizing image data of the predictive image, performing an encoding process on the image data of the image included in the image group.
