# US 2024/0267534 A1 · Detection of amount of judder in videos

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0267534 A1
- Document ID: US20240267534A1
- Status: Published application
- Kind: A1
- Application number: 18/432,918
- Filed: 2024-02-05
- Published: 2024-08-08
- Earliest claimed: 2023-02-06
- Assignees: Disney Enterprises, Inc.
- Applicants: Disney Enterprises, Inc.
- Inventors: Christopher Richard Schroers; Blake Sloan; Mitchel Jacobs; Scott Labrozzi; Shinobu Hattori; Felix Klose
- Web page: https://patentgrep.com/patent/US20240267534A1

## CPC

- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- H04N 19/137: Motion inside a coding unit, e.g. average field, frame or block difference
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method receives a video. The method analyzes information for a pixel of a frame in the video to determine a first value and a second value for the pixel. The first value is based on an image structure formed by the pixel in the frame and the second value is based on interframe motion of the image structure at the pixel. A third value is determined for an amount of judder based on the first value and the second value. The method outputs the third value to evaluate the video.

## Claims

### Claim 1

A method comprising:
receiving, by a computing device, a video;
analyzing, by the computing device, information for a pixel of a frame in the video to determine a first value and a second value for the pixel, wherein the first value is based on an image structure formed by the pixel in the frame and the second value is based on interframe motion of the image structure at the pixel;
determining, by the computing device, a third value for an amount of judder based on the first value and the second value; and
outputting, by the computing device, the third value to evaluate the video.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining the third value for the amount of judder comprises:
using a function that represents a relationship based on the first value and the second value to determine the amount of judder.

### Claim 3 (depends on 2)

The method of claim 2, wherein:
the first value comprises a magnitude of an intensity change of the pixel,
the second value comprises the interframe motion of the image structure at the pixel, and
the function represents a relationship between the magnitude of the intensity change and the interframe motion.

### Claim 4 (depends on 3)

The method of claim 3, wherein:
the amount of judder is determined based on an intersection of the magnitude of the intensity change and the interframe motion using the function.

### Claim 5 (depends on 3)

The method of claim 3, wherein:
the amount of judder varies non-linearly based on the magnitude of the intensity change and the interframe motion.

### Claim 6 (depends on 1)

The method of claim 1, wherein:
the first value comprises a first change of a characteristic in a direction of the interframe motion of the image structure at the pixel, and
the second value comprises a second change in the interframe motion of the image structure at the pixel.

### Claim 7 (depends on 1)

The method of claim 1, wherein determining the first value comprises:
determining a combination of an image gradient and the interframe motion of the image structure at the pixel to generate a magnitude of an intensity change in a direction of motion.

### Claim 8 (depends on 7)

The method of claim 7, wherein the image gradient comprises a difference of a characteristic between the pixel and another pixel.

### Claim 9 (depends on 1)

The method of claim 1, wherein:
the frame comprises a first frame, and
the interframe motion comprises a difference of a position of the pixel in the first frame and a second frame.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
analyzing a plurality of pixels of the frame to determine respective first values for the image structure and respective second values for the interframe motion for the plurality of pixels;
determining a plurality of third values for the amount of judder based on the respective first value and the respective second value for the plurality of pixels; and
determining a fourth value for the plurality of pixels using the plurality of third values.

### Claim 11 (depends on 10)

The method of claim 10, wherein the fourth value represents the amount of judder for a portion of the video.

### Claim 12 (depends on 11)

The method of claim 11, wherein:
the frame comprises a first frame,
the portion of the video comprises the first frame, and
one or more other fourth values is determined for one or more other frames.

### Claim 13 (depends on 1)

The method of claim 1, wherein another pixel in another frame that includes interframe motion that is parallel to a direction of the interframe motion is not analyzed for an amount of judder.

### Claim 14 (depends on 1)

The method of claim 1, further comprising:
determining an amount of judder for other frames;
identifying a portion of the video based on the amount of judder determined for the frame and the other frames; and
performing a judder mitigation process on the portion of the video to mitigate the amount of judder.

### Claim 15 (depends on 1)

The method of claim 1, further comprising:
determining an amount of judder for frames of the video, wherein the amount of judder for the frame is based on the amount of judder for the pixel;
comparing the amount of judder for the frames of the video to a threshold;
determining a portion of the video that meets the threshold; and
performing a judder mitigation process on the portion of the video.

### Claim 16 (depends on 15)

The method of claim 15, wherein performing the judder mitigation process comprises:
determining a setting for the judder mitigation process based on the amount of judder for frames of the portion of the video; and
performing the judder mitigation process using the setting.

### Claim 17

A non-transitory computer-readable storage medium having stored thereon computer executable instructions, which when executed by a computing device, cause the computing device to be operable for:
receiving a video;
analyzing information for a pixel of a frame in the video to determine a first value and a second value for the pixel, wherein the first value is based on an image structure formed by the pixel in the frame and the second value is based on interframe motion of the image structure at the pixel;
determining a third value for an amount of judder based on the first value and the second value; and
outputting the third value to evaluate the video.

### Claim 18 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, wherein determining the amount of judder comprises:
using a function that represents a relationship based on the first value and the second value to determine the amount of judder.

### Claim 19 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, wherein:
the first value comprises a magnitude of an intensity change in a direction of the interframe motion of the image structure at the pixel, and
the second value comprises the interframe motion of the image structure at the pixel.

### Claim 20

An apparatus comprising:
one or more computer processors; and
a computer-readable storage medium comprising instructions for controlling the one or more computer processors to be operable for:
receiving a video;
analyzing information for a pixel of a frame in the video to determine a first value and a second value for the pixel, wherein the first value is based on an image structure formed by the pixel in the frame and the second value is based on interframe motion of the image structure at the pixel;
determining a third value for an amount of judder based on the first value and the second value; and
outputting the third value to evaluate the video.
