# US 2008/0187047 A1 · Video compression system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0187047 A1
- Document ID: US20080187047A1
- Status: Published application
- Kind: A1
- Application number: 11/873,051
- Filed: 2007-10-16
- Published: 2008-08-07
- Earliest claimed: 2006-10-17
- Assignees: Harman Becker Automotive Systems GmbH
- Inventors: Martin Stephan; Ulrich Mohr
- Web page: https://patentgrep.com/patent/US20080187047A1

## CPC

- H04N 19/527: Global motion vector estimation
- H04N 19/61: in combination with predictive coding
- H04N 19/137: Motion inside a coding unit, e.g. average field, frame or block difference
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A video compression system processes images captured from a video camera mounted to a vehicle. Vehicle-mounted sensors generate vehicle motion information corresponding to a current state of motion of the vehicle. An optical flow estimation circuit estimates apparent motion of objects within a visual field. A video encoder circuit in communication with the optical flow estimation circuit compresses the video data from the video camera based on the estimated apparent motion.

## Claims

### Claim 1

A video compression system comprising:
a video camera mounted to or in a vehicle, and configured to generate video data;
at least one sensor configured to generate vehicle motion information corresponding to a current state of motion of the vehicle;
an optical flow estimation circuit configured to generate an estimated apparent motion of objects within a visual field of the video camera; and
a video encoder circuit in communication with the optical flow estimation circuit, and configured to compress the video data in accordance with the estimated apparent motion.

### Claim 2 (depends on 1)

The system of claim 1, where the optical flow estimation circuit comprises:
a motion reconstruction circuit configured to reconstruct the current state of motion of the vehicle;
the reconstruction based on the vehicle motion information provided by the sensor; and
where the estimated apparent motion is determined in accordance with the reconstructed state of motion of the vehicle.

### Claim 3 (depends on 1)

The system of claim 1, where the estimated apparent motion includes qualitative information indicating a type of flow field.

### Claim 4 (depends on 1)

The system of claim 1, where the estimated apparent motion includes a vector field representation.

### Claim 5 (depends on 1)

The system of claim 1, where the video encoder circuit comprises:
a model circuit configured to generate motion vectors indicating motion within the video data, the motion vectors determined based on the estimated apparent motion; and
a predictive coding circuit configured generate predicted video data based on the motion vectors, and configured to determine differences between the video data and predicted video data.

### Claim 6 (depends on 5)

The system of claim 5, where the model circuit generates the motion vectors by searching a predefined search range of possible motion vectors.

### Claim 7 (depends on 6)

The system of claim 6, where the model circuit determines a search range based on the estimated apparent motion.

### Claim 8 (depends on 6)

The system of claim 6, where the model circuit determines a starting value for searching the motion vectors based on the estimated apparent motion.

### Claim 9 (depends on 5)

The system of claim 5, where the video encoder circuit comprises a segmentation circuit configured to partition video images into blocks, and where the model circuit determines motion vectors for each block based on the estimated apparent motion and a location of the block within the video image.

### Claim 10 (depends on 1)

The system of claim 1, where the video encoder circuit compresses the video data according to an MPEG (Motion Picture Experts Group) format.

### Claim 11 (depends on 1)

The system of claim 1, where the at least one sensor comprises a tachometer, an accelerometer, an angular sensor, a distance sensor, a gyroscope, a compass, or a GPS receiver.

### Claim 12 (depends on 1)

The system of claim 1, where the vehicle motion information includes velocity, direction of motion, linear acceleration, or radial acceleration.

### Claim 13 (depends on 1)

The system of claim 1, further comprising a digital communication bus to facilitate communication between the sensors and the video encoder circuit.

### Claim 14 (depends on 13)

The system of claim 13, comprising:
a video decoder configured to decode the compressed video information; and
a display device in communication with the decoder, where the display device is configured to display the decoded compressed video data.

### Claim 15 (depends on 13)

The system of claim 13, comprising a recording device in communication with the video encoder circuit through the communication bus, where the recording device is configured to store the compressed video data.

### Claim 16

A video compression system for vehicles, comprising:
a video camera mounted to or in the vehicle, the camera configured to generate video data;
at least one sensor configured to generate vehicle motion information corresponding to a current state of motion of the vehicle;
an optical flow estimation circuit configured to generate an estimated apparent motion of objects within a visual field of the video camera;
a video encoder circuit in communication with the optical flow estimation circuit, and configured to compress the video data in accordance with the estimated apparent motion; and
the video encoder circuit further comprising
a model circuit configured to generate motion vectors indicating motion within the video data, the motion vectors determined based on the estimated apparent motion; and
a predictive coding circuit configured generate predicted video data based on the motion vectors, and configured to determine differences between the video data and predicted video data.

### Claim 17

A method for compressing video data generated by a video camera mounded in or on a vehicle, the method comprising:
providing vehicle motion information corresponding to a current state of motion of the vehicle;
estimating an apparent motion of objects within a visual field of the video camera based on the vehicle motion information; and
compressing the video data based on the estimated apparent motion.

### Claim 18 (depends on 17)

The method of claim 17, comprising:
providing sensor data corresponding to the vehicle motion information;
reconstructing the current state of motion of the vehicle based on the sensor data; and
where estimating the apparent motion of objects is based on the reconstructed current state of motion of the vehicle.

### Claim 19 (depends on 17)

The method of claim 17, where estimating the apparent motion of objects generates qualitative information indicating a type of flow field.

### Claim 20 (depends on 17)

The method of claim 17, where estimating the apparent motion of objects generates vector field representation information.

### Claim 21 (depends on 17)

The method of claim 17 comprising:
determining motion vectors indicative of motion within a subsequent video image, the motion vectors determined based on the estimated apparent motion of objects within the visual field of the camera; and
predictively coding differences between the video data and video images predicted from the motion vectors.

### Claim 22 (depends on 21)

The method of claim 21, comprising determining the motion vectors by searching a predefined search range of possible motion vectors.

### Claim 23 (depends on 22)

The method of claim 22, comprising determining the motion vectors by establishing a search range in accordance with the estimated apparent motion.

### Claim 24 (depends on 22)

The method of claim 22, comprising:
segmenting a video image into a plurality of data blocks; and
determining motion vectors for each block in accordance with the estimated apparent motion and a location of the block within the video image.

### Claim 25

A method for compressing video data generated by a video camera mounted in or on a vehicle, the method comprising:
segmenting a video image into a plurality of data blocks;
providing vehicle motion information corresponding to a current state of motion of the vehicle;
reconstructing the current state of motion of the vehicle based on the vehicle motion information;
estimating an apparent motion of objects within a visual field of the video camera based on the vehicle motion information and the reconstructed current state of motion of the vehicle;
determining motion vectors for each block in accordance with the estimated apparent motion and a location of the block within the video image; and
compressing the video data based on the motion vectors.
