# US 2008/0260347 A1 · Temporal occlusion costing applied to video editing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0260347 A1
- Document ID: US20080260347A1
- Status: Published application
- Kind: A1
- Application number: 11/789,201
- Filed: 2007-04-23
- Published: 2008-10-23
- Earliest claimed: 2007-04-23
- Assignees: Hewlett-Packard Development Company, L.P.
- Inventors: Simon Widdowson
- Web page: https://patentgrep.com/patent/US20080260347A1

## CPC

- G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

In a method for determining a temporal occlusion cost for a video crop, video image saliency data for a video is received. A video crop is received for a presenting an edited version of the video within a viewing region. The video image saliency data is used to determine a temporal occlusion cost for the video crop.

## Claims

### Claim 1

A method for determining a temporal occlusion cost for a video crop, said method comprising:
receiving video image saliency data for a video;
receiving a video crop for a presenting an edited version of said video within a viewing region; and
utilizing said video image saliency data to determine a temporal occlusion cost for said video crop.

### Claim 2 (depends on 1)

The method as recited in claim 1, wherein said receiving video image saliency data for a video comprises:
receiving a video image saliency map for said video.

### Claim 3 (depends on 2)

The method as recited in claim 2, wherein said receiving a video image saliency map for said video comprises:
receiving a plurality of grayscale saliency maps, each of said grayscale saliency maps providing image saliency information for a frame of said video.

### Claim 4 (depends on 1)

The method as recited in claim 1, wherein said receiving video image saliency data for a video comprises:
utilizing a user-specified saliency parameter to control generation of said video image saliency data; and
receiving said video image saliency data, wherein said video image saliency data is generated according to said user-specified image saliency parameter.

### Claim 5 (depends on 1)

The method as recited in claim 1, wherein said receiving a video crop for a presenting an edited version of said video within a viewing region comprises:
utilizing a user-specified video cropping constraint to control generation of said video crop; and
receiving said video crop, wherein said video crop is generated according to said user-specified video cropping constraint.

### Claim 6 (depends on 1)

The method as recited in claim 1, wherein said receiving a video crop for a presenting an edited version of said video within a viewing region comprises:
receiving video crop comprising an aspect ratio conversion of said video.

### Claim 7 (depends on 1)

The method as recited in claim 1, wherein said receiving a video crop for a presenting an edited version of said video within a viewing region comprises:
receiving a cuboidal volume of voxels defined within a three-dimensional space, said three-dimensional space defined by a height and a width of a frame of said video along with a running time of said video.

### Claim 8 (depends on 7)

The method as recited in claim 7, wherein said receiving a cuboidal volume of voxels defined within a three-dimensional space comprises:
receiving said cuboidal volume of voxels, wherein cross-sectional areas of said cuboidal volume remain fixed over time.

### Claim 9 (depends on 7)

The method as recited in claim 7, wherein said receiving a cuboidal volume of voxels defined within a three-dimensional space comprises:
receiving said cuboidal volume of voxels, wherein cross-sectional areas of said cuboidal volume vary over time.

### Claim 10 (depends on 1)

The method as recited in claim 1, wherein said utilizing said video image saliency data to determine a temporal occlusion cost for said video crop comprises:
determining a value which represents said temporal occlusion cost, wherein said value varies in accordance with saliency eliminated by said video crop, video frame area eliminated by said video crop, and video running time removed by said video crop.

### Claim 11

A computer-readable medium having computer-executable instructions stored thereon for causing a computer system to execute a method for cropping a video, said method comprising:
receiving video image saliency data for a video;
receiving a plurality of video crops, each of said plurality of video crops comprising a possible presentation of an edited version of said video within a viewing region;
utilizing said video image saliency data to determine a plurality of temporal occlusion costs, each of said temporal occlusion costs associated with one of said plurality of possible video crops;
determining a video crop associated with a lowest temporal occlusion cost of said plurality of temporal occlusion costs; and
cropping said video in accordance with said video crop associated with said lowest temporal occlusion cost.

### Claim 12 (depends on 11)

The computer readable medium of claim 11, wherein said receiving video image saliency data for a video to comprises:
receiving a video image saliency map for said video.

### Claim 13 (depends on 12)

The computer readable medium claim 12, wherein said receiving a video image saliency map for said video comprises:
receiving a plurality of grayscale saliency maps, each of said grayscale saliency maps providing image saliency information for a frame of said video.

### Claim 14 (depends on 11)

The computer readable medium claim 11, wherein said receiving video image saliency data for a video further comprises:
utilizing a user-specified saliency parameter to control generation of said video image saliency data; and
receiving said video image saliency data, wherein said video image saliency data is generated according to said user-specified image saliency parameter.

### Claim 15 (depends on 11)

The computer readable medium claim 11, wherein said receiving a plurality of video crops further comprises:
utilizing a user-specified video cropping constraint to control generation of said video crops; and
receiving said video crops, wherein said video crops are generated according to said user-specified video cropping constraint.

### Claim 16 (depends on 11)

The computer readable medium claim 11, wherein said receiving a plurality of video crops comprises:
receiving a cuboidal volume of voxels defined within a three-dimensional space, said three-dimensional space defined by a height and a width of a frame of said video along with a running time of said video, wherein said cuboidal volume of voxels represents one of said plurality of video crops.

### Claim 17 (depends on 1)

The computer readable medium claim 1l, wherein said utilizing said video image saliency data to determine a plurality of temporal occlusion costs comprises:
determining values for temporal occlusion costs associated with a plurality of said video crops, wherein a value of said values varies in accordance with saliency eliminated by said video crop, video frame area eliminated by said video crop, and video running time eliminated by said video crop.

### Claim 18

A system for determining a temporal occlusion cost for a video crop, said system comprising:
an video image saliency receiver configured for receiving video image saliency data associated with a video;
a video crop receiver configured for receiving a video crop to said video; and
a temporal occlusion cost generator coupled to said video image saliency receiver and said video crop receiver, said temporal occlusion cost generator configured for utilizing said video image saliency data to determine a temporal occlusion cost associated with said video crop.

### Claim 19 (depends on 18)

The system of claim 18 further comprising:
a cost minimization engine coupled to said temporal occlusion cost generator, said cost minimization engine configured for selecting a minimized temporal occlusion cost from a plurality of temporal occlusion costs associated with a plurality of video crops evaluated by said temporal occlusion cost generator.

### Claim 20 (depends on 18)

The system of claim 18 further comprising:
a video image saliency generator controller coupled to said video image saliency receiver, wherein said video image saliency generator controller incorporates a user-specifiable image saliency parameter for controlling generation of said video image saliency data; and
a video crop generator controller coupled to said video crop receiver, wherein said video crop generator controller incorporates a user-specifiable video cropping constraint for controlling generation of said video crop.
