# US 2016/0254024 A1 · System and method for spatiotemporal image fusion and integration

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0254024 A1
- Document ID: US20160254024A1
- Status: Published application
- Kind: A1
- Application number: 14/805,710
- Filed: 2015-07-22
- Published: 2016-09-01
- Earliest claimed: 2015-02-27
- Assignees: Xerox Corporation
- Applicants: Xerox Corporation
- Inventors: Hao Wu; Robert P. Loce
- Web page: https://patentgrep.com/patent/US20160254024A1

## CPC

- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G06V 20/47: {Detecting features for summarising video content}
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A system and method for creating a spatiotemporal image representation with information content that enables accurate and rapid processing for several applications.

## Claims

### Claim 1

A computer implemented method for processing a sequence of images comprising:
acquiring a sequence of images, the images related to each other by a common parameter;
extracting multiple 1D signals from at least one image of the of the sequence of images;
stacking the 1D signals to form multiple 1D signal vs common parameter stacks;
applying a joint transform with at least two 1D signal vs common parameter stacks as input; and
outputting at least one transformed signal vs. common parameter stack.

### Claim 2 (depends on 1)

The computer implemented method of claim 1, wherein acquiring a sequence of images includes acquiring video comprising a plurality of temporally related images, wherein the common parameter is time.

### Claim 3 (depends on 1)

The computer implemented method of claim 1, wherein acquiring a sequence of images includes acquiring a plurality of images of a physical location taken from a plurality of vantage points, at least two of the images including common features of the physical location , wherein the common parameter is space.

### Claim 4 (depends on 1)

The computer implemented method of claim 1, wherein applying the joint transform includes using a multiple input, multiple output function, wherein the multiple inputs include multiple 1D signal vs common parameter stacks.

### Claim 5 (depends on 1)

The computer implemented method of claim 1, further comprising redefining at least one of the 1D signal vs common parameter stacks into RGB color channels, transferring the RGB color channels to HSV, and normalizing V to suppress global illumination fluctuation.

### Claim 6 (depends on 1)

The computer implemented method of claim 1, further comprising performing temporal noise reduction on the at least one 1D signal vs common parameter stack.

### Claim 7 (depends on 6)

The computer implemented method of claim 6, further comprising performing spatial noise reduction on the at least one 1D signal vs common parameter stack.

### Claim 8 (depends on 7)

The computer implemented method of claim 7, further comprising performing preprocessing of the at least one 1D signal vs common parameter stacks.

### Claim 9 (depends on 1)

The computer implemented method of claim 1, further comprising generating a plurality of 1D signal vs common parameter stacks, each 1D signal vs common parameter stacks comprised of lines of data extracted from the same location in each image of the sequence of images.

### Claim 10

A system for processing a sequence of images, the system comprising a memory in communication with a processor configured to:
acquire a sequence of images, the images related to each other by a common parameter;
extract multiple 1D signals from at least one image of the of the sequence of images;
stack the 1D signals to form multiple 1D signal vs common parameter stacks;
apply a joint transform with at least two 1D signal vs common parameter stacks as input; and
output at least one transformed signal vs. common parameter stack.

### Claim 11 (depends on 10)

The system of claim 10, wherein the processor is further configured to acquire video comprising a plurality of temporally related images, wherein the common parameter is time.

### Claim 12 (depends on 10)

The system of claim 10, wherein the processor is further configured to acquire a plurality of images of a physical location taken from a plurality of vantage points, at least two of the images including common features of the physical location, wherein the common parameter is space.

### Claim 13 (depends on 10)

The system of claim 10, wherein the processor is further configured to apply the joint transform including using a multiple input, multiple output function, wherein the multiple inputs include multiple 1D signal vs common parameter stacks.

### Claim 14 (depends on 10)

The system of claim 10, wherein the processor is further configured to redefine at least one of the 1D signal vs common parameter stacks into RGB color channels, transfer the RGB color channels to HSV, and normalize V to suppress global illumination fluctuation.

### Claim 15 (depends on 10)

The system of claim 10, wherein the processor is further configured to perform temporal noise reduction on the at least one 1D signal vs common parameter stack.

### Claim 16 (depends on 10)

The system of claim 10, wherein the processor is further configured to perform spatial noise reduction on the at least one 1D signal vs common parameter stack.

### Claim 17 (depends on 10)

The system of claim 10, wherein the processor is further configured to perform preprocessing of the at least one 1D signal vs common parameter stacks.

### Claim 18 (depends on 10)

The system of claim 10, wherein the processor is further configured to generate a plurality of 1D signal vs common parameter stacks, each 1D signal vs common parameter stacks comprised of lines of data extracted from the same location in each image of the sequence of images.
