# US 2004/0017504 A1 · Automated stroboscoping of video sequences

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2004/0017504 A1
- Document ID: US20040017504A1
- Status: Published application
- Kind: A1
- Application number: 09/828,028
- Filed: 2001-04-06
- Published: 2004-01-29
- Earliest claimed: 2000-04-07
- Assignees: Inmotion Technologies AB
- Inventors: Paolo Prandoni; Emmanuel Reusens; Martin Vetterli; Luciano Sbaiz; Serge Ayer
- Web page: https://patentgrep.com/patent/US20040017504A1

## CPC

- H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)}
- H04N 5/2625: {for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect (sequence generated by event triggered capturing H04N7/188)}
- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Standard video footage even from a single video camera can be used to obtain, in an automated fashion, a stroboscope sequence of a sports event, for example. The sequence may be represented as a static images of a photographic nature, or by a video sequence in which camera motion remains present, in which case the video sequence can be rendered as a panning camera movement on a stroboscope picture or as an animated stroboscope sequence in which the moving object leaves a trailing trace of copies along its path. Multiple cameras can be used for an expanded field of view or for comparison of multiple sequences, for example.

## Claims

### Claim 1

A computer method for rendering a stroboscopic representation from images in a video sequence, comprising the steps of:
(a) separating the images into a background portion and a foreground portion, resulting in a background sequence and a foreground sequence;
(b) selecting from the foreground sequence at least one feature to be included in the stroboscopic sequence, resulting in a foreground selected sequence;
(c) synthesizing the background sequence and the foreground selected sequence, resulting in a synthesized sequence; and
(d) rendering the stroboscopic representation from the synthesized sequence.

### Claim 2 (depends on 1)

The method of claim 1, wherein the images are from a fixed field of view.

### Claim 3 (depends on 1)

The method of claim 1, wherein separating comprises estimating camera motion in making the video sequence.

### Claim 4 (depends on 1)

The method of claim 1, wherein separating comprises using camera parameters in making the video sequence.

### Claim 5 (depends on 4)

The method of claim 4, wherein the camera parameters have been obtained by sensors.

### Claim 6 (depends on 1)

The method of claim 1, wherein selecting is at a fixed frame interval.

### Claim 7 (depends on 1)

The method of claim 1, wherein selecting is at clocked time intervals.

### Claim 8 (depends on 1)

The method of claim 1, wherein selecting is at specified background locations.

### Claim 9 (depends on 1)

The method of claim 1, wherein selecting is at specified foreground events.

### Claim 10 (depends on 1)

The method of claim 1, wherein selecting comprises accepting input for the feature to be selected.

### Claim 11 (depends on 1)

The method of claim 1, wherein synthesizing comprises choosing a field of view for the stroboscopic representation.

### Claim 12 (depends on 11)

The method of claim 11, wherein the field of view is the same as original field of view.

### Claim 13 (depends on 11)

The method of claim 11, wherein the field of view is greater than original field of view.

### Claim 14 (depends on 13)

The method of claim 13, wherein the field of view encompasses all of a foreground movement.

### Claim 15 (depends on 11)

The method of claim 11, wherein the field of view is less than original field of view.

### Claim 16 (depends on 1)

The method of claim 1, wherein rendering comprises generating the stroboscopic representation as a still image.

### Claim 17 (depends on 16)

The method of claim 16, wherein rendering further comprises converting the still image to video.

### Claim 18 (depends on 17)

The method of claim 17, wherein converting comprises scanning.

### Claim 19 (depends on 18)

The method of claim 18, wherein scanning comprises accepting input for at least one scanning parameter.

### Claim 20 (depends on 19)

The method of claim 19, wherein the scanning parameter is one of scanning direction, scanning speed and focal length.

### Claim 21 (depends on 19)

The method of claim 19, wherein the input is from a joy stick device.

### Claim 22 (depends on 1)

The method of claim 1, wherein rendering comprises generating the stroboscopic representation as a video including multiple representations of at least one foreground feature frozen at triggering instants.

### Claim 23 (depends on 22)

The method of claim 22, wherein rendering further comprises including a trace of the feature between the multiple representations.

### Claim 24 (depends on 1)

The method of claim 1, wherein rendering comprises placing multiple representations of at least one foreground feature against a background, with the representations being spaced apart according to a function of time.

### Claim 25 (depends on 24)

The method of claim 24, wherein the representations are spaced apart on account of their actual spatial travel.

### Claim 26 (depends on 24)

The method of claim 24, wherein the representations are spaced apart other than on account of their spatial travel, spatially unrolling their action.

### Claim 27 (depends on 24)

The method of claim 24, wherein the representations are shown over an actual background.

### Claim 28 (depends on 24)

The method of claim 24, wherein the representations are shown over a synthetic background.

### Claim 29 (depends on 1)

The method of claim 1, wherein rendering comprises controlling foreground feature persistency.

### Claim 30 (depends on 29)

The method of claim 29, wherein controlling is for older representations of a foreground feature as a function of time to appear increasingly transparent.

### Claim 31 (depends on 1)

The method of claim 1, wherein rendering comprises assigning a distinctive brightness/color to at least one foreground feature.

### Claim 32 (depends on 31)

The method of claim 31, wherein the brightness/color is selected as a function of time.

### Claim 33 (depends on 1)

The method of claim 1, wherein rendering comprises 3-dimensional reconstruction of the stroboscopic representation.

### Claim 34 (depends on 1)

The method of claim 1, wherein the video sequence is of a sports event.

### Claim 35 (depends on 1)

The method of claim 1, further comprising broadcasting the stroboscopic representation.

### Claim 36 (depends on 1)

The method of claim 1, further comprising delivering the stroboscopic representation over the Internet.

### Claim 37

A system for rendering a stroboscopic representation from images in a video sequence, comprising:
(a) means for separating the images into a background portion and a foreground portion, resulting in a background sequence and a foreground sequence;
(b) means for selecting from the foreground sequence at least one feature to be included in the stroboscopic sequence, resulting in a foreground selected sequence;
(c) means for synthesizing the background sequence and the foreground selected sequence, resulting in a synthesized sequence; and
(d) means for rendering the stroboscopic representation from the synthesized sequence.

### Claim 38

A system for rendering a stroboscopic representation from images in a video sequence, comprising a processor which is instructed for:
(a) separating the images into a background portion and a foreground portion, resulting in a background sequence and a foreground sequence;
(b) selecting from the foreground sequence at least one feature to be included in the stroboscopic sequence, resulting in a foreground selected sequence;
(c) synthesizing the background sequence and the foreground selected sequence, resulting in a synthesized sequence; and
(d) rendering the stroboscopic representation from the synthesized sequence.
