# US 2014/0198178 A1 · Methods and Systems for Creating Swivel Views From a Handheld Device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0198178 A1
- Document ID: US20140198178A1
- Status: Published application
- Kind: A1
- Application number: 13/743,439
- Filed: 2013-01-17
- Published: 2014-07-17
- Earliest claimed: 2013-01-17
- Assignees: Google Inc.
- Inventors: Sergey Ioffe; Christian Frueh
- Web page: https://patentgrep.com/patent/US20140198178A1

## CPC

- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H04N 5/262: Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects}
- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

Examples of methods and systems for creating swivel views from handheld video are described. In some examples, a method may be performed by a handheld device to receive or capture a video of a target object and the video may include a plurality of frames and content of the target object from a plurality of viewpoints. The device may determine one or more approximately corresponding frames of the video including content of the target object from a substantially matching viewpoint and may align the approximately corresponding frames of the video based on one or more feature points of the target object to generate an aligned video. The device may provide sampled frames from multiple viewpoints from the aligned video, configured for viewing the target object in a rotatable manner, such as in a swivel view format.

## Claims

### Claim 1

A method, comprising:
receiving a video of a target object, wherein the video includes a plurality of frames, and wherein the video includes content representing a plurality of images of the target object from a plurality of viewpoints;
determining one or more approximately corresponding frames of the video including content of the target object from a substantially matching viewpoint, wherein a first of the one or more approximately corresponding frames is from a first portion of the video and a second of the one or more approximately corresponding frames is from another portion of the video;
aligning the one or more approximately corresponding frames of the video to generate an aligned video;
sampling frames of the aligned video to select frames from multiple viewpoints of the plurality of viewpoints; and
providing the sampled frames configured for viewing the target object in a rotatable manner.

### Claim 2 (depends on 1)

The method of claim 1, wherein receiving the video comprises receiving the video from a mobile device configured for handheld use.

### Claim 3 (depends on 1)

The method of claim 1, wherein the plurality of viewpoints include one or more viewpoints from circling 360 degrees around the target object.

### Claim 4 (depends on 1)

The method of claim 1, wherein sampling frames of the aligned video to select frames from multiple viewpoints of the plurality of viewpoints comprises selecting frames at approximately evenly spaced degrees of rotation from the plurality of viewpoints.

### Claim 5 (depends on 1)

The method of claim 1, further comprising providing the sampled frames configured for viewing such that a view of the target object is based on a received input to a viewer.

### Claim 6 (depends on 1)

The method of claim 1, wherein providing the sampled frames configured for viewing the target object in the rotatable manner comprises providing the sampled frames configured for viewing in a swivel view format.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
determining one or more feature points of the target object in the plurality of frames, wherein the one or more feature points include distinct pixels capable of being tracked across the plurality of frames; and
based on an amount of movement of the one or more feature points across the plurality of frames, determining one or more transformation parameters applicable to adjust the video to be substantially focused on the target object.

### Claim 8

A non-transitory computer readable medium having stored therein instructions executable by a computing device to cause the computing device to perform functions, the functions comprising:
receiving a video of a target object, wherein the video includes a plurality of frames, and wherein the video includes content representing a plurality of images of the target object from a plurality of viewpoints;
determining one or more approximately corresponding frames of the video including content of the target object from a substantially matching viewpoint, wherein a first of the one or more approximately corresponding frames is from a first portion of the video and a second of the one or more approximately corresponding frames is from another portion of the video;
aligning the one or more approximately corresponding frames of the video to generate an aligned video;
sampling frames of the aligned video to select frames from multiple viewpoints of the plurality of viewpoints; and
providing the sampled frames configured for viewing the target object in a rotatable manner.

### Claim 9 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the functions further comprise receiving the video from a mobile device configured for handheld use.

### Claim 10 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the plurality of viewpoints include one or more viewpoints from about 360 degrees around the target object.

### Claim 11 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the function of sampling frames of the aligned video to select frames from multiple viewpoints of the plurality of viewpoints further comprises selecting frames at approximately evenly spaced degrees of rotation from the plurality of viewpoints.

### Claim 12 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the functions further comprise providing the sampled frames configured for viewing such that a view of the target object is based on a received input to a viewer.

### Claim 13 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the function of providing the sampled frames configured for viewing the target object in the rotatable manner further comprises providing the sampled frames configured for viewing in a swivel view format.

### Claim 14 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the functions further comprise:
determining one or more feature points of the target object in the plurality of frames, wherein the one or more feature points include distinct pixels capable of being tracked across the plurality of frames; and
based on an amount of movement of the one or more feature points across the plurality of frames, determining one or more transformation parameters applicable to adjust the video to be substantially focused on the target object.

### Claim 15

A system, comprising:
at least one processor; and
data storage comprising program instructions executable by the at least one processor to cause the at least one processor to perform functions comprising:
receiving a video of a target object, wherein the video includes a plurality of frames, and wherein the video includes content representing a plurality of images of the target object from a plurality of viewpoints;
determining one or more approximately corresponding frames of the video including content of the target object from a substantially matching viewpoint, wherein a first of the one or more approximately corresponding frames is from a first portion of the video and a second of the one or more approximately corresponding frames is from another portion of the video;
aligning the one or more approximately corresponding frames of the video to generate an aligned video;
sampling frames of the aligned video to select frames from multiple viewpoints of the plurality of viewpoints; and
providing the sampled frames configured for viewing the target object in a rotatable manner.

### Claim 16 (depends on 15)

The system of claim 15, wherein the functions further comprise receiving the video from a mobile telephone that includes a camera and processor configured for obtaining video content.

### Claim 17 (depends on 15)

The system of claim 15, wherein the plurality of viewpoints include one or more viewpoints from circling 360 degrees around the target object.

### Claim 18 (depends on 15)

The system of claim 15, wherein the function of sampling frames of the aligned video to select frames from multiple viewpoints of the plurality of viewpoints comprises selecting frames at approximately evenly spaced degrees of rotation from the plurality of viewpoints.

### Claim 19 (depends on 15)

The system of claim 15, wherein the functions further comprise providing the sampled frames configured for viewing such that a view of the target object is based on a received input to a viewer.

### Claim 20 (depends on 15)

The system of claim 15, wherein the functions further comprise:
determining one or more feature points of the target object in the plurality of frames, wherein the one or more feature points include distinct pixels capable of being tracked across the plurality of frames; and
based on an amount of movement of the one or more feature points across the plurality of frames, determining one or more transformation parameters applicable to adjust the video to be substantially focused on the target object.
