# US 7,613,999 B2 · Navigable telepresence method and systems utilizing an array of cameras

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 7,613,999 B2
- Document ID: US7613999B2
- Status: Granted
- Kind: B2
- Application number: 11/359,233
- Filed: 2006-02-21
- Published: 2006-07-06
- Granted: 2009-11-03
- Earliest claimed: 1998-04-02
- Assignees: Kewazinga Corp.
- Inventors: Andrew H. Weber; David C. Worley; Scott Soroken
- Web page: https://patentgrep.com/patent/US7613999B2

## CPC

- H04N 7/157: {defining a virtual conference space and using avatars or agents (computer conference optimisation or adaptation H04L12/1827)}
- G03B 37/04: with cameras or projectors providing touching or overlapping fields of view
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0354: with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- H04N 5/262: Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects}
- H04N 5/2624: {for obtaining an image which is composed of whole input images, e.g. splitscreen}
- H04N 5/2627: {for providing spin image effect, 3D stop motion effect or temporal freeze effect (2D image animation in general G06T13/80)}
- H04N 5/265: Mixing
- H04N 7/142: {Constructional details of the terminal equipment, e.g. arrangements of the camera and the display}
- H04N 7/15: Conference systems
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 7/185: {from a mobile camera, e.g. for remote control}
- H04N 13/167: Synchronising or controlling image signals
- H04N 13/189: Recording image signals; Reproducing recorded image signals
- H04N 13/194: Transmission of image signals
- H04N 13/204: using stereoscopic image cameras (stereoscopic photography G03B35/00)
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 13/243: using three or more two-dimensional [2D] image sensors
- H04N 13/296: Synchronisation thereof; Control thereof
- H04N 23/58: Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
- H04N 13/246: Calibration of cameras
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A telepresence system for providing first and second users with displays of an environment. The system includes an array of cameras, and the array includes multiple camera paths. A first user interface device is associated with first user inputs and movement along a first path, and a second user interface device is associated with second user inputs and a second path. The user interface devices are coupled to at least one processing element that receives and interprets the user inputs. The processing element is configured to allow the first user and the second user to navigate simultaneously and independently and also configured to link the users and provide the same path in response to an indication or input to do so.

## Claims

### Claim 1

A telepresence system for providing a first user with a first display of an environment and a second user with a second display of the environment, the system comprising:
an array of cameras, each camera having an associated view of the environment and an associated camera output representing the associated view, the array including multiple camera paths;
a first user interface device associated with the first user and first user inputs associated with movement along a first path in the array;
a second user interface device associated with the second user and second user inputs associated with movement along a second path in the array; and
at least one processing element coupled to the user interface devices for receiving user inputs, the processing element configured to interpret received first user inputs and select outputs of cameras in the first path and interpret received second user inputs and select outputs of cameras in the second path independently of the first inputs, thereby allowing the first user and second user to navigate simultaneously and independently through the array, the processing element further configured to, in response to an indication to link users, provide to both the first user interface device and the second user interface device camera outputs of cameras in the first path in response to the first user inputs, thereby linking the users and allowing the first user to guide navigation through the array.

### Claim 2 (depends on 1)

The system of claim 1 where in the system further includes a memory storing additional source output, wherein the user inputs include an indication of viewing the additional source output, and the processing element is further configured to mix camera output and the additional source output upon receiving the indication to view the additional source output by mosaicing the camera output and the additional source output.

### Claim 3 (depends on 2)

The system of claim 2 wherein the additional source output includes output from the group of outputs including: computer graphic imagery, virtual world imagery, applets, film clips, and animation.

### Claim 4 (depends on 1)

The system of claim 1 wherein the at least one processor is further configured to, in response to an indication to unlink users, provide the first user interface device camera outputs of cameras in the first path and provide the second user interface device camera outputs of cameras in the second path, thereby unlinking the users.