# US 8,570,358 B2 · Automated wireless three-dimensional (3D) video conferencing via a tunerless television device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,570,358 B2
- Document ID: US8570358B2
- Status: Granted
- Kind: B2
- Application number: 12/661,372
- Filed: 2010-03-16
- Published: 2011-05-12
- Granted: 2013-10-29
- Earliest claimed: 2009-11-06
- Assignees: Sony Corporation
- Applicants: Xiangpeng Jing; Aravind Asam; Dipendu Saha; Seungwook Hong; Aixin Liu; Yang Yu; Andy Nguyen; Abhishek Patil; Diung Nguyen
- Inventors: Xiangpeng Jing; Aravind Asam; Dipendu Saha; Seungwook Hong; Aixin Liu; Yang Yu; Andy Nguyen; Abhishek Patil; Diung Nguyen
- Web page: https://patentgrep.com/patent/US8570358B2

## CPC

- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 7/17318: {Direct or substantially direct transmission and handling of requests}
- H04N 13/194: Transmission of image signals
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/4347: {Demultiplexing of several video streams}
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- H04N 21/6125: {involving transmission via Internet (transmission by internet of broadcast information H04H60/82)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Automated wireless three-dimensional (3D) video conferencing is provided using a tunerless television device. A 3D video conference is automatically established with a wireless device capable of 3D video conferencing using a wireless communication interface of the tunerless television device. A first and a second two-dimensional (2D) video stream are received, using a camera interface module, from a first and a second video camera associated with the tunerless television device. A merged 3D video stream is created from the first 2D video stream and the second 2D video stream using a 3D video offload processing module operatively coupled to the camera interface module. The merged 3D video stream is sent to the wireless device using the wireless communication interface. This abstract is not to be considered limiting, since other embodiments may deviate from the features described in this abstract.

## Claims

### Claim 1

A method of automated wireless three-dimensional (3D) video conferencing via a tunerless television device, comprising:
automatically establishing, via a wireless communication interface of the tunerless television device, a 3D video conference with a wireless device capable of 3D video conferencing, where in being programmed to automatically establishing, the processor is programmed to:
receive, at the tunerless television device, a text message from the wireless device;
determine whether the text message is from a user within a contact list associated with the tunerless television device that is authorized for automated 3D video conferencing; and
automatically establish the 3D video conference in response to determining that the text message is from the user within the contact list associated with the tunerless television device that is authorized for automated 3D video conferencing;
receiving, via a camera interface module, a first and a second two-dimensional (2D) video stream from a first and a second video camera associated with the tunerless television device;
creating, via a 3D video offload processing module operatively coupled to the camera interface module, a merged 3D video stream from the first 2D video stream and the second 2D video stream, where a computation that produces the 3D video stream is carried out in a user space application or a hardware module; and
sending the merged 3D video stream to the wireless device via the wireless communication interface.

### Claim 2 (depends on 1)

The method according to claim 1, further comprising:
receiving a 3D video stream from the wireless device;
processing the received 3D video stream; and
rendering the processed 3D video stream via a display associated with the tunerless television device.

### Claim 3 (depends on 1)

The method according to claim 1, where the automatically established 3D video conference comprises a 3D video conference established over a wireless mesh network connection between the tunerless television device and the wireless device.

### Claim 4 (depends on 1)

The method according to claim 1, where automatically establishing, via the wireless communication interface of the tunerless television device, the 3D video conference with the wireless device capable of 3D video conferencing comprises:
detecting, via a wireless connection associated with the wireless communication interface, the wireless device;
initiating 3D video conferencing initiation signaling with the wireless device; and
receiving 3D video conferencing confirmation signaling from the wireless device.

### Claim 5 (depends on 1)

The method according to claim 1, further comprising providing a default display screen via a display of the tunerless television device, where the default display screen comprises an option for 3D video conferencing.

### Claim 6 (depends on 5)

The method according to claim 5, further comprising:
receiving a request to customize the default display screen with an Internet address for default access to content available via the Internet address; and
adding the Internet address to the default display screen.

### Claim 7 (depends on 1)

The method according to claim 1, further comprising sending an indication of at least one service available via the tunerless television device via the wireless interface to the wireless device.

### Claim 8 (depends on 7)

The method according to claim 7, further comprising:
receiving a request from the wireless device to use one of the at least one of the service available via the tunerless television device; and
allowing the wireless device to use the one of the at least one of the service available via the tunerless television device.

### Claim 9 (depends on 1)

The method according to claim 1, further comprising:
receiving an indication from a telephone answering device via the wireless communication interface that a telephone voice mail is available for a user of the tunerless television device;
retrieving the telephone voice mail from the telephone answering device via the wireless communication interface; and
generating an audio output signal of the telephone voice mail via an audio output device associated with the tunerless television device.

### Claim 10 (depends on 1)

The method according to claim 1, further comprising:
receiving, during the 3D video conference, text message content from the wireless device associated with the 3D video conference; and
displaying the text message content via a display associated with the tunerless television device.

### Claim 11 (depends on 10)

The method according to claim 10, further comprising:
detecting an indication to reply to the text message content received from the wireless device associated with the 3D video conference;
detecting text input from a wireless text input device associated with the tunerless television device; and
sending the text input as a text message to the wireless device associated with the 3D video conference.

### Claim 12 (depends on 1)

The method according to claim 1, further comprising:
detecting, during the 3D video conference, a selection of a contact from a contact list;
detecting text input from a wireless text input device associated with the tunerless television device; and
sending the text input as a text message to a wireless device associated with the selected contact during the 3D video conference.

### Claim 13 (depends on 1)

The method according to claim 1, further comprising:
receiving, during the 3D video conference, text message content from a wireless device other than the wireless device associated with the 3D video conference; and
displaying the text message content via a display associated with the tunerless television device.

### Claim 14 (depends on 13)

The method according to claim 13, further comprising:
detecting an indication to reply to the text message content received from the wireless device other than the wireless device associated with the 3D video conference;
detecting text input from a wireless text input device associated with the tunerless television device; and
sending the text input as a text message to the wireless device other than the wireless device associated with the 3D video conference.

### Claim 15 (depends on 1)

The method according to claim 1, further comprising:
receiving audio input via an audio input device associated with the tunerless television device;
processing the received audio input using noise cancellation; and
sending the processed audio input to the wireless device.

### Claim 16 (depends on 1)

The method according to claim 1, further comprising detecting a request via a user remote control to switch from a 3D video conference mode to a 2D video conference mode, and switching the tunerless television device from the 3D video conference mode to the 2D video conference mode.

### Claim 17 (depends on 1)

The method according to claim 1, where the merged 3D video stream comprises one of frame sequential 3D video content and polarized 3D video content.

### Claim 18 (depends on 1)

The method according to claim 1, where the wireless communication interface comprises one of a cellular wireless communication interface and a Bluetooth wireless communication interface.

### Claim 19 (depends on 1)

A computer readable tangible non-transitory storage medium storing instructions which, when executed on one or more programmed processors, carry out a method according to claim 1.

### Claim 20

An apparatus for automated wireless three-dimensional (3D) video conferencing comprising:
a wireless communication interface;
a camera interface module;
a first and a second video camera;
a 3D video offload processing module operatively coupled to the camera interface module; and
a processor programmed to:
automatically establish, via the wireless communication interface, a 3D video conference with a wireless device capable of 3D video conferencing, where the 3D video conference is automatically established by:
receiving, at the tunerless television device, a text message from the wireless device;
determining whether the text message is from a user within a contact list associated with the tunerless television device that is authorized for automated 3D video conferencing; and
automatically establishing the 3D video conference in response to determining that the text message is from the user within the contact list associated with the tunerless television device that is authorized for automated 3D video conferencing;
receive, via the camera interface module, a first and a second two-dimensional (2D) video stream from the first and the second video camera;
create, via the 3D video offload processing module, a merged 3D video stream from the first 2D video stream and the second 2D video stream, where a computation that produces the 3D video stream is carried out in a user space application or a hardware module; and
send the merged 3D video stream to the wireless device via the wireless communication interface.

### Claim 21 (depends on 20)

The apparatus according to claim 20, further comprising:
a display; and
where the processor is further programmed to:
receive a 3D video stream from the wireless device;
process the received 3D video stream; and
render the processed 3D video stream via the display.

### Claim 22 (depends on 20)

The apparatus according to claim 20, where, in being programmed to automatically establish, via the wireless communication interface, the 3D video conference with the wireless device capable of 3D video conferencing, the processor is programmed to automatically establish, via the wireless communication interface, the 3D video conference with the wireless device capable of 3D video conferencing over a wireless mesh network connection.

### Claim 23 (depends on 20)

The apparatus according to claim 20, further comprising:
a display; and
where the processor is further programmed to provide a default display screen via the display, where the default display screen comprises an option for 3D video conferencing.

### Claim 24 (depends on 23)

The apparatus according to claim 23, where the processor is further programmed to:
receive a request to customize the default display screen with an Internet address for default access to content available via the Internet address; and
add the Internet address to the default display screen.

### Claim 25 (depends on 20)

The apparatus according to claim 20, where the processor is further programmed to send an indication of at least one service available via the wireless communication interface to the wireless device.

### Claim 26 (depends on 25)

The apparatus according to claim 25, where the processor is further programmed to:
receive a request from the wireless device to use one of the at least one of the service available via the wireless communication interface; and
allow the wireless device to use the one of the at least one of the service available via the wireless communication interface.

### Claim 27 (depends on 20)

The apparatus according to claim 20, further comprising:
an audio output device; and
where the processor is further programmed to:
receive an indication from a telephone answering device via the wireless communication interface that a telephone voice mail is available for a user;
retrieve the telephone voice mail from the telephone answering device via the wireless communication interface; and
generate an audio output signal of the telephone voice mail via the audio output device.

### Claim 28 (depends on 20)

The apparatus according to claim 20, further comprising:
a display; and
where the processor is further programmed to:
receive, during the 3D video conference, text message content from the wireless device associated with the 3D video conference; and
display the text message content via the display.

### Claim 29 (depends on 28)

The apparatus according to claim 28, where the processor is further programmed to:
detect an indication to reply to the text message content received from the wireless device associated with the 3D video conference;
detect text input from a wireless text input device; and
send the text input as a text message to the wireless device associated with the 3D video conference.

### Claim 30 (depends on 20)

The apparatus according to claim 20, where the processor is further programmed to:
detect, during the 3D video conference, a selection of a contact from a contact list;
detect text input from a wireless text input device; and
send the text input as a text message to a wireless device associated with the selected contact during the 3D video conference.

### Claim 31 (depends on 20)

The apparatus according to claim 20, further comprising:
a display; and
where the processor is further programmed to:
receive, during the 3D video conference, text message content from a wireless device other than the wireless device associated with the 3D video conference; and
display the text message content via the display.

### Claim 32 (depends on 31)

The apparatus according to claim 31, where the processor is further programmed to:
detect an indication to reply to the text message content received from the wireless device other than the wireless device associated with the 3D video conference;
detect text input from a wireless text input device; and
send the text input as a text message to the wireless device other than the wireless device associated with the 3D video conference.

### Claim 33 (depends on 20)

The apparatus according to claim 20, further comprising:
an audio input device comprising noise cancellation circuitry; and
where the processor is further programmed to:
receive audio input via the audio input device;
process the received audio input using the noise cancellation circuitry; and
send the processed audio input to the wireless device.

### Claim 34 (depends on 20)

The apparatus according to claim 20, where the processor is further programmed to:
detect a request via a user remote control to switch from a 3D video conference mode to a 2D video conference mode; and
switch from the 3D video conference mode to the 2D video conference mode.

### Claim 35 (depends on 20)

The apparatus according to claim 20, where the merged 3D video stream comprises one of frame sequential 3D video content and polarized 3D video content.

### Claim 36 (depends on 20)

The apparatus according to claim 20, where the wireless communication interface comprises one of a cellular wireless communication interface and a Bluetooth wireless communication interface.