Integral eye-path alignment on telephony and computer video devices using two or more image sensing devices
AssigneeBroadcom Corporation
InventorsDarwin Rambo, Philip Houghton
Life of this patent
Estimating the term…
Abstract
A two-way visual communication system using multiple imaging devices, and a method for operating such a device is described. An embodiment of the present invention may use an image processor to analyze and modify image data from one or more imaging devices, and from the far-end party, in order to improve the perceived level of eye contact experienced by the users. The output signals from the imaging devices may be individually selected for transmission to the far end party, or may be used in combination in the synthesis of a composite image, using information derived from the imaging devices and/or from the image of the far-end party.
Claims31
A two-way visual communication system comprising:
- a visual display device for displaying, at a first location, an image represented by a first signal received from a remote second location;
- an imaging device having a field of view directed at a user of the visual display device, the imaging device producing a second signal for transmission to the remote second location, the second signal representing an image of the user;
- at least one image processor, at the first location, enabling analysis of the first signal to determine a location of a facial feature in the image represented by the first signal, and enabling modification of the second signal based upon the determined location of the facial feature in the image represented by the first signal, wherein the at least one image processor encodes the modified second signal at the first location for transmission to the remote second location;
- and
- wherein the modification of the second signal based upon the determined location of the facial feature in the image represented by the first signal comprises a closed loop optimization of the modification at the first location.
A two-way visual communication system comprising:
- a visual display device for displaying, at a first location, an image represented by a first signal received from a remote second location;
- at least two imaging devices in spaced relation to one another, the at least two imaging devices being arranged so that the fields of view of the at least two imaging devices are directed at a user of the visual display device, each of the at least two imaging devices producing an output signal representative of an image, the output signals collectively forming a plurality of output signals;
- at least one image processor, at the first location, enabling analysis of the first signal to determine a location of a facial feature in the image represented by the first signal, and enabling processing of the plurality of output signals based upon the determined location of the facial feature in the image represented by the first signal, the at least one image processor producing, from the plurality of output signals for transmission to the remote second location, a second signal representative of an image of the user, wherein the at least one image processor encodes the second signal at the first location for transmission to the remote second location;
- and
- wherein producing, from the plurality of output signals for transmission to the remote second location, the second signal representative of the image of the user comprises performing a closed loop optimization at the first location.
A method of operating a two-way visual communication system comprising:
- receiving, at a first location from a remote second location, a first signal representing a first image;
- processing, at the first location, the first signal to determine a location of a facial feature in the first image;
- converting, at the first location, a second image to a second signal;
- modifying the second signal based upon the determined location of the facial feature in the first image;
- and encoding the modified second signal at the first location for transmission to the remote second location, and
- performing a closed optimization of the modification of the second signal at the first location.
A method of operating a two-way visual communication system comprising:
- receiving, at a first location from a remote second location, a first signal representing a first image of a user at the remote second location;
- processing, at the first location, the first signal to determine a location of a facial feature in the first image;
- converting a plurality of images of a user at the first location into a plurality of output signals;
- generating a second signal representing an image of the user at the first location based upon the plurality of output signals and the determined location of the facial feature in the first image;
- encoding the second signal at the first location for transmission to the remote second location, and
- performing a closed loop optimization of the modification of the second signal at the first location.
A machine-readable storage, having stored thereon a computer program having at least one code section for implementing a two-way visual communication system, the at least one code section executable by a machine for causing the machine to perform the operations comprising:
- receiving, at a first location from a remote second location, a first signal representing a first image;
- processing, at the first location, the first signal to determine a location of a facial feature in the first image;
- converting, at the first location, a second image to a second signal;
- modifying the second signal based upon the determined location of the facial feature in the first image;
- encoding the modified second signal at the first location for transmission to the remote second location, and
- wherein the at least one code section is executable by the machine to cause the machine to perform a closed loop optimization of the modification of the second signal at the first location.
A machine-readable storage, having stored thereon a computer program having at least one code section for implementing a two-way visual communication system, the at least one code section executable by a machine for causing the machine to perform the operations comprising:
- receiving, at a first location from a remote second location, a first signal representing a first image of a user at the remote second location;
- processing, at the first location, the first signal to determine a location of a facial feature in the first image;
- converting a plurality of images of a user at the first location into a plurality of output signals;
- generating a second signal representing an image of the user at the first location based upon the plurality of output signals and the determined location of the facial feature in the first image;
- encoding the second signal at the first location for transmission to the remote second location, and
- wherein the at least one code section is executable by the machine to cause the machine to perform a closed loop optimization of the modification of the second signal at the first location.
Dependencies are inferred from the claim text.