US 10,321,123 B2Granted

Gaze correction of multi-view images

AssigneeRealD Spark, LLC

InventorsEric Sommerlade, Michael G. Robinson

Life of this patent

Estimating the term…

Loading patent…

Abstract

Gaze is corrected by adjusting multi-view images of a head. Image patches containing the left and right eyes of the head are identified and a feature vector is derived from plural local image descriptors of the image patch in at least one image of the multi-view images. A displacement vector field representing a transformation of an image patch is derived, using the derived feature vector to look up reference data comprising reference displacement vector fields associated with possible values of the feature vector produced by machine learning. The multi-view images are adjusted by transforming the image patches containing the left and right eyes of the head in accordance with the derived displacement vector field.

Claims15

Dependent claims

A device for adjusting multi-view images of a head to correct gaze, the device comprising an image processor arranged to process the multi-view images of a head by:

in each image, identifying image patches containing the left and right eyes of the head, respectively;
in respect of the image patches containing the left eyes of the head in each image of the multi-view images, and also in respect of the image patches containing the right eyes of the head in each image of the multi-view images, performing the steps of:
deriving a feature vector from plural local image descriptors of the image patch in at least one image of the multi-view images;
and
deriving a displacement vector field representing a transformation of an image patch, using the derived feature vector to look up reference data comprising reference displacement vector fields associated with possible values of the feature vector;
and
adjusting each image of the multi-view images by transforming the image patches containing the left and right eyes of the head in accordance with the derived displacement vector field.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/397,951Filed 4 Jan 2017 · us provisional application
Priority: 5 Jan 2016
Published: US 2017/0195662 A16 Jul 2017
Granted: 11 Jun 2019
Term ends: Not estimatedThe source records don’t support an estimate.

Classification12 codes

G06V 10/62
Extraction of image or video features: relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
G06F 3/011
Input arrangements or combined input and output arrangements for interaction between user and computer: arrangements for interaction with the…
G06F 3/013
Arrangements for interaction with the human body, e.g. for user immersion in virtual reality: eye tracking input arrangements
G06V 10/462
Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient…:…

Family

Application62/274,897Us provisional application · filed 5 Jan 2016
US 2017/0195662 A1Pre-grant publication · published 6 Jul 2017
US 10,321,123 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key