Back to results
US 9,870,119 B2Granted
Computing apparatus and method for providing three-dimensional (3D) interaction
AssigneeSamsung Electronics Co., Ltd.
InventorsDong Kyung Nam, Hyoseok Hwang, Jingu Heo
Life of this patent
Estimating the term…
Abstract
A computing apparatus for providing a three-dimensional (3D) interactive user experience (UX) is provided. The computing apparatus may include an object position estimator configured to calculate first coordinates recognized by a user as a position of a first point of an object in a stereoscopic image. The computing apparatus may include a pointing determiner configured to determine whether the user points to the first point based on the first coordinates and second coordinates, the second coordinates representing a pointing position of the user.
Claims18
A computing apparatus, comprising:
- a memory and a processor, the memory configured to store instructions that, when executed by the processor, configures the processor to,
- calculate first coordinate values based on a position of each of a left eye and a right eye of a user and a position of an object point on an image, the first coordinate values representing the position of the object point as recognized by the user,
- determine whether a pointing position of the user corresponds to the object point based on the first coordinate values and second coordinate values, the second coordinate values representing the pointing position, and
- calculate the second coordinate values based on directions of a plurality of markers corresponding to at least one identification element associated with a user device, the directions of the plurality of markers recognized by image-sensing and displacement information between the plurality of markers.
1 more element
A computing apparatus, comprising:
- a camera configured to determine positions of eyes of a user;
- and
- a memory and a processor, the memory configured to store instructions that, when executed by the processor, configures the processor to,
- determine a transformation function based on the positions of the eyes of the user, the transformation function being used to transform coordinate values of an object point in a global coordinate system to first coordinate values in a user recognition coordinate system, the object point being a point on an image, the point being estimated based on the positions of the eyes of the user, and
- determine whether a pointing position of the user corresponds to the object point based on the first coordinate values and second coordinate values, the second coordinate values representing the pointing position.
2 more elements
A computing apparatus, comprising:
- a camera configured to determine positions of eyes of a user;
- and
- a memory and a processor, the memory configured to store instructions that, when executed by the processor, configures the processor to,
- determine a transformation function based on the positions of the eyes of the user, the transformation function being used to transform initial coordinate values of an object point in a global coordinate system to first coordinate values in a user recognition coordinate system, the object point being a point on an image, the point being estimated based on the positions of the eyes of the user,
- determine third coordinate values in the global coordinate system by applying an inverse function to the transformation function of second coordinate values representing a pointing position of the user, and
- determine whether the pointing position corresponds to the object point based on the first coordinate values and the third coordinate values.
3 more elements
A method by which a computing apparatus including at least one processor provides a three-dimensional (3D) interactive user experience, the method comprising:
- calculating, by the at least one processor, first coordinate values based on positions of eyes of a user and a position of an object point displayed on an image, the first coordinate values being recognized by the user as the position of the object point;
- calculating, by the at least one processor, second coordinate values representing a pointing position of the user, the calculating the second coordinate values including,
- correcting a position of at least one identification element sensed in a current frame based on a position of the at least one identification element sensed in at least one previous frame, the at least one identification element being associated with a user device, and
- calculating the second coordinate values based on the corrected position;
- and
- determining, by the at least one processor, whether the pointing position corresponds to the object point based on the first coordinate values and the second coordinate values.
3 more elements
A device, comprising:
- a memory and a processor, the memory configured to store instructions that, when executed by the processor, configures the processor to,
- estimate a position of an object point on an image based on i) a position of each of a left eye and a right eye of a user in a user coordinate system, and ii) a position of the object point in a global coordinate system, the user coordinate system being from a different perspective than the global coordinate system,
- determine whether a pointing position of the user corresponds to the object point based on the estimated position, the image being a stereoscopic image comprising a right image and a left image,
- determine, as the estimated position of the object point, coordinates of an intersection point at which a first straight line connecting the position of the left eye and a position of the object point on the left image intersects a second straight line connecting the position of the right eye and a position of the object point on the right image, if the first straight line and the second straight line intersect, and
- determine, as the estimated position of the object point, coordinates of a central point of a line segment perpendicular to the first straight line and the second straight line, if the first straight line and the second straight line do not intersect.
2 more elements
Dependencies are inferred from the claim text.