User interface apparatus and control method
AssigneeCanon Kabushiki Kaisha
InventorSoshi Oshima
Life of this patent
Estimating the term…
Abstract
A three-dimensional image of an operation surface and a region upward thereof is acquired, a hand region is extracted from the three-dimensional image, and the position of a fingertip is specified based on the extracted hand region. A touch on the operation surface is detected based on the operation surface included in the three-dimensional image and the specified position of the fingertip, and if a touch is detected, the direction of the fingertip is specified, and a position obtained by shifting the position of the fingertip by a predetermined amount in the direction opposite to the specified direction of the fingertip is determined as the touch position.
Claims22
An apparatus for specifying an operation performed on an operation surface, the apparatus comprising:
- an image sensor installed at a position upward from the operation surface and configured to sense a distance from respective positions of a plurality of positions of a target object placed on the operation surface;
- a memory storing instructions;
- and
- one or more processors which execute the instructions and cause the apparatus to function as units comprising:
- (1) a first acquisition unit that acquires distances from the image sensor to respective positions of a plurality of positions of a target object placed on the operation surface;
- (2) a first determination unit that determines that the target object performs a touch gesture against the operation surface in a case where the distance acquired by the first acquisition unit is less than or equal to a predetermined value;
- (3) a first specification unit that specifies a tip of the target object that is determined to have performed the touch gesture in an image having the distances acquired by the first acquisition unit;
- (4) a second specification unit that specifies a direction of the target object in the image having the distances;
- (5) a second acquisition unit that acquires an angle formed by the direction of the target object and the operation surface using the image having the distances;
- and
- (6) a second determination unit that determines, as the touch position on the operation surface, a position shifted by a predetermined amount in the specified direction of the target object from the specified tip of the target object,
- wherein the predetermined amount is a first amount in a case where the acquired angle is a first angle, and
- wherein the predetermined amount is a second amount that is smaller than the first amount in a case where the acquired angle is a second angle that is larger than the first angle.
A method of specifying an operation performed on an operation surface by an apparatus, the apparatus having an image sensor installed at a position upward from the operation surface and configured to sense a distance from respective positions of a plurality of positions of a target object placed on the operation surface, the method comprising;
- acquiring distances from an image sensor to respective positions of a plurality of positions of a target object placed on the operation surface;
- determining that the target object performs a touch gesture against the operation surface in a case where the distance acquired by the acquiring is less than or equal to a predetermined value;
- specifying a tip of the target object that is determined to have performed the touch gesture in an image having the distances acquired by the acquiring;
- specifying a direction of the target object in the image having the distances;
- acquiring an angle formed by the direction of the target object and the operation surface using the image having the distances;
- and
- determining, as the touch position on the operation surface, a position shifted by a predetermined amount in the specified direction of the target object from the specified tip of the target object,
- wherein the predetermined amount is a first amount in a case where the acquired angle is a first angle, and
- wherein the predetermined amount is a second amount that is smaller than the first amount in a case where the acquired angle is a second angle that is larger than the first angle.
Dependencies are inferred from the claim text.