Back to results
US 8,996,173 B2Granted
Method and apparatus for hand gesture control in a minimally invasive surgical system
AssigneeIntuitive Surgical Operations, Inc.
InventorsBrandon D. Itkowitz, Simon P. DiMaio, Tao Zhao
Life of this patent
Estimating the term…
Abstract
In a minimally invasive surgical system, a hand tracking system tracks a location of a sensor element mounted on part of a human hand. A system control parameter is generated based on the location of the part of the human hand. Operation of the minimally invasive surgical system is controlled using the system control parameter. Thus, the minimally invasive surgical system includes a hand tracking system. The hand tracking system tracks a location of part of a human hand. A controller coupled to the hand tracking system converts the location to a system control parameter, and injects into the minimally invasive surgical system a command based on the system control parameter.
Claims15
A method comprising:
- receiving a plurality of locations of elements, the receiving being at a controller, each element being mounted on a unique part of a human hand;
- selecting a hand gesture pose from a plurality of known hand gesture poses, the selecting of the hand gesture pose being by the controller and based on the plurality of locations, each hand gesture pose of the plurality of known hand gesture poses, other than a hand gesture pose used in a plurality of known hand gesture trajectories, being assigned to one of a first plurality of system modes of operation, wherein modes of operation of a surgical system comprise the first plurality of system modes of operation;
- determining whether the selected hand gesture pose is the hand gesture pose used in the plurality of known hand gesture trajectories;
- selecting a hand gesture trajectory from the plurality of known hand gesture trajectories if the determining finds that the selected hand gesture pose is the hand gesture pose used in the plurality of known hand gesture trajectories, the selecting of the hand gesture trajectory being by the controller and based on the plurality of locations, each hand gesture trajectory of the plurality of known hand gesture trajectories being assigned to one of a second plurality of system modes of operation, wherein the modes of operation of the surgical system further comprises the second plurality of system modes;
- changing a mode of operation of the surgical system to one of the first plurality of system modes of operation if the selected hand gesture pose is not the hand gesture pose used in the plurality of known hand gesture trajectories, the changing to the one of the first plurality of system modes being by the controller and based on the selected hand gesture pose;
- and
- changing the mode of operation of the surgical system to one of the second plurality of system modes of operation if the selected hand gesture pose is the hand gesture pose used in the plurality of known hand gesture trajectories, the changing to the one of the second plurality of system modes being by the controller and based on the selected hand gesture trajectory.
4 more elements
A surgical system including a plurality of system modes of operation, the surgical system comprising:
- a hand tracking system, wherein the hand tracking system tracks locations of a plurality of tracking sensors, each one of the plurality of tracking sensors being mounted on a unique part of a human hand;
- and
- a controller coupled to the hand tracking system, wherein the controller transforms the locations to a hand gesture pose, wherein the controller determines whether the hand gesture pose is a hand gesture pose used in a plurality of known hand gesture trajectories, wherein if the hand gesture pose is not the hand gesture pose used in the plurality of known hand gesture trajectories, based on the hand gesture pose, the controller sends a first command to change from a first one of the plurality of system modes of operation to a second one of the plurality of system modes of operation, and wherein if the hand gesture pose is the hand gesture pose used in the plurality of known hand gesture trajectories, the controller transforms the locations to a hand gesture trajectory, and based on the hand gesture trajectory, the controller sends a second command to change from the first one of the plurality of system modes of operation to a third one of the plurality of system modes of operation.
In a medical device system, a method comprising:
- at a controller, receiving a plurality of locations, each of the received plurality of locations corresponding to a unique part of a human hand;
- by the controller, using at least a portion of the received plurality of locations, identifying a hand gesture pose in a plurality of known hand gesture poses corresponding to a pose of the human hand, the plurality of known hand gesture poses including a subplurality of hand gesture poses and a hand gesture trajectory pose different from the hand gesture poses of the subplurality of hand gesture poses, each of the hand gesture poses of the subplurality of hand gesture poses being uniquely associated with one of a first plurality of modes of operation of the system, the hand gesture trajectory pose being used in a trajectory of the human hand;
- by the controller, determining if the hand gesture pose is the hand gesture trajectory pose;
- if the controller determines the hand gesture pose is not the hand gesture trajectory pose, then by the controller, changing a mode of operation of the system to the system mode of operation uniquely associated with the hand gesture pose;
- and
- if the controller determines the hand gesture pose is the hand gesture trajectory pose, then by the controller using at least a portion of the received plurality of locations to calculate a trajectory of the human hand:
- identifying a hand gesture trajectory in a plurality of known hand gesture trajectories corresponding to the trajectory of the human hand, each of the plurality of known hand gesture trajectories being uniquely associated with one of a second plurality of system modes of operation, the modes of operation of the second plurality of system modes of operation being different from the modes of operation of the first plurality of system modes of operation, and
- changing a mode of operation of the system to the mode of operation of the second plurality of system modes of operation uniquely associated with the hand gesture trajectory.
5 more elements
Dependencies are inferred from the claim text.