Back to results
US 10,482,608 B2Granted
Method and apparatus to generate haptic feedback from video content analysis
AssigneeImmersion Corporation
InventorsJamal Saboune, Juan Manuel Cruz-Hernandez
Life of this patent
Estimating the term…
Abstract
A system includes an image capture device configured to capture images, and a processor programmed with one or more computer program modules. When executed, the one or more computer program modules are configured to receive the images captured by the image capture device, generate a control signal for a haptic output device as the images are received, synchronize the images and the control signal, and output a video with the synchronized images and the control signal.
Claims19
A method of generating haptics for a video, comprising:
- tracking motion of an object in the video, the video including a plurality of image frames;
- performing image processing on the plurality of image frames;
- detecting an event based on the image processing to generate a detected event;
- obtaining sensor information associated with the plurality of image frames, the sensor information including one or more sensor measurements of the motion of the object;
- generating a first estimate of the motion of the object based on the plurality of image frames and a second estimate of the motion of the object based on the one or more sensor measurements;
- updating the first estimate of the motion of the object with the second estimate of the motion of the object to generate an updated first estimate, and providing a control signal based on the detected event and the updated first estimate
- or
- updating the second estimate of the motion of the object with the first estimate of the motion of the object to generate an updated second estimate, and providing the control signal based on the detected event and the updated second estimate, the control signal being configured to cause haptic feedback for the motion of the object in the video;
- and
- providing the haptic feedback based on the control signal, the providing of the haptic feedback occurring in synchronization with the motion of the object in the video.
7 more elements
A system, comprising:
- a sensor tracking motion of an object in a video including a plurality of image frames and obtaining sensor information associated with the plurality of image frames, the sensor information including one or more sensor measurements of the motion of the object;
- a computing device having a processor programmed with a computer program module, wherein when executed, the computer program module is configured to
- perform image processing on the plurality of image frames,
- detect an event based on the image processing to generate a detected event,
- generate a first estimate of the motion of the object based on the plurality of image frames and a second estimate of the motion of the object based on the one or more sensor measurements;
- and
- update the first estimate of the motion of the object with the second estimate of the motion of the object to generate an updated first estimate, and provide a control signal based on the detected event and the updated first estimate
- or
- update the second estimate of the motion of the object with the first estimate of the motion of the object to generate an updated second estimate, and provide the control signal based on the detected event and the updated second estimate, the control signal being configured to cause haptic feedback for the motion of the object in the video;
- and
- a first haptic output device configured to provide the haptic feedback based on the control signal, wherein the haptic feedback is provided in synchronization with the motion of the object in the video.
8 more elements
A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor, cause the processor to perform operations comprising:
- tracking motion of an object in a video, the video including a plurality of image frames;
- performing image processing on the plurality of image frames;
- detecting an event based on the image processing to generate a detected event;
- obtaining sensor information associated with the plurality of image frames, the sensor information including one or more sensor measurements of the motion of the object;
- generating a first estimate of the motion of the object based on the plurality of image frames and a second estimate of the motion of the object based on the one or more sensor measurements;
- updating the first estimate of the motion of the object with the second estimate of the motion of the object to generate an updated first estimate, and providing a control signal based on the detected event and the updated first estimate
- or
- updating the second estimate of the motion of the object with the first estimate of the motion of the object to generate an updated second estimate, and providing the control signal based on the detected event and the updated second estimate, the control signal being configured to cause haptic feedback for the motion of the object in the video;
- and
- providing the haptic feedback based on the control signal, the providing of the haptic feedback occurring in synchronization with the motion of the object in the video.
7 more elements
Dependencies are inferred from the claim text.