Back to results
US 12,514,445 B2Granted
Body worn camera, sensor and content delivery system
AssigneeHeadvantage Corporation
InventorsJay Hedley, Peter Miller
Life of this patent
Estimating the term…
Abstract
A streaming content delivery system is provided for processing and broadcasting digital video content obtained from a distributed wearable camera device having eye tracking and movement sensing circuitry, or combination of devices or components, worn by an athlete, sports participant, or first responder. The system which may include eye sensors, accelerometers, as well as other sensors and specific wearable devices are disclosed which provide sensor data-enhanced video content from the point of view of an athlete during competition including for the sports of football, baseball, golf, skiing, and snowboarding.
Claims34
A wearable apparatus, comprising:
- a sports helmet or a hat;
- sensors and a camera embedded in the sports helmet or the hat;
- one or more infrared eye-tracking sensors attached to a faceguard of the sports helmet or the hat below eyes of a wearer of the sports helmet or the hat at a distance of 4 to 8 inches away from the eyes of the wearer of the sports helmet or the hat and configured to capture eye-tracking data;
- and
- processing circuitry embedded in the sports helmet or the hat and configured to
- map gaze point locations in a continuous stream of the eye-tracking data to video data captured by the camera by determining a position and a movement of the eyes relative to the one or more infrared eye-tracking sensors when the eyes and the one or more infrared eye-tracking sensors are simultaneously in motion, and determining locations in frames of the video data corresponding to the gaze point locations based on a continuous stream of motion data corresponding to a motion of the one or more infrared eye-tracking sensors attached to the faceguard of the sports helmet or the hat relative to the position and the movement of the eyes of the wearer of the sports helmet or the hat, and
- transmit sensor data captured by the sensors, the video data, and the eye-tracking data over a wireless network,
- wherein the motion of the one or more infrared eye-tracking sensors corresponds to a displacement of the one or more infrared eye-tracking sensors relative to a reference corresponding to the wearer, and
- wherein the motion of the one or more infrared eye-tracking sensors is captured by the one or more infrared eye-tracking sensors.
6 more elements
A method for mapping eye-tracking data to video data, comprising:
- receiving, via processing circuitry, the video data from a camera embedded in a sports helmet or a hat;
- receiving, via the processing circuitry, the eye-tracking data from one or more infrared eye-tracking sensors attached to a faceguard of the sports helmet or the hat below eyes of a wearer of the sports helmet or the hat at a distance of 4 to 8 inches away from the eyes of the wearer of the sports helmet or the hat;
- receiving, via the processing circuitry, motion data corresponding to a motion of the one or more infrared eye-tracking sensors attached to the faceguard of the sports helmet or the hat relative to a position and a movement of the eyes of the wearer of the sports helmet or the hat from one or more motion sensors embedded in the sports helmet or the hat;
- stabilizing, via the processing circuitry, the video data based on the motion data corresponding to the motion of the one or more infrared eye-tracking sensors attached to the faceguard of the sports helmet or the hat relative to the position and the movement of the eyes of the wearer of the sports helmet or the hat;
- and
- mapping, via the processing circuitry, gaze point locations in a continuous stream of the eye-tracking data to the stabilized video data by determining a position and a movement of the eyes relative to the one or more infrared eye-tracking sensors when the eyes and the one or more infrared eye-tracking sensors are simultaneously in motion, and determining locations in frames of the video data corresponding to the gaze point locations based on a continuous stream of the motion data corresponding to the motion of the one or more infrared eye-tracking sensors attached to the faceguard of the sports helmet or the hat relative to the position and the movement of the eyes of the wearer of the sports helmet or the hat,
- wherein the motion of the one or more infrared eye-tracking sensors corresponds to a displacement of the one or more infrared eye-tracking sensors relative to a reference corresponding to the wearer, and wherein the motion of the one or more infrared eye-tracking sensors is captured by the one or more infrared eye-tracking sensors.
4 more elements
A non-transitory computer-readable storage medium for storing computer-readable instructions that, when executed by a computer, cause the computer to perform a method, the method comprising:
- receiving video data from a camera embedded in a sports helmet or a hat;
- receiving eye-tracking data from one or more infrared eye-tracking sensors attached to a faceguard of the sports helmet or the hat below eyes of a wearer of the sports helmet or the hat at a distance of 4 to 8 inches away from the eyes of the wearer of the sports helmet or the hat;
- receiving motion data corresponding to a motion of the one or more infrared eye-tracking sensors attached to the faceguard of the sports helmet or the hat relative to a position and a movement of the eyes of the wearer of the sports helmet or the hat from one or more motion sensors embedded in the sports helmet or the hat;
- stabilizing the video data based on the motion data corresponding to the motion of the one or more infrared eye-tracking sensors attached to the faceguard of the sports helmet or the hat relative to the position and the movement of the eyes of the wearer of the sports helmet or the hat;
- and
- mapping gaze point locations in a continuous stream of the eye-tracking data to the stabilized video data by determining a position and a movement of the eyes relative to the one or more infrared eye-tracking sensors when the eyes and the one or more infrared eye-tracking sensors are simultaneously in motion, and determining locations in frames of the video data corresponding to the gaze point locations based on a continuous stream of the motion data corresponding to the motion of the one or more infrared eye-tracking sensors attached to the faceguard of the sports helmet or the hat relative to the position and the movement of the eyes of the wearer of the sports helmet or the hat,
- wherein the motion of the one or more infrared eye-tracking sensors corresponds to a displacement of the one or more infrared eye-tracking sensors relative to a reference corresponding to the wearer, and
- wherein the motion of the one or more infrared eye-tracking sensors is captured by the one or more infrared eye-tracking sensors.
5 more elements
Dependencies are inferred from the claim text.