Two-dimensional impairment sensor
AssigneeBattelle Memorial Institute
InventorsAdam V. Rich, Aaron Frank, Scott Gibbons
Life of this patent
Estimating the term…
Abstract
To determine impairment due to drugs or alcohol, an image capture component captures video of at least a head of a test subject. Cropped head images of the head of the test subject are extracted from sequential images of the video. For each cropped head image, a gaze angle of the test subject is determined from the cropped head image. The determined gaze angles are analyzed to determine horizontal nystagmus and/or angle of onset of nystagmus. A level of impairment of the test subject is determined from the horizontal nystagmus and/or angle of onset of nystagmus. A visual representation of the level of impairment of the test subject is generated on an associated display.
Claims13
A system configured to determine impairment due to drugs or alcohol, the system comprising:
- an image capture component configured to capture a plurality of sequential images of at least a head of a test subject;
- and
- a processor in communication with a memory storing instructions which are executed by the processor to:
- extract cropped head images of the head of the test subject from the captured sequential images,
- determining a three-dimensional (3D) head pose of the head in each cropped head image, wherein the determined 3D head pose in each cropped head image comprises a 3D orientation of a medial plane of the head in the cropped head image;
- for each cropped head image, determine a gaze angle of the test subject from the cropped head image;
- analyze the determined gaze angles to determine at least one of horizontal nystagmus and angle of onset of nystagmus;
- estimate a level of impairment of the test subject from the determined at least one of horizontal nystagmus and angle of onset of nystagmus;
- and
- generate a visual representation of the level of impairment of the test subject on an associated display:
- wherein the system comprises a mobile device and the image capture component is a built-in camera of the mobile device.
A method of indicating impairment due to drugs or alcohol, the method comprising:
- capturing, via an image capture component of a mobile device, a plurality of sequential images of a test subject;
- extracting at least one cropped head image from the captured sequence including determining a head pose of the cropped head image, wherein determining the head pose of the cropped head image further comprises determining a three-dimensional (3D) head pose of the head in each cropped head image, wherein the determined 3D head pose in each cropped head image comprises a 3D orientation of a medial plane of the head in the cropped head image;
- determining a gaze angle of the test subject in the at least one cropped head image;
- analyzing the determined gaze angle to determine at least one of a horizontal nystagmus and angle of onset of nystagmus;
- estimating a level of impairment of the test subject from the determined at least one of horizontal nystagmus and angle of onset of nystagmus;
- and
- generating a visual representation of the level of impairment of the test subject on an associated display,
- wherein at least one of the capturing, extracting, determining, analyzing, and generating is performed by a processor in communication with memory storing instructions thereon which are executed by the processor.
A mobile device configured to determine impairment due to drugs or alcohol, the mobile device comprising:
- an image capture component configured to capture a plurality of sequential images of at least a head of a test subject;
- a three-dimensional mapping component configured to generate a cropped, three-dimensional image of the head of the test subject from the plurality of sequential images captured by the image capture component, wherein the three-dimensional mapping component is configured to determine a three-dimensional (3D) head pose of the head in each cropped head image, wherein the determined 3D head pose in each cropped head image comprises a 3D orientation of a medial plane of the head in the cropped head image, and wherein, for each cropped head image, the gaze angle is determined with respect to the medial plane of the head in the cropped head image;
- a gaze angle determination component configured to receive the cropped, three-dimensional image of the head of the test subject and determine a gaze angle therefrom using a recurrent neural network;
- an analysis component configured to analyze the determined gaze angle to detect at least one of horizontal nystagmus or angle of onset to determine impairment;
- and
- a display configured to generate a visual representation of the determined impairment.
Dependencies are inferred from the claim text.