# US 2019/0318181 A1 · System and method for driver monitoring > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0318181 A1 - Document ID: US20190318181A1 - Status: Published application - Kind: A1 - Application number: 16/314,675 - Filed: 2017-06-30 - Published: 2019-10-17 - Earliest claimed: 2016-07-01 - Assignees: Eyesight Mobile Technologies Ltd. - Applicants: eyeSight Mobile Technologies Ltd. - Inventors: Itay KATZ; Yonatan SAMET; Tamir ANAVI - Web page: https://patentgrep.com/patent/US20190318181A1 ## CPC - A61B 3/0025: {characterised by electronic signal processing, e.g. eye models} - G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness} - A61B 3/113: for determining or recording eye movement - A61B 5/163: {by tracking eye movement, gaze, or pupil change} - A61B 5/18: for vehicle drivers {or machine operators} - B60W 40/08: related to drivers or passengers - B60W 40/09: Driving style or behaviour - B60W 50/08: Interaction between the driver and the control system - B62D 1/02: vehicle-mounted - G06F 3/012: {Head tracking input arrangements} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06V 40/193: {Preprocessing; Feature extraction} - B60W 2040/0818: {Inactivity or incapacity of driver} - B60W 2540/00: Input parameters relating to occupants - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06V 40/18: Eye characteristics, e.g. of the iris - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT - B62D: MOTOR VEHICLES; TRAILERS (steering, or guiding on a desired track, of agricultural machines or implements A01B69/00; wheels, castors, axles, increasing wheel adhesion B60B; vehicle tyres, tyre inflation or tyre changing B60C; connections between vehicles of a train or the like B60D; vehicles for use on rail and road, amphibious or convertible vehicles B60F; suspension arrangements B60G; heating, cooling, ventilating or other air treating devices B60H; windows, windscreens, non-fixed roofs, doors or similar devices, protective coverings for vehicles not in use B60J; propulsion plant arrangements, auxiliary drives, transmissions, controls, instrumentation or dashboards B60K; electric equipment or propulsion of electrically-propelled vehicles B60L; power supply for electrically-propelled vehicles B60M; passenger accommodation not otherwise provided for B60N; adaptations for load transportation or to carry special loads or objects B60P; arrangement of signalling or lighting devices, the mounting or supporting thereof or circuits therefor, for vehicles in general B60Q; vehicles, vehicle fittings or vehicle parts not otherwise provided for B60R; servicing, cleaning, repairing, supporting, lifting, or manoeuvring, not otherwise provided for, B60S; brake arrangements, brake control systems or parts thereof B60T; air-cushion vehicles B60V; motor-cycles, accessories therefor B62J, B62K; testing of vehicles G01M) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Systems and methods are disclosed for driver monitoring. In one implementation, one or more images are received, e.g., from an image sensor. Such image(s) can reflect a at least a portion of a face of a driver. Using the images, a direction of a gaze of the driver is determined. A set of determined driver gaze directions is identified using at least one predefined direction. One or more features of one or more eyes of the driver are extracted using information associated with the identified set. ## Claims ### Claim 1 A system comprising: at least one image sensor; and at least one processor, configured to: receive one or more images from the image sensor, the one or more images reflecting a at least a portion of a face of a driver; determine, using the images, a direction of a gaze of the driver; identify a set of determined driver gaze directions using at least one predefined direction; and extract one or more features of one or more eyes of the driver using information associated with the identified set. ### Claim 2 (depends on 1) The system of claim 1, wherein the direction of the gaze of the driver reflects a location at which the driver is looking. ### Claim 3 (depends on 2) The system of claim 2, wherein the location reflects a location outside a vehicle within which the driver is present. ### Claim 4 (depends on 2) The system of claim 2, wherein the location reflects a location inside a vehicle within which the driver is present. ### Claim 5 (depends on 1) The system of claim 1, wherein to identify the set of determined driver gaze directions, the at least one processor is further configured to correlate one or more of the determined driver gaze directions with the at least one predefined direction. ### Claim 6 (depends on 1) The system of claim 1, wherein the set of determined driver gaze directions is identified using information associated with a distribution of the driver gaze during driving. ### Claim 7 (depends on 6) The system of claim 6, wherein the set of determined driver gaze directions is identified using information associated with a distribution of the driver gaze outside during driving. ### Claim 8 (depends on 6) The system of claim 6, wherein the set of determined driver gaze is identified using information associated with a distribution of the driver gaze inside a vehicle while driving. ### Claim 9 (depends on 6) The system of claim 6, wherein the set of determined driver gaze is identified using information associated with a distribution of the driver gaze based on driving behavior. ### Claim 10 (depends on 6) The system of claim 6, wherein the set of determined driver gaze is identified using information associated with a distribution of the driver gaze based on one or more actions of the driver occurring within a vehicle. ### Claim 11 (depends on 6) The system of claim 6, wherein the set of determined driver gaze is identified using information associated with a distribution of the driver gaze based on one or more actions of the driver occurring in relation to a component of a vehicle. ### Claim 12 (depends on 6) The system of claim 6 wherein the set of determined driver gaze is identified using additional information associated with at least one of: a motion direction of a vehicle, a vehicle speed, or a geographic location of a vehicle. ### Claim 13 (depends on 1) The system of claim 1, wherein to extract one or more features, the at least one processor is further configured to extract respective features from each of the determined driver gaze directions within the set. ### Claim 14 (depends on 1) The system of claim 1, wherein to identify a set of determined driver gaze directions the processor is further configured to identify at least a first set of driver gaze directions and a second set of driver gaze directions; and wherein to extract one or more features, the at least one processor is further configured to extract at least a first feature using information associated with the first set of determined driver gaze directions and a second feature from the second set of determined driver gaze directions. ### Claim 15 (depends on 1) The system of claim 1, wherein to identify a set of determined driver gaze directions the processor is further configured to identify at least a first set of driver gaze directions and a second set of driver gaze directions; and wherein to extract one or more features, the at least one processor is further configured to extract the one or more features using information associated with at least the first set of determined driver gaze directions and the second set of determined driver gaze directions. ### Claim 16 (depends on 1) The system of claim 1, wherein the at least one processor is further configured to determine a position of a head of the driver. ### Claim 17 (depends on 16) The system of claim 16, wherein to identify the set of determined driver gaze directions, the at least one processor is further configured to identify the set of determined driver gaze directions using the position of the head of the driver. ### Claim 18 (depends on 1) The system of claim 1, wherein to identify the set of determined driver gaze directions, the at least one processor is further configured to identify the set of determined driver gaze directions using information associated with a position of the head of the driver. ### Claim 19 (depends on 1) The system of claim 1, further comprising a light emitting device. ### Claim 20 (depends on 19) The system of claim 19, wherein the light emitting device comprises an infrared (IR) light emitting device. ### Claim 21 (depends on 1) The system of claim 1, wherein to identify the set of determined driver gaze directions, the at least one processor is further configured to identify the set of determined driver gaze directions using a position of one or more objects inside a vehicle within which the driver is present. ### Claim 22 (depends on 21) The system of claim 21, wherein the one or more objects include one or more mirrors of the vehicle. ### Claim 23 (depends on 1) The system of claim 1, wherein the at least one predefined direction reflects a direction aligned with the direction of the motion of the vehicle within which the driver is present is traveling. ### Claim 24 (depends on 1) The system of claim 1, wherein the one or more features comprises a kappa angle of the one or more eyes of the driver. ### Claim 25 (depends on 1) The system of claim 1, wherein the one or more features comprises a radius of curvature of a cornea of the driver. ### Claim 26 (depends on 1) The system of claim 1, wherein the one or more features comprises a distance between (a) a pupil plane of the one or more eyes of the driver and (b) a center of curvature of a cornea of the driver. ### Claim 27 A method comprising: receiving one or more images from an image sensor, the one or more images reflecting a at least a portion of a face of a driver; determining, using the images, a direction of a gaze of the driver; identifying a set of determined driver gaze directions using at least one predefined direction; and extracting one or more features of one or more eyes of the driver using information associated with the identified set. ### Claim 28 A non-transitory computer readable medium having instructions stored thereon that, when executed by a processing device, cause the processing device to perform operations comprising: receiving one or more images from an image sensor, the one or more images reflecting a at least a portion of a face of a user; determining, using the images, a direction of a gaze of the user; identifying a set of determined user gaze directions using at least one predefined direction; and extracting one or more features of one or more eyes of the user using information associated with the identified set.