Back to results
US 10,949,679 B2Granted
Nighttime sensing
AssigneeApple Inc.
InventorsLucian Ion, Daniel E. Potter, Evan C. Cull, Xiaofeng Tang
Life of this patent
Estimating the term…
Abstract
Systems and methods for night vision combining sensor image types. Some implementations may include obtaining a long wave infrared image from a long wave infrared sensor; detecting an object in the long wave infrared image; identifying a region of interest associated with the object; adjusting a control parameter of a near infrared sensor based on data associated with the region of interest; obtaining a near infrared image captured using the adjusted control parameter of the near infrared sensor; and determining a classification of the object based on data of the near infrared image associated with the region of interest.
Claims20
A system, comprising:
- a long wave infrared sensor;
- a near infrared sensor;
- a visible spectrum sensor;
- a data processing apparatus;
- and
- a data storage device storing instructions executable by the data processing apparatus that upon execution by the data processing apparatus cause the data processing apparatus to perform operations comprising:
- obtaining a long wave infrared image from the long wave infrared sensor,
- detecting an object in the long wave infrared image,
- identifying a region of interest associated with the object,
- adjusting a control parameter of the near infrared sensor based on data associated with the region of interest,
- adjusting a control parameter of the visible spectrum sensor based on data associated with the region of interest,
- obtaining a near infrared image captured using the adjusted control parameter of the near infrared sensor,
- obtaining a visible spectrum image from the visible spectrum sensor that is captured using the adjusted control parameter of the visible spectrum sensor, and
- determining a classification of the object based on data of the near infrared image associated with the region of interest and based on data of the visible spectrum image associated with the region of interest.
11 more elements
A method, comprising:
- obtaining a long wave infrared image from a long wave infrared sensor;
- detecting an object in the long wave infrared image;
- identifying a region of interest associated with the object;
- adjusting a control parameter of a near infrared sensor based on data associated with the region of interest;
- adjusting a visible spectrum sensor control parameter based on data associated with the region of interest;
- obtaining a near infrared image captured using the adjusted control parameter of the near infrared sensor;
- obtaining a visible spectrum image from the visible spectrum sensor that is captured using the adjusted control parameter of the visible spectrum sensor;
- and
- determining a classification of the object based on data of the near infrared image associated with the region of interest and based on data of the visible spectrum image associated with the region of interest.
6 more elements
A vehicle, comprising:
- a vehicle body;
- actuators operable to cause motion of the vehicle body;
- a long wave infrared sensor;
- a near infrared sensor;
- a visible spectrum sensor;
- and
- an automated controller configured to:
- obtain a long wave infrared image from the long wave infrared sensor,
- detect an object in the long wave infrared image,
- identify a region of interest associated with the object,
- adjust a control parameter of the near infrared sensor based on data associated with the region of interest,
- adjust a control parameter of the visible spectrum sensor based on data associated with the region of interest,
- obtain a near infrared image captured using the adjusted control parameter of the near infrared sensor,
- obtain a visible spectrum image from the visible spectrum sensor that is captured using the adjusted control parameter of the visible spectrum sensor,
- determine a classification of the object based on data of the near infrared image associated with the region of interest and based on data of the visible spectrum image associated with the region of interest,
- determine a motion plan based on the classification of the object, and
- output commands to the actuators to maneuver the vehicle.
14 more elements
Dependencies are inferred from the claim text.