# US 2021/0065565 A1 · Remote surface condition assessment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0065565 A1
- Document ID: US20210065565A1
- Status: Published application
- Kind: A1
- Application number: 16/551,817
- Filed: 2019-08-27
- Published: 2021-03-04
- Earliest claimed: 2019-08-27
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Eli M. Dow; Campbell D. Watson; Guillaume A.R. Auger; Michael E. Henderson
- Web page: https://patentgrep.com/patent/US20210065565A1

## CPC

- B60W 40/06: Road conditions
- G08G 5/26: Transmission of traffic-related information between aircraft and ground stations
- B64U 10/13: Flying platforms
- B64U 40/10: for adjusting control surfaces or rotors
- G06V 20/17: taken from planes or by drones
- G06V 20/182: {Network patterns, e.g. roads or rivers}
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G08G 5/21: located onboard the aircraft
- G08G 5/32: for flight plan preparation
- G08G 5/55: for a single aircraft
- G08G 5/74: for monitoring terrain
- B60W 2554/00: Input parameters relating to objects
- B60W 2555/20: Ambient conditions, e.g. wind or rain
- B60W 2556/10: Historical data
- B64U 2101/31: for surveillance
- G08G 5/57: for unmanned aircraft
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Method, apparatus, and computer program product are provided for assessing road surface condition. In some embodiments, candidate locations each forecast to have a dangerous road surface condition are determined, an optimized flight path is determined comprising a sequence of sites corresponding to the candidate locations, dispatch is made to a first site within the sequence, and a road surface condition at the first site is assessed using an onboard sensor (e.g., spectroradiometer). In some embodiments, a check for new information is performed before dispatch is made to a second site. In some embodiments, the candidate locations are determined using both a model forecast and data-mined locations considered hazardous. In some embodiments, the optimized flight path is determined using TSP optimization constrained by available flight time and prioritized by frequency of historical incident and severity of forecast road surface condition.

## Claims

### Claim 1

A method of assessing road surface condition, the method comprising:
determining a plurality of candidate locations each forecast to have a dangerous road surface condition;
determining an optimized flight path for an aerial drone, wherein the optimized flight path comprises a sequence of sites each corresponding to one of the plurality of candidate locations;
dispatching the aerial drone to a first site within the sequence of sites that comprise the optimized flight path;
assessing, using a sensor onboard the aerial drone, a road surface condition at the first site.

### Claim 2 (depends on 1)

The method as recited in claim 1, wherein determining a plurality of candidate locations each forecast to have a dangerous road surface condition includes utilizing both a model forecast and data-mined locations considered hazardous.

### Claim 3 (depends on 2)

The method as recited in claim 2, wherein determining an optimized flight path for an aerial drone includes utilizing traveling salesman problem (TSP) optimization constrained by flight time available to the aerial drone and prioritized by frequency of historical incident and severity of forecast road surface condition.

### Claim 4 (depends on 1)

The method as recited in claim 1, further comprising determining whether an observed dangerous road surface condition exists at the first site based on the assessing operation.

### Claim 5 (depends on 4)

The method as recited in claim 4, further comprising performing one or more actions to improve safety at the first site responsive to determining that the observed dangerous road surface condition exists at the first site.

### Claim 6 (depends on 5)

The method as recited in claim 5, wherein performing one or more actions to improve safety at the first site includes the aerial drone hovering over the first site and flashing a warning light.

### Claim 7 (depends on 5)

The method as recited in claim 5, wherein performing one or more actions to improve safety at the first site includes at least one of sending a text message to one or more approaching vehicles, alerting one or more local authorities, reducing a speed limit on one or more nearby electronic road signs, and placing a caution message on one or more nearby programmable road signs.

### Claim 8 (depends on 1)

The method as recited in claim 1, further comprising checking, after dispatching the aerial drone to the first site and before dispatching the aerial drone to a second site within the sequence of sites that comprise the optimized flight path, whether new information is available.

### Claim 9 (depends on 8)

The method as recited in claim 8, determining an updated optimized flight path in response to the checking operation finding that new information is available.

### Claim 10 (depends on 1)

The method as recited in claim 1, wherein assessing, using a sensor onboard the aerial drone, a road surface condition at the first site includes using a spectroradiometer configured to detect light of one or more wavelengths reflected from a road surface at the first site, and wherein the one or more wavelengths are within a range of wavelengths defined by visible and near-infrared (VNIR) light and short-wavelength infrared (SWIR) light.

### Claim 11 (depends on 10)

The method as recited in claim 10, wherein assessing, using a sensor onboard the aerial drone, a road surface condition at the first site further includes using an infrared temperature sensor configured to measure a road surface temperature at the first site.

### Claim 12 (depends on 1)

The method as recited in claim 1, wherein assessing, using a sensor onboard the aerial drone, a road surface condition at the first site includes using a mobile road condition sensor configured to detect light reflected from a road surface at the first site.

### Claim 13 (depends on 12)

The method as recited in claim 12, wherein assessing, using a sensor onboard the aerial drone, a road surface condition at the first site further includes using an infrared temperature sensor configured to measure a road surface temperature at the first site.

### Claim 14

A system for assessing road surface condition, the system comprising:
one or more processors, one or more computer readable storage devices, and program instructions stored on at least one of the one or more computer readable storage devices for execution by at least one of the one or more processors, the program instructions executable to:
determine a plurality of candidate locations each forecast to have a dangerous road surface condition;
determine an optimized flight path for an aerial drone, wherein the optimized flight path comprises a sequence of sites each corresponding to one of the plurality of candidate locations;
dispatch the aerial drone to a first site within the sequence of sites that comprise the optimized flight path;
assess, using a sensor onboard the aerial drone, a road surface condition at the first site.

### Claim 15 (depends on 14)

The system as recited in claim 14, wherein the program instructions executable to determine the plurality of candidate locations utilize both a model forecast and data-mined locations considered hazardous.

### Claim 16 (depends on 15)

The system as recited in claim 15, wherein the program instruction executable to determine the optimized flight path utilize traveling salesman problem (TSP) optimization constrained by flight time available to the aerial drone and prioritized by frequency of historical incident and severity of forecast road surface condition.

### Claim 17 (depends on 15)

The system as recited in claim 15, further comprising the program instructions executable to:
determine whether an observed dangerous road surface condition exists at the first site based on the assessing operation;
perform one or more actions to improve safety at the first site responsive to determining that the observed dangerous road surface condition exists at the first site.

### Claim 18

A computer program product for assessing road surface condition, the computer program product comprising a computer readable storage medium having program code embodied therewith, the program code executable by one or more processors, to perform a method comprising:
determining a plurality of candidate locations each forecast to have a dangerous road surface condition;
determining an optimized flight path for an aerial drone, wherein the optimized flight path comprises a sequence of sites each corresponding to one of the plurality of candidate locations;
dispatching the aerial drone to a first site within the sequence of sites that comprise the optimized flight path;
assessing, using a sensor onboard the aerial drone, a road surface condition at the first site.

### Claim 19 (depends on 18)

The computer program product as recited in claim 18, wherein determining a plurality of candidate locations each forecast to have a dangerous road surface condition includes utilizing both a model forecast and data-mined locations considered hazardous.

### Claim 20 (depends on 19)

The computer program product as recited in claim 19, wherein determining an optimized flight path for an aerial drone includes utilizing traveling salesman problem (TSP) optimization constrained by flight time available to the aerial drone and prioritized by frequency of historical incident and severity of forecast road surface condition.
