# US 2021/0197383 A1 · Systems and methods for detecting blind spots for robots

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0197383 A1
- Document ID: US20210197383A1
- Status: Published application
- Kind: A1
- Application number: 17/199,721
- Filed: 2021-03-12
- Published: 2021-07-01
- Earliest claimed: 2018-09-12
- Assignees: Brain Corporation
- Applicants: Brain Corporation
- Inventors: Jean-Baptiste Passot
- Web page: https://patentgrep.com/patent/US20210197383A1

## CPC

- G05D 1/024: {in combination with a laser (lasers per se H01S)}
- B25J 9/1671: {characterised by simulation, either to verify existing program or to create and verify new program, CAD/CAM oriented, graphic oriented programming systems}
- B25J 9/1676: {Avoiding collision or forbidden zones}
- B25J 19/061: {with audible signals (audio controls B25J13/003)}
- G05D 1/0251: {extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision (stereoscopic image analysis H04N13/00; depth recovery from images G06T7/593)}
- G05D 1/0274: {using mapping information stored in a memory device (navigation using map-matching G01C21/30)}
- G05D 1/247: using signals provided by artificial sources external to the vehicle, e.g. navigation beacons
- G06V 10/421: {by analysing segments intersecting the pattern}
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems and methods for detecting blind spots using a robotic apparatus are disclosed herein. According to at least one exemplary embodiment, a robot may utilize a plurality of virtual robots or representations to determine intersection points between extended measurements from the robot and virtual measurements from a respective one of the virtual robot or representation to determine blind spots. The robot may additionally consider locations of the blind spots while navigating a route to enhance safety, wherein the robot may perform an action to alert nearby humans upon navigating near a blind spot along the route.

## Claims

### Claim 1

A non-transitory computer readable storage medium comprising a plurality of computer readable instructions stored thereon that when executed by at least one controller cause at least one controller to,
project at least one virtual representation along a route traveled by a robot;
collect, via the at least one virtual representation, a plurality of virtual measurements of an object based on current localization data of the object on a computer readable map; and
determine, via the at least one virtual representation, a blind spot based on intersections between at least one extended measurement extending from the robot and at least one virtual measurement of the at least one virtual representation which does not detect the object.

### Claim 2 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein,
the plurality of virtual measurements comprise virtual extensions of measurements extended beyond the object, and wherein at least one virtual measurement of the plurality of virtual measurements is used to determine the intersections, the intersections comprises at least one of the plurality of virtual measurements which do not detect the object based on the current localization data.

### Claim 3 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the at least one controller is further configured to execute the computer readable instructions to,
map the blind spot on the computer readable map upon detection of an edge of the object, the edge of the object is a corner point and is proximate to the blind spot along the route traveled by the robot.

### Claim 4 (depends on 3)

The non-transitory computer readable storage medium of claim 3, wherein the at least one controller is further configured to execute the computer readable instructions to,
perform a safety action upon navigating a predetermined distance from a point along the route proximate to the corner point, the safety action comprising at least one of a visual indication, an auditory noise, a change of trajectory, or change of velocity of the robot.

### Claim 5 (depends on 3)

The non-transitory computer readable storage medium of claim 3, wherein the at least one controller is further configured to execute the computer readable instructions to,
detect the corner point by detecting an edge beam, the edge beam being detected based on a change in distance measurement as a function of angle exceeding a threshold value, the corner point being of the object localized by a beam emitted adjacent to the edge beam.

### Claim 6 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein,
the extended measurements are represented by a first region, the first region comprising portions of the computer readable map not in line of sight of any sensor coupled to the robot due to the object, the first region being centered about the robot;
the virtual measurements are represented by a second region extending radially from each of the at least one virtual representation on the computer readable map; and
the blind spot comprises a region of overlap between the first and second regions.

### Claim 7

A system for detecting a blind spot, comprising:
a memory comprising a plurality of computer readable instructions stored thereon; and
at least one controller configured to execute the computer readable instructions to,
project at least one virtual representation along a route traveled by a robot upon detection of an object by a sensor coupled to the robot,
collect a plurality of virtual measurements of the object based on current localization data of the object on a computer readable map, and
determine the blind spot based on intersections between at least one extended measurement from the sensor coupled to the robot and at least one virtual measurement of the at least one virtual representation which does not detect the object.

### Claim 8 (depends on 7)

The robotic system of claim 7, wherein,
the at least one extended measurement comprises virtual extensions of measurements extended beyond the object, and wherein at least one virtual measurement of the plurality of virtual measurements is used to determine the intersections, the interactions comprises at least one of the plurality of virtual measurements which do not detect the object based on the current localization data.

### Claim 9 (depends on 7)

The robotic system of claim 7, wherein the at least one controller is further configured to execute the plurality of computer readable instructions to,
map the blind spot on the computer readable map upon detection of an edge of the object, the edge of the object is defined by a corner point and is proximate to the blind spot along the route traveled by the robot.

### Claim 10 (depends on 9)

The robotic system of claim 9, wherein the at least one controller is further configured to execute the plurality of computer readable instructions to,
perform a safety action upon navigating a predetermined distance from a point along the route proximate to the corner point, the safety action comprising at least one of a visual indication, an auditory noise, a change of trajectory, or change of velocity of the robot.

### Claim 11 (depends on 10)

The robotic system of claim 10, wherein the at least one controller is further configured to execute the plurality of computer readable instructions to,
detect the corner point by detecting an edge beam, the edge beam being detected based on a change in distance measurement as a function of angle exceeding a threshold value, the corner point being of the object localized by a beam emitted adjacent to the edge beam.

### Claim 12 (depends on 9)

The robotic system of claim 9, wherein,
the extended measurements are represented by a first region, the first region comprising portions of the computer readable map not in line of sight of any sensor coupled to the robot due to the object, the first region being centered about the robot;
the virtual measurements are represented by a second region extending radially from each of the at least one virtual representation on the computer readable map; and
the blind spot comprises a region of overlap between the first and second regions.

### Claim 13

A method for detecting a blind spot, comprising:
projecting, by at least one controller coupled to a robot traveling along a route, at least one virtual representation along the route upon detection of an object by a sensor coupled to the robot, the at least one virtual representation being configured to collect a plurality of virtual measurements of the object based on current localization data of the object on a computer readable map; and
determining, by the at least one controller, the blind spot based on intersections between at least one extended measurement from the sensor and at least one virtual measurement of the at least one virtual representation which does not detect the object.

### Claim 14 (depends on 13)

The method of claim 13, wherein,
the extended measurements comprise virtual extensions of measurements extended beyond the object, and wherein at least one virtual measurement of the plurality of virtual measurements is used to determine the intersections, the intersections comprises at least one of the plurality of virtual measurements which do not detect the object based on the current localization data.

### Claim 15 (depends on 13)

The method of claim 13, further comprising:
mapping the blind spot on the computer readable map upon detection of an edge of the object, the edge of the object being defined by a corner point and proximate to the blind spot along the route traveled by the robot.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
performing a safety action upon navigating a predetermined distance from a point along the route proximate to the corner point, the safety action comprising at least one of a visual indication, an auditory noise, a change of trajectory, or change of velocity of the robot.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
detecting the corner point by detecting an edge beam, the edge beam being detected based on a change in distance measurement as a function of angle exceeding a threshold value, the corner point being of the object localized by a beam emitted adjacent to the edge beam.

### Claim 18 (depends on 13)

The method of claim 13, wherein,
the extended measurements are represented by a first region, the first region comprising portions of the computer readable map not in line of sight of any sensor coupled to the robot due to the object, the first region being centered about the robot;
the virtual measurements are represented by a second region extending radially from each of the at least one virtual representation on the computer readable map; and
the blind spot comprises a region of overlap between the first and second regions.
