# US 12,111,157 B2 · Information processing system, information processing device, and information processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,111,157 B2
- Document ID: US12111157B2
- Status: Granted
- Kind: B2
- Application number: 16/994,682
- Filed: 2020-08-17
- Published: 2020-12-03
- Granted: 2024-10-08
- Earliest claimed: 2017-03-09
- Assignees: Aerosense Inc.
- Applicants: Aerosense Inc.
- Inventors: Satoru Shimizu; Kohtaro Sabe; Tomohiro Maeshiro; Kousuke Suzuki; Sho Murakoshi
- Web page: https://patentgrep.com/patent/US12111157B2

## CPC

- G01C 15/04: Permanent marks; Boundary markers
- G01C 11/02: Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
- G01S 7/4972: {Alignment of sensor}
- G01S 17/89: for mapping or imaging
- G01S 19/485: {whereby the further system is an optical system or imaging system}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 20/17: taken from planes or by drones
- G01S 19/10: providing dedicated supplementary positioning signals
- G01S 19/45: by combining measurements of signals from the satellite radio beacon positioning system with a supplementary measurement
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

There is provided an information processing system including: a plurality of survey markers each including a GNSS reception unit that receives a signal from a GNSS satellite; a first position measurement unit that measures a ground position of at least one survey marker on the basis of the signals received by the plurality of survey markers; and a processing unit that detects the survey marker from a captured image captured by a UAV and including the survey marker, and associates a position of the detected survey marker in the captured image with the ground position.

## Claims

### Claim 1

A survey marker, comprising:
a global navigation satellite system (GNSS) receiver that receives a signal from a GNSS satellite; and
the survey marker has a predetermined shape and including at least two areas with different properties from one another, wherein
the at least two areas have a different reflectivity from one another,
a ground position of the survey marker is measured by the signals received on the GNSS receiver,
the survey marker is detectable based on the different properties of the at least two areas,
a position of the survey marker, in an image that includes the survey marker, is associated with the ground position,
the at least two areas include a first area and a second area,
the predetermined shape further includes a third area and a fourth area,
the third area has a same reflectivity as the first area,
the fourth area has a same reflectivity as the second area,
the first area, the second area, the third area and the fourth area each has a quadrangle shape,
the first area borders the second area and the fourth area, and
the third area borders the second area and the fourth area.

### Claim 2 (depends on 1)

The survey marker according to claim 1, wherein the at least two areas have a different hue from one another.

### Claim 3 (depends on 1)

The survey marker according to claim 1, wherein the at least two areas have a different color from one another.

### Claim 4 (depends on 1)

The survey marker according to claim 1, wherein
the survey marker includes a plurality of different hued polygonal areas or different colored polygonal areas, and
the survey marker is detected based on the different hued polygonal areas or different colored on the survey marker.

### Claim 5 (depends on 1)

The survey marker according to claim 1, wherein the image is captured by an unmanned aerial vehicle (UAV).

### Claim 6 (depends on 5)

The survey marker according to claim 5, wherein
the UAV transmits laser light to the at least two areas, and
the UAV receives a reflected laser light that is reflected by the at least two areas.

### Claim 7 (depends on 1)

The survey marker according to claim 1, wherein
the survey marker includes a plurality of different hued areas or different colored areas differentiated by perimeters of concentric circles, and
the survey marker is detected based on the different hued areas or different colored areas differentiated by the perimeters of concentric circles on the survey marker.

### Claim 8 (depends on 1)

The survey marker according to claim 1, wherein
the first area and the third area has a same color, and
the second area and the fourth area have a same color.

### Claim 9 (depends on 1)

The survey marker according to claim 1, wherein
the first area and the third area has a same pattern, and
the second area and the fourth area have a same pattern.

### Claim 10

A survey marker, comprising:
a global navigation satellite system (GNSS) receiver that receives a signal from a GNSS satellite; and
the survey marker includes a first region and a second region, wherein
the first region includes at least two areas with different properties from one another,
the second region is stacked above the first region along a direction perpendicular to a first surface of the first region,
a ground position of the survey marker is measured by the signals received on the GNSS receiver,
the survey marker is detectable based on the different properties of the at least two areas, and
a position of the survey marker, in an image that includes the survey marker, is associated with the ground position.

### Claim 11 (depends on 10)

The survey marker according to claim 10, further comprising:
a casing which is separable from the GNSS receiver.

### Claim 12 (depends on 10)

The survey marker according to claim 10, wherein the second region includes a second surface which is not parallel to the first surface of the first region.
