# US 2025/0168499 A1 · Observation assistance apparatus, observation assistance method, and computer-readable recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0168499 A1
- Document ID: US20250168499A1
- Status: Published application
- Kind: A1
- Application number: 18/841,019
- Filed: 2023-03-09
- Published: 2025-05-22
- Earliest claimed: 2022-03-28
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Yumiko Urasawa; Kenta Iseki
- Web page: https://patentgrep.com/patent/US20250168499A1

## CPC

- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- B64G 1/1028: {using optical means for mapping, surveying or detection, e.g. of intelligence}
- B64G 1/242: {Orbits and trajectories}
- G05D 1/225: operated by off-board computers
- G05D 1/689: Pointing payloads towards fixed or moving targets (positioning towed, pushed or suspended implements G05D1/672)
- G06T 15/60: Shadow generation
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- B64U 2101/31: for surveillance
- G05D 2109/20: Aircraft, e.g. drones
- G05D 2111/10: Optical signals
- Y02A 90/10: Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B64G: COSMONAUTICS; VEHICLES OR EQUIPMENT THEREFOR
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- Y02A: TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE

## Abstract

An observation assistance apparatus for supporting generation of control instruction information used for observation of a mobile body includes: a target region quasi-image generation unit that generates a target region quasi-image that shows a target region, which is estimated when the target region is captured from a viewpoint of a mobile body moving along a path, and a control instruction information generation unit that generates control instruction information for causing the mobile body to observe an actual observation image of the target region equivalent to the target region quasi-image, if the target region quasi-image is selected by an operator, based on mobile body position information indicating a position of the mobile body and mobile body direction information indicating a direction of the mobile body that were used when the selected target region quasi-image was generated.

## Claims

### Claim 1

An observation assistance apparatus comprising:
at least one memory storing instructions; and
at least one processor configured to execute the instructions to:
generate target region quasi-image that shows a target region and is estimated to be obtained when an image of the target region is captured from a viewpoint of a mobile body that is equipped with an observation apparatus for observing the Earth's surface and moves along a path in a space above the Earth's surface; and
generate, if the target region quasi-image is selected by an operator, control instruction information that is used for controlling at least a timing when the mobile body observes the target region, a position at which the mobile body performs observation, and a direction in which the mobile body performs observation, which are information for causing the mobile body to observe an actual observation image of the target region equivalent to the target region quasi-image, based on mobile body position information indicating a position of the mobile body and mobile body direction information indicating a direction of the mobile body that were used when the selected target region quasi-image was generated.

### Claim 2 (depends on 1)

The observation assistance apparatus according to claim 1,
wherein the one or more processors further:
adds a shadow image to the target region quasi-image using a timing when it is possible to observe the generated target region quasi-image, insolation information indicating an altitude and an amplitude of the sun in the target region, and three-dimensional map information of the target region.

### Claim 3 (depends on 1)

The observation assistance apparatus according to claim 1,
wherein the one or more processors further:
adds a shadow image to the target region quasi-image using a timing when it is possible to observe the generated target region quasi-image, weather information indicating weather in the target region, and three-dimensional map information of the target region.

### Claim 4 (depends on 1)

The observation assistance apparatus according to claim 1,
wherein the target region quasi-image and the control instruction information are displayed on a display device.

### Claim 5

An observation assistance method to be performed by a computer, comprising:
generating a target region quasi-image that shows a target region and is estimated to be obtained when an image of the target region is captured from a viewpoint of a mobile body that is equipped with an observation apparatus for observing the Earth's surface and moves along a path in a space above the Earth's surface; and
generating, if the target region quasi-image is selected by an operator, control instruction information that is used for controlling at least a timing when the mobile body observes the target region, a position at which the mobile body performs observation, and a direction in which the mobile body performs observation, which are information for causing the mobile body to observe an actual observation image of the target region equivalent to the target region quasi-image, based on mobile body position information indicating a position of the mobile body and mobile body direction information indicating a direction of the mobile body that were used when the selected target region quasi-image was generated.

### Claim 6 (depends on 5)

The observation assistance method according to claim 5,
wherein a shadow image is added to the target region quasi-image using a timing when it is possible to observe the generated target region quasi-image, insolation information indicating an altitude and an amplitude of the sun in the target region, and three-dimensional map information of the target region.

### Claim 7 (depends on 5)

The observation assistance method according to claim 5,
wherein a shadow image is added to the target region quasi-image using a timing when it is possible to observe the generated target region quasi-image, weather information indicating weather in the target region, and three-dimensional map information of the target region.

### Claim 8 (depends on 5)

The observation assistance method according to claim 5,
wherein the target region quasi-image and the control instruction information are displayed on a display device.

### Claim 9

A non-transitory computer-readable recording medium that includes a program recording thereon, the program including instructions that cause a computer to carry out:
generating a target region quasi-image that shows a target region and is estimated to be obtained when an image of the target region is captured from a viewpoint of a mobile body that is equipped with an observation apparatus for observing the Earth's surface and moves along a path in a space above the Earth's surface; and
generating, if the target region quasi-image is selected by an operator, control instruction information that is used for controlling at least a timing when the mobile body observes the target region, a position at which the mobile body performs observation, and a direction in which the mobile body performs observation, which are information for causing the mobile body to observe an actual observation image of the target region equivalent to the target region quasi-image, based on mobile body position information indicating a position of the mobile body and mobile body direction information indicating a direction of the mobile body that were used when the selected target region quasi-image was generated.

### Claim 10 (depends on 9)

The non-transitory computer-readable recording medium according to claim 9, further causing the computer to carry out:
adding a shadow image to the target region quasi-image using a timing when it is possible to observe the generated target region quasi-image, insolation information indicating an altitude and an amplitude of the sun in the target region, and three-dimensional map information of the target region.

### Claim 11 (depends on 9)

The non-transitory computer-readable recording medium according to claim 9, further causing the computer to carry out:
adding a shadow image to the target region quasi-image using a timing when it is possible to observe the generated target region quasi-image, weather information indicating weather in the target region, and three-dimensional map information of the target region.

### Claim 12 (depends on 9)

The non-transitory computer-readable recording medium according to claim 9, further causing the computer to carry out:
displaying the target region quasi-image and the control instruction information on a display device.
