# US 2025/0157212 A1 · Information processing method, information processing device, and non-transitory computer readable recording medium storing information processing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0157212 A1
- Document ID: US20250157212A1
- Status: Published application
- Kind: A1
- Application number: 19/024,948
- Filed: 2025-01-16
- Published: 2025-05-15
- Earliest claimed: 2022-07-20
- Assignees: Panasonic Intellectual Property Management Co., Ltd.
- Applicants: Panasonic Intellectual Property Management Co., Ltd.
- Inventors: Satoshi MATSUI; Tadamasa TOMA; Minami NAKA
- Web page: https://patentgrep.com/patent/US20250157212A1

## CPC

- G06V 10/987: {with the intervention of an operator}
- G06T 7/00: Image analysis
- G06T 7/73: using feature-based methods
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 20/50: Context or environment of the image
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N 23/60: Control of cameras or camera modules
- G06T 2207/30204: Marker
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image processing device acquires an image captured by a camera, recognizes a plurality of markers included in the image, calculates a distance between each of the plurality of markers that are recognized, identifies a first capturable area surrounded by a predetermined number of markers belonging to a first marker group among the plurality of markers that are recognized and a second capturable area surrounded by a predetermined number of markers belonging to a second marker group among the plurality of markers that are recognized based on the distance that is calculated, creates a mask image in which an area outside the first capturable area and the second capturable area in the image is masked, and outputs the mask image.

## Claims

### Claim 1

An information processing method in a computer, the information processing method comprising:
acquiring an image captured by a camera;
recognizing a plurality of markers included in the image;
calculating a distance between each of the plurality of markers that are recognized;
identifying a first capturable area surrounded by a predetermined number of markers belonging to a first marker group among the plurality of markers that are recognized and a second capturable area surrounded by a predetermined number of markers belonging to a second marker group among the plurality of markers that are recognized based on the distance that is calculated;
creating a mask image in which an area outside the first capturable area and the second capturable area in the image is masked; and
outputting the mask image.

### Claim 2 (depends on 1)

The information processing method according to claim 1, wherein in identifying the first capturable area and the second capturable area, the first marker group including the predetermined number of markers between which the distance is equal to or less than a threshold and the second marker group including the predetermined number of markers between which the distance is equal to or less than a threshold are identified.

### Claim 3 (depends on 1)

The information processing method according to claim 1, wherein in identifying the first capturable area and the second capturable area, in a case where a plurality of markers of a same type exist, a marker with the distance closest from a marker as a reference is identified as a marker belonging to a same marker group as the marker as the reference.

### Claim 4 (depends on 1)

The information processing method according to claim 1, wherein
a positional relationship between the predetermined number of markers belonging to each of the first marker group and the second marker group is determined in advance, and
the information processing method further comprises:
determining whether or not the predetermined number of markers are arranged according to the positional relationship determined in advance in a case of recognizing the plurality of markers first; and
outputting notification information for notifying a worker that a positional relationship between the predetermined number of markers is incorrect in a case of determining that the predetermined number of markers are not arranged according to the positional relationship determined in advance.

### Claim 5 (depends on 1)

The information processing method according to claim 1, wherein
a positional relationship between the predetermined number of markers belonging to each of the first marker group and the second marker group is determined in advance, and
the information processing method further comprises:
determining whether or not the predetermined number of markers are arranged according to the positional relationship determined in advance in a case of recognizing the plurality of markers first; and
outputting notification information for notifying a worker of a marker not arranged according to the positional relationship determined in advance in a case of determining that the predetermined number of markers are not arranged according to the positional relationship determined in advance.

### Claim 6 (depends on 4)

The information processing method according to claim 4, further comprising:
receiving input by the worker about a number of a plurality of marker groups to be used and a number of the predetermined number of markers belonging to each marker group; and
determining whether or not the plurality of markers, a number of which is same as a number of all markers belonging to the plurality of marker groups that are input, are recognized in a case of recognizing the plurality of markers first,
wherein in determining whether or not the predetermined number of markers are arranged according to the positional relationship determined in advance, in a case where the plurality of markers, a number of which is same as a number of all markers belonging to each of the plurality of marker groups that are input, are determined to be recognized, whether or not the predetermined number of markers are arranged according to the positional relationship determined in advance is determined.

### Claim 7 (depends on 4)

The information processing method according to claim 4, further comprising:
presenting the image that is acquired to the worker in a case where the plurality of markers are first recognized; and
receiving input by the worker as to whether or not all markers belonging to a plurality of marker groups are recognized in the image,
wherein in determining whether or not the predetermined number of markers are arranged according to the positional relationship determined in advance, in a case where the worker inputs that all the markers belonging to the marker groups are recognized, whether or not the predetermined number of markers are arranged according to the positional relationship determined in advance is determined.

### Claim 8 (depends on 1)

The information processing method according to claim 1, wherein
the predetermined number of markers belonging to the first marker group include a first marker arranged at an upper left position, a second marker arranged at a lower left position, a third marker arranged at an upper right position, and a fourth marker arranged at a lower right position in a first work area that is capturable in a work space, and
the predetermined number of markers belonging to the second marker group include a fifth marker arranged at an upper left position, a sixth marker arranged at a lower left position, a seventh marker arranged at an upper right position, and an eighth marker arranged at a lower right position in a second work area that is capturable in the work space.

### Claim 9 (depends on 8)

The information processing method according to claim 8, wherein
in identifying the first capturable area and the second capturable area,
in a case where there are the second marker and the sixth marker below the first marker, the second marker closer to the first marker and with a distance to the first marker equal to or less than a threshold is determined as a marker belonging to the first marker group,
in a case where there are the third marker and the seventh marker on a right side of the first marker, the third marker closer to the first marker and with a distance to the first marker equal to or less than a threshold is determined as a marker belonging to the first marker group,
in a case where there are the fourth marker and the eighth marker on the right side of the second marker, the fourth marker closer to the second marker and with a distance to the second marker equal to or less than a threshold is determined as a marker belonging to the first marker group, and
in a case where there are the fourth marker and the eighth marker below the third marker, the fourth marker closer to the third marker and with a distance to the third marker equal to or less than a threshold is determined as a marker belonging to the first marker group.

### Claim 10

An information processing device comprising:
an acquisition part that acquires an image captured by a camera;
a recognition part that recognizes a plurality of markers included in the image;
a calculation part that calculates a distance between each of the plurality of markers that are recognized;
an identification part that identifies a first capturable area surrounded by a predetermined number of markers belonging to a first marker group among the plurality of markers that are recognized and a second capturable area surrounded by a predetermined number of markers belonging to a second marker group among the plurality of markers that are recognized based on the distance that is calculated;
a creation part that creates a mask image in which an area outside the first capturable area and the second capturable area in the image is masked; and
an output part that outputs the mask image.

### Claim 11

A non-transitory computer readable recording medium storing an information processing program that causes a computer to function to:
acquire an image captured by a camera;
recognize a plurality of markers included in the image;
calculate a distance between each of the plurality of markers that are recognized;
identify a first capturable area surrounded by a predetermined number of markers belonging to a first marker group among the plurality of markers that are recognized and a second capturable area surrounded by a predetermined number of markers belonging to a second marker group among the plurality of markers that are recognized based on the distance that is calculated;
create a mask image in which an area outside the first capturable area and the second capturable area in the image is masked; and
output the mask image.
