# US 2025/0095321 A1 · Equipment operation device and equipment operation method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095321 A1
- Document ID: US20250095321A1
- Status: Published application
- Kind: A1
- Application number: 18/961,596
- Filed: 2024-11-27
- Published: 2025-03-20
- Earliest claimed: 2022-06-09
- Assignees: Mitsubishi Electric Corporation
- Applicants: Mitsubishi Electric Corporation
- Inventors: Takashi OGAWA
- Web page: https://patentgrep.com/patent/US20250095321A1

## CPC

- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G08C 17/00: Arrangements for transmitting signals characterised by the use of a wireless electrical link
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G06T 2207/20221: Image fusion; Image merging
- H04Q 9/00: Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04Q: SELECTING (switches, relays, selectors H01H; wireless communication networks H04W)

## Abstract

An equipment operation device includes processing circuitry is configured to; acquire, from a camera, image data indicating a captured image in which operation target equipment and a peripheral region of the operation target equipment appear; perform a process of detecting a difference between the captured image indicated by the acquired image data and a first registered image that has been recorded; record the captured image as a second registered image that is different from the first registered image when the difference is detected, and acquire a second captured image differentiated from the first registered image that has been recorded and to record the second captured image as the second registered image that is different from the first registered image when the difference is not detected; and download an operation application of the operation target equipment appearing in the second registered image having been recorded.

## Claims

### Claim 1

An equipment operation device comprising:
processing circuitry configured to
acquire, from a camera, image data indicating a captured image in which operation target equipment and a peripheral region of the operation target equipment appear;
perform a process of detecting a difference between the captured image indicated by the acquired image data and a first registered image that has been recorded;
record the captured image as a second registered image that is different from the first registered image when the difference is detected, and acquire a second captured image differentiated from the first registered image that has been recorded and to record the second captured image as the second registered image that is different from the first registered image when the difference is not detected; and
download an operation application of the operation target equipment appearing in the second registered image having been recorded.

### Claim 2 (depends on 1)

The equipment operation device according to claim 1, wherein
the processing circuitry acquires, from the camera, image data indicating a captured image in which the operation target equipment with an identification marker and the peripheral region appear as the second captured image.

### Claim 3 (depends on 2)

The equipment operation device according to claim 2,
wherein the processing circuitry is further configured to
present guidance to prompt a user to paste the identification marker when the difference is not detected;
acquire image data indicating a captured image in which the operation target equipment to which the identification marker is pasted and the peripheral region appear from the camera after the guidance is presented; and
acquire, as the image data indicating the second captured image, the acquired image data after the guidance is presented.

### Claim 4 (depends on 1)

The equipment operation device according to claim 1, wherein
the processing circuitry is further configured to combine an illustration component indicating an identification marker with the operation target equipment appearing in the captured image indicated by image data having been acquired, and acquire an image in which the operation target equipment with the identification marker and the peripheral region appear as the second captured image.

### Claim 5 (depends on 1)

The equipment operation device according to claim 1,
wherein the processing circuitry is further configured to receive selection of any one operation application from among one or more operation applications having been downloaded and execute the selected operation application.

### Claim 6 (depends on 1)

The equipment operation device according to claim 1,
wherein the processing circuitry is further configured to add a grid to the captured image indicated by the acquired image data and output the captured image with the grid.

### Claim 7 (depends on 1)

The equipment operation device according to claim 1,
wherein the processing circuitry is further configured to receive designation of a feature region that is a region of interest in the captured image indicated by the image data having been acquired when the processing circuitry performs the process of detecting the difference between the captured image indicated by the acquired image and the first registered image that has been recorded, and to output a captured image in which the feature region is designated.

### Claim 8 (depends on 7)

The equipment operation device according to claim 7, wherein
when receiving designation of a plurality of feature regions, the processing circuitry receives designation of a priority order of each of the feature regions, and outputs a captured image in which the feature region with the priority order is designated.

### Claim 9

An equipment operation method comprising:
acquiring from a camera, image data indicating a captured image in which operation target equipment and a peripheral region of the operation target equipment appear;
performing a process of detecting a difference between the captured image indicated by the acquired image data and a first registered image that has been recorded;
recording the captured image as a second registered image that is different from the first registered image when the difference is detected, and acquiring a second captured image differentiated from the first registered image that has been recorded, and recording the second captured image as the second registered image that is different from the first registered image when the difference is not detected; and
downloading an operation application of the operation target equipment appearing in the second registered image having been recorded.
