# US 2026/0073693 A1 · Information processing terminal and remote control method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073693 A1
- Document ID: US20260073693A1
- Status: Published application
- Kind: A1
- Application number: 19/256,255
- Filed: 2025-07-01
- Published: 2026-03-12
- Earliest claimed: 2025-07-01
- Assignees: Maxell, Ltd.
- Applicants: Maxell, Ltd.
- Inventors: Mayumi NAKADE; Tamotsu ITO
- Web page: https://patentgrep.com/patent/US20260073693A1

## CPC

- G06V 20/50: Context or environment of the image
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/0485: Scrolling or panning
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06T 11/00: Two-dimensional [2D] image generation
- G06V 20/20: in augmented reality scenes
- G08C 17/00: Arrangements for transmitting signals characterised by the use of a wireless electrical link
- G08C 17/02: using a radio link
- H04L 67/12: specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04M 1/72415: for remote control of appliances
- H04Q 9/00: Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
- G06V 30/10: Character recognition
- G08C 2201/30: User interface
- G08C 2201/93: Remote control using other portable devices, e.g. mobile phone, PDA, laptop
- H04W 4/70: Services for machine-to-machine communication [M2M] or machine type communication [MTC]
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04Q: SELECTING (switches, relays, selectors H01H; wireless communication networks H04W)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

An information processing terminal including a communication device, which transmits a control command to a controlled device via the communication device to remotely control the controlled device, comprises: a virtual remote control generator configured to identify the controlled device and a desired control operation that is a control operation desired to be performed from a surrounding image which is an image around the information processing terminal, and generate an acceptance object for accepting an operation instruction to the desired control operation from a user; an operation acceptance section configured to accept the operation instruction from the user via the acceptance object; and a command transmitter configured to transmit the control command corresponding to the operation instruction accepted by the operation acceptance section to the controlled device.

## Claims

### Claim 1

An information processing terminal comprising:
a communication interface configured to communicate with a controlled device;
a camera configured to acquire a surrounding image which is an image around the information processing terminal;
an operation interface configured to accept an operation instruction from a user of the information processing terminal;
a display; and
processing circuitry,
wherein the processing circuitry is configured to:
acquire controlled device identification information for identifying a controlled device and desired control operation identification information for identifying a desired control operation to the controlled device, respectively, from a controlled device description and a desired control operation description written on a presentation surface member included in the surrounding image acquired by the camera;
acquire control data on the controlled device using the controlled device identification information;
associate a predetermined control command of a set of control commands for controlling the controlled device included in the control data with the desired control operation identified by the desired control operation identification information; and
generate a virtual remote control image including an acceptance object corresponding to the desired control operation identification information,
wherein the display is configured to display the acceptance object included in the virtual remote control image generated by the processing circuitry in an area where the desired control operation description is written on the presentation surface member, and
wherein the communication interface is configured to transmit the predetermined control command, associated with the desired control operation identified by the desired control operation identification information corresponding to the acceptance object, to the controlled device, using the operation instruction as an instruction to the acceptance object included in the virtual remote control image, when the operation instruction accepted by the operation interface is an instruction corresponding to the desired control operation description written on the presentation surface member.

### Claim 2 (depends on 1)

The information processing terminal according to claim 1, wherein
the display is configured to display the virtual remote control image for a predetermined period of time and then erase the virtual remote control image.

### Claim 3 (depends on 1)

The information processing terminal according to claim 1, wherein
when the desired control operation identified by the desired control operation identification information is a control operation that the controlled device does not accept, the processing circuitry is configured to generate a non-available display, and the display is configured to display the non-available display superimposed on the acceptance object.

### Claim 4 (depends on 1)

The information processing terminal according to claim 1, further comprising a memory,
wherein the processing circuitry is configured to acquire a control data table, in which the control data is associated with the controlled device identification information, from either the memory, an external server, or the controlled device.

### Claim 5 (depends on 1)

The information processing terminal according to claim 1, further comprising a memory storing an analysis table, wherein the processing circuitry is configured to acquire the controlled device identification information and the desired control operation identification information using the analysis table.

### Claim 6 (depends on 1)

The information processing terminal according to claim 1, wherein
the desired control operation is an operation that the user wants to perform to the controlled device.

### Claim 7 (depends on 1)

The information processing terminal according to claim 1, wherein
the presentation surface member is shaped like a sheet-like member or a whiteboard, and the description is a character or a figure described by the user of the information processing terminal.

### Claim 8 (depends on 1)

The information processing terminal according to claim 1, wherein
the communication interface comprises at least one of a LAN communication interface and a near field communication interface.

### Claim 9 (depends on 1)

The information processing terminal according to claim 1, wherein
the information processing terminal is a head-mounted display or a smartphone.

### Claim 10

A control method for an information processing terminal, comprising the steps of:
acquiring, by a camera of the information processing terminal, a surrounding image which is an image around the information processing terminal;
acquiring controlled device identification information for identifying a controlled device and desired control operation identification information for identifying a desired control operation to the controlled device, respectively, from a controlled device description and a desired control operation description written on a presentation surface member included in the surrounding image acquired by the camera;
acquiring control data on the controlled device using the controlled device identification information;
associating a predetermined control command of a set of control commands for controlling the controlled device included in the control data with the desired control operation identified by the desired control operation identification information;
generating a virtual remote control image including an acceptance object corresponding to the desired control operation identification information;
displaying the acceptance object included in the generated virtual remote control image in an area where the desired control operation description is written on the presentation surface member;
accepting an operation instruction from a user of the information processing terminal; and
transmitting the predetermined control command, associated with the desired control operation identified by the desired control operation identification information corresponding to the acceptance object, to the controlled device, using the operation instruction as an instruction to the acceptance object included in the virtual remote control image, when the accepted operation instruction is an instruction corresponding to the desired control operation description written on the presentation surface member.

### Claim 11 (depends on 10)

The control method according to claim 10, further comprising
displaying the virtual remote control image for a predetermined period of time and then erasing the virtual remote control image.

### Claim 12 (depends on 10)

The control method according to claim 10, further comprising
when the desired control operation identified by the desired control operation identification information is a control operation that the controlled device does not accept, generating a non-available display, and displaying the non-available display superimposed on the acceptance object.

### Claim 13 (depends on 10)

The control method according to claim 10, further comprising
acquiring a control data table, in which the control data is associated with the controlled device identification information, from either a memory of the information processing terminal, a server, or the controlled device.

### Claim 14 (depends on 10)

The control method according to claim 10, further comprising
acquiring the controlled device identification information and the desired control operation identification information using an analysis table stored in a memory of the information processing terminal.

### Claim 15 (depends on 10)

The control method according to claim 10, wherein
the desired control operation is an operation that the user wants to perform to the controlled device.

### Claim 16 (depends on 10)

The control method according to claim 10, wherein
the presentation surface member is shaped like a sheet-like member or a whiteboard, and the description is a character or a figure described by the user of the information processing terminal.

### Claim 17 (depends on 10)

The control method according to claim 10, wherein
the information processing terminal is a head-mounted display or a smartphone.
