# US 2023/0055232 A1 · Discovery Of And Connection To Remote Devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0055232 A1
- Document ID: US20230055232A1
- Status: Published application
- Kind: A1
- Application number: 17/980,057
- Filed: 2022-11-03
- Published: 2023-02-23
- Earliest claimed: 2019-05-21
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Jeffrey S. Norris; Bruno M. Sommer; Alexandre Da Veiga
- Web page: https://patentgrep.com/patent/US20230055232A1

## CPC

- G08C 17/02: using a radio link
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06V 10/22: by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
- G06V 20/20: in augmented reality scenes
- H04W 8/005: {Discovery of network devices, e.g. terminals}
- H04W 76/10: Connection setup
- G08C 2201/31: Voice input
- G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A method includes receiving one or more signals that each indicate a device type for a respective remote device, identifying one or more visible devices in one or more images, matching a first device from the one or more visible devices with a first signal from the one or more signals based on a device type of the first device matching a device type for the first signal and based on a visible output of the first device, pairing the first device with a second device, and controlling a function of the first device using the second device.

## Claims

### Claim 1

A method, comprising:
receiving one or more signals that each indicate a device type for a respective remote device;
identifying one or more visible devices in one or more images;
matching a first device from the one or more visible devices with a first signal from the one or more signals based on a device type of the first device matching a device type for the first signal and based on a visible output of the first device;
pairing the first device with a second device; and
controlling a function of the first device using the second device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the visible output of the first device includes light emitted by the first device.

### Claim 3 (depends on 1)

The method of claim 1, wherein the one or more signals each indicate a location for the respective remote device.

### Claim 4 (depends on 3)

The method of claim 3, wherein matching the first device with the first signal is further based on a location of the first device matching the location for the first signal.

### Claim 5 (depends on 4)

The method of claim 4, wherein the location of the first device is determined using the one or more images.

### Claim 6 (depends on 1)

The method of claim 1, wherein the device type of the first device is determined based on the one or more images using an object detection model.

### Claim 7 (depends on 1)

The method of claim 1, wherein the one or more images are captured using an imaging device that is associated with at least one of the second device or a host device that is separate from the second device.

### Claim 8

A non-transitory computer-readable storage device including program instructions executable by one or more processors that, when executed, cause the one or more processors to perform operations, the operations comprising:
receiving one or more signals that each indicate a device type for a respective remote device;
identifying one or more visible devices in one or more images;
matching a first device from the one or more visible devices with a first signal from the one or more signals based on a device type of the first device matching a device type for the first signal and based on a visible output of the first device;
pairing the first device with a second device; and
controlling a function of the first device using the second device.

### Claim 9 (depends on 8)

The non-transitory computer-readable storage device of claim 8, wherein the visible output of the first device includes light emitted by the first device.

### Claim 10 (depends on 8)

The non-transitory computer-readable storage device of claim 8, wherein the one or more signals each indicate a location for the respective remote device.

### Claim 11 (depends on 10)

The non-transitory computer-readable storage device of claim 10, wherein matching the first device with the first signal is further based on a location of the first device matching the location for the first signal.

### Claim 12 (depends on 11)

The non-transitory computer-readable storage device of claim 11, wherein the location of the first device is determined using the one or more images.

### Claim 13 (depends on 8)

The non-transitory computer-readable storage device of claim 8, wherein the device type of the first device is determined based on the one or more images using an object detection model.

### Claim 14 (depends on 8)

The non-transitory computer-readable storage device of claim 8, wherein the one or more images are captured using an imaging device that is associated with at least one of the second device or a host device that is separate from the second device.

### Claim 15

A system, comprising:
a memory; and
one or more processors that are configured to execute instructions that are stored in the memory, wherein the instructions, when executed, cause the one or more processors to:
receive one or more signals that each indicate a device type for a respective remote device;
identify one or more visible devices in one or more images;
match a first device from the one or more visible devices with a first signal from the one or more signals based on a device type of the first device matching a device type for the first signal and based on a visible output of the first device;
pair the first device with a second device; and
control a function of the first device using the second device.

### Claim 16 (depends on 15)

The system of claim 15, wherein the visible output of the first device includes light emitted by the first device.

### Claim 17 (depends on 15)

The system of claim 15, wherein the one or more signals each indicate a location for the respective remote device.

### Claim 18 (depends on 17)

The system of claim 17, wherein matching the first device with the first signal is further based on a location of the first device matching the location for the first signal.

### Claim 19 (depends on 18)

The system of claim 18, wherein the location of the first device is determined using the one or more images.

### Claim 20 (depends on 15)

The system of claim 15, wherein the device type of the first device is determined based on the one or more images using an object detection model.

### Claim 21 (depends on 15)

The system of claim 15, wherein the one or more images are captured using an imaging device that is associated with at least one of the second device or a host device that is separate from the second device.
