# US 10,373,013 B2 · Systems and methods for identifying objects and providing information related to identified objects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,373,013 B2
- Document ID: US10373013B2
- Status: Granted
- Kind: B2
- Application number: 15/973,115
- Filed: 2018-05-07
- Published: 2018-09-06
- Granted: 2019-08-06
- Earliest claimed: 2008-01-03
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Michael Nathaniel Rosenblatt
- Web page: https://patentgrep.com/patent/US10373013B2

## CPC

- G06V 30/142: using hand-held instruments; Constructional details of the instruments
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06V 10/462: {Salient features, e.g. scale invariant feature transforms [SIFT]}
- H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04N 5/76: Television signal recording
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and methods for identifying an object and presenting additional information about the identified object are provided. The techniques of the present invention can allow the user to specify modes to help with identifying objects. Furthermore, the additional information can be provided with different levels of detail depending on user selection. Apparatus for presenting a user with a log of the identified objects is also provided. The user can customize the log by, for example, creating a multi-media album.

## Claims

### Claim 1

A system comprising:
a data source; and
an electronic device comprising:
an output component;
object detection technology operative to detect an object in an environment of the electronic device;
an identification module operative to communicate a search request to the data source for obtaining identification information from the data source about the detected object; and
a processor operative to:
select a mode of the electronic device; and
present at least a portion of the obtained identification information for the detected object to a user via the output component, wherein the selected mode specifies at least one parameter of the search request configured to be used for searching the data source for obtaining the identification information from the data source.

### Claim 2 (depends on 1)

The system of claim 1, wherein:
the electronic device further comprises location detection technology operative to detect the location of the electronic device when the object is detected; and
the detected location of the electronic device when the object is detected specifies at least one other parameter of the search request configured to be used for searching the data source for obtaining the identification information from the data source.

### Claim 3 (depends on 2)

The system of claim 2, wherein the location detection technology comprises a global positioning system receiver.

### Claim 4 (depends on 1)

The system of claim 1, wherein the data source is remote from the electronic device.

### Claim 5 (depends on 1)

The system of claim 1, wherein the identification information comprises at least one user-selectable option for providing additional information about the detected object.

### Claim 6 (depends on 1)

The system of claim 1, wherein the identification information comprises at least two user-selectable options for providing different types of additional information about the detected object.

### Claim 7 (depends on 1)

The system of claim 1, wherein the object detection technology comprises a camera, and wherein the output component comprises a visual display.

### Claim 8 (depends on 1)

The system of claim 1, wherein the data source comprises an information database of multi-media data from which the identification information is obtained using a search based on the selected mode.

### Claim 9 (depends on 1)

The system of claim 1, wherein the processor is operative to simultaneously present the identification information for the detected object and an image of the detected object via the output component.

### Claim 10 (depends on 9)

The system of claim 9, wherein the identification information comprises at least two user-selectable options.

### Claim 11 (depends on 10)

The system of claim 10, wherein each one of the at least two user-selectable options is operative to provide additional unique information associated with the detected object when selected by the user.

### Claim 12 (depends on 9)

The system of claim 9, wherein the identification information comprises at least one link to a website comprising additional information associated with the detected object.

### Claim 13 (depends on 9)

The system of claim 9, wherein the object detection technology comprises a camera operative to capture the image, and wherein the output component comprises a visual display.

### Claim 14 (depends on 1)

The system of claim 1, wherein the identification information comprises at least one link to a website comprising additional information associated with the detected object.

### Claim 15 (depends on 1)

The system of claim 1, wherein:
the selected mode is implemented as at least one metadata tag; and
each of the at least one metadata tag specifies at least one of the at least one parameter of the search request configured to be used for searching the data source for obtaining the identification information from the data source.

### Claim 16 (depends on 1)

The system of claim 1, wherein the processor is operative to enable a user to select the mode of the electronic device.

### Claim 17 (depends on 1)

The system of claim 1, wherein:
the processor is further operative to select an other mode of the electronic device in addition to the mode of the electronic device; and
the selected other mode specifies at least one other parameter of the search request configured to be used for searching the data source for obtaining the identification information from the data source.

### Claim 18

A system comprising:
a data source; and
an electronic device comprising:
an output component;
object detection technology operative to detect an object in an environment of the electronic device;
an identification module operative to communicate with the data source for obtaining identification information from the data source about the detected object; and
a processor operative to:
select a mode of the electronic device; and
present the identification information for the detected object to a user via the output component, wherein the data source comprises an information database of multi-media data from which the identification information is obtained using the selected mode of the electronic device.

### Claim 19

A method for operating an electronic device that comprises object detection technology, an output component, and a processor, the method comprising:
detecting an object in an environment of the electronic device using the object detection technology; selecting at least one mode of the electronic device;
in response to the detecting and the selecting, automatically obtaining, using the processor, identification information associated with both the detected object and the at least one selected mode; and
presenting data, using the output component, wherein the presented data comprises at least a portion of the obtained identification information.

### Claim 20 (depends on 19)

The method of claim 19, wherein the data further comprises a user-selectable option.

### Claim 21 (depends on 20)

The method of claim 20, wherein, when the user-selectable option is selected, presenting, using the output component, other data comprising additional identification information associated with the detected object.

### Claim 22 (depends on 21)

The method of claim 21, wherein the additional identification information comprises another portion of the obtained identification information.

### Claim 23 (depends on 20)

The method of claim 20, wherein the user-selectable option comprises a link to a website comprising additional information associated with the detected object.

### Claim 24 (depends on 9)

The method of claim 9, wherein the automatically obtaining the identification information comprises automatically obtaining the identification information from a data source remote from the electronic device.

### Claim 25 (depends on 19)

The method of claim 19, wherein the data further comprises an image of the detected object.

### Claim 26 (depends on 19)

The method of claim 19, further comprising determining a location of the electronic device when the objected was detected using location detection technology of the electronic device, wherein the automatically obtaining the identification information comprises automatically obtaining the identification information that is associated with not only the detected object and the at least one selected mode but also the determined location.
