# US 10,375,266 B2 · Systems and methods for selecting an action based on a detected person

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,375,266 B2
- Document ID: US10375266B2
- Status: Granted
- Kind: B2
- Application number: 15/793,370
- Filed: 2017-10-25
- Published: 2018-04-26
- Granted: 2019-08-06
- Earliest claimed: 2016-10-26
- Assignees: OrCam Technologies Ltd.
- Applicants: OrCam Technologies Ltd.
- Inventors: Yonatan Wexler; Amnon Shashua
- Web page: https://patentgrep.com/patent/US10375266B2

## CPC

- H04N 1/32101: {Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title}
- G01S 5/0027: {of actual mobile position, i.e. position determined on mobile}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 16/23: Updating
- G06F 16/51: Indexing; Data structures therefor; Storage structures
- G06F 16/5838: {using colour}
- G06F 18/21: Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F 21/31: User authentication
- G06N 5/04: Inference or reasoning models
- G06Q 10/42: Determination of affinities or common interests between users
- G06T 1/0007: {Image acquisition}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/60: Analysis of geometric attributes
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/73: using feature-based methods
- G06V 20/20: in augmented reality scenes
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V 40/172: {Classification, e.g. identification}
- H04L 51/52: for supporting social networking services
- H04L 67/306: User profiles
- H04L 67/535: {Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34)}
- H04N 7/185: {from a mobile camera, e.g. for remote control}
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 23/51: Housings
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 23/80: Camera processing pipelines; Components thereof
- G06T 2207/10004: Still image; Photographic image
- G06T 2207/30196: Human being; Person
- G06T 2207/30201: Face
- G06V 2201/07: Target detection
- G06V 2201/10: Recognition assisted with metadata
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

The present disclosure relates to systems and methods for selecting an action based on a detected person. In one implementation, a wearable apparatus may include a wearable image sensor configured to capture a plurality of images from the environment of the user of the wearable apparatus and at least one processing device. The at least one processing device may be programmed to analyze at least one of the plurality of images to detect the person; analyze at least one of the plurality of images to identify an attribute of the detected person; select at least one category for the detected person based on the identified attribute; select at least one action based on the at least one category; and cause the at least one selected action to be executed.

## Claims

### Claim 1

A wearable apparatus for causing an action to be executed based on a person being present in an environment of a user of the wearable apparatus, the wearable apparatus comprising:
a wearable image sensor configured to capture a plurality of images from the environment of the user of the wearable apparatus; and
at least one processing device programmed to:
analyze at least one of the plurality of images to detect the person;
analyze at least one of the plurality of images to identify an attribute of the detected person;
select at least one category for the detected person based on the identified attribute;
select at least one action from a plurality of alternative actions associated with the at least one category, the action comprising software instructions for the at least one processing device or a second processing device paired with the wearable apparatus; and
cause the at least one selected action to be executed by the at least one processing device or the second processing device.

### Claim 2 (depends on 1)

The wearable apparatus of claim 1, wherein the at least one category is selected from a plurality of attribute categories.

### Claim 3 (depends on 1)

The wearable apparatus of claim 1, wherein the analysis of the at least one of the plurality of images to identify the attribute of the detected person includes analyzing the at least one of the plurality of images to estimate an age of the detected person, and selecting the at least one category for the detected person based on the identified attribute includes categorizing the detected person into the at least one category based on the estimated age of the detected person.

### Claim 4 (depends on 1)

The wearable apparatus of claim 1, wherein the analysis of the at least one of the plurality of images to identify the attribute of the detected person includes analyzing the at least one of the plurality of images to estimate a height of the detected person, and selecting the at least one category for the detected person based on the identified attribute includes categorizing the detected person into the at least one category based on the estimated height of the detected person.

### Claim 5 (depends on 1)

The wearable apparatus of claim 1, wherein the analysis of the at least one of the plurality of images to identify the attribute of the detected person includes analyzing the at least one of the plurality of images to estimate a weight of the detected person, and selecting the at least one category for the detected person based on the identified attribute includes categorizing the detected person into the at least one category based on the estimated weight of the detected person.

### Claim 6 (depends on 1)

The wearable apparatus of claim 1, wherein the analysis of the at least one of the plurality of images to identify the attribute of the detected person includes analyzing the at least one of the plurality of images to identify a gender of the detected person, and selecting the at least one category for the detected person based on the identified attribute includes categorizing the detected person into the at least one category based on the identified gender of the detected person.

### Claim 7 (depends on 1)

The wearable apparatus of claim 1, wherein the analysis of the at least one of the plurality of images to identify the attribute of the detected person includes analyzing the at least one of the plurality of images to determine an identity of the detected person, and the at least one processing device is further programmed to, based on the identity of the detected person, determine a type of a relationship between the user and the detected person, and wherein selecting the at least one category for the detected person based on the identified attribute includes categorizing the detected person into the at least one category based on the type of the relationship between the user and the detected person.

### Claim 8 (depends on 1)

The wearable apparatus of claim 1, wherein the at least one action includes at least one of transmitting information for an amber alert and transmitting information to update a database of missing persons.

### Claim 9 (depends on 1)

The wearable apparatus of claim 1, wherein the at least one action includes identifying the person.

### Claim 10 (depends on 1)

The wearable apparatus of claim 1, wherein the at least one action includes at least one of uploading an image and tagging an image.

### Claim 11 (depends on 1)

The wearable apparatus of claim 1, wherein the at least one action includes at least one of updating a log and updating a timeline or a Gantt chart.

### Claim 12 (depends on 1)

The wearable apparatus of claim 1, wherein the at least one action includes providing information related to a potential dating match.

### Claim 13 (depends on 1)

The wearable apparatus of claim 1, wherein the at least one action includes updating at least one of a social graph and a social network profile.

### Claim 14 (depends on 1)

The wearable apparatus of claim 1, wherein the at least one category includes a statistical category.

### Claim 15 (depends on 14)

The wearable apparatus of claim 14, wherein the statistical category is associated with a geographical region.

### Claim 16 (depends on 14)

The wearable apparatus of claim 14, wherein the statistical category is associated with a time period.

### Claim 17 (depends on 14)

The wearable apparatus of claim 14, wherein the at least one action includes updating information related to the statistical category.

### Claim 18 (depends on 17)

The wearable apparatus of claim 17, wherein updating the information related to the statistical category includes updating a count of unique persons associated with the statistical category.

### Claim 19 (depends on 1)

The wearable apparatus of claim 1, wherein causing the at least one selected action to be executed includes sending information to the device paired with the wearable apparatus, and wherein the device paired with the wearable apparatus includes the at least one processing device or the second processing device.

### Claim 20 (depends on 1)

The wearable apparatus of claim 1, wherein the at least one processing device is further programmed to:
analyze at least one of the plurality of images to detect a second person;
analyze at least one of the plurality of images to identify an attribute of the second person;
select at least one category for the second person based on the identified attribute of the second person; and
further base the selection of the at least one action on the at least one category selected for the second person.

### Claim 21

A method for causing an action to be executed based on a person being present in an environment of a user of a wearable apparatus, the method comprising:
receiving a plurality of images captured by an image sensor of the wearable apparatus from the environment of the user of the wearable apparatus;
analyzing at least one of the plurality of images to detect the person;
analyzing at least one of the plurality of images to identify an attribute of the detected person;
selecting at least one category for the detected person based on the identified attribute;
selecting at least one action from a plurality of alternative actions associated with the at least one category, the action comprising software instructions for the at least one processing device or a second processing device paired with the wearable apparatus; and
causing the at least one selected action to be executed by the at least one processing device or the second processing device.

### Claim 22 (depends on 21)

The method of claim 21, wherein the at least one category is selected from a plurality of attribute categories.

### Claim 23

A non-transitory computer readable medium storing computer-executable instructions that, when executed by the processor, cause the processor to perform a method comprising:
receiving a plurality of images captured by an image sensor of a wearable apparatus from an environment of a user of the wearable apparatus;
analyzing at least one of the plurality of images to detect the person;
analyzing at least one of the plurality of images to identify an attribute of the detected person;
selecting at least one category for the detected person based on the identified attribute;
selecting at least one action from a plurality of alternative actions associated with the at least one category, the action comprising software instructions for the at least one processing device or a second processing device paired with the wearable apparatus; and
causing the at least one selected action to be executed by the at least one processing device or the second processing device.