# US 10,313,552 B2 · Systems and methods for providing visual feedback of a field of view

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,313,552 B2
- Document ID: US10313552B2
- Status: Granted
- Kind: B2
- Application number: 15/793,661
- Filed: 2017-10-25
- Published: 2018-04-26
- Granted: 2019-06-04
- Earliest claimed: 2016-10-26
- Assignees: OrCam Technologies Ltd.
- Applicants: OrCam Technologies Ltd.
- Inventors: Yonatan Wexler; Amnon Shashua
- Web page: https://patentgrep.com/patent/US10313552B2

## CPC

- H04N 1/32101: {Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title}
- G01S 5/0027: {of actual mobile position, i.e. position determined on mobile}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 16/23: Updating
- G06F 16/51: Indexing; Data structures therefor; Storage structures
- G06F 16/5838: {using colour}
- G06F 18/21: Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F 21/31: User authentication
- G06N 5/04: Inference or reasoning models
- G06Q 10/42: Determination of affinities or common interests between users
- G06T 1/0007: {Image acquisition}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/60: Analysis of geometric attributes
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/73: using feature-based methods
- G06V 20/20: in augmented reality scenes
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V 40/172: {Classification, e.g. identification}
- H04L 51/52: for supporting social networking services
- H04L 67/306: User profiles
- H04L 67/535: {Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34)}
- H04N 7/185: {from a mobile camera, e.g. for remote control}
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 23/51: Housings
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 23/80: Camera processing pipelines; Components thereof
- G06T 2207/10004: Still image; Photographic image
- G06T 2207/30196: Human being; Person
- G06T 2207/30201: Face
- G06V 2201/07: Target detection
- G06V 2201/10: Recognition assisted with metadata
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A wearable apparatus may include at least one image sensor configured to capture a plurality of images from an environment of a user of the wearable apparatus and at least one projector. The at least one light projector may be configured to emit a light pattern configured to visually indicate to the user of the wearable apparatus an active field of view of the at least one image sensor.

## Claims

### Claim 1

A wearable apparatus, the wearable apparatus comprising:
at least one image sensor configured to capture a plurality of images from an environment of a user of the wearable apparatus, the wearable apparatus configured to be secured to an object worn by the user;
at least one projector configured to emit a light pattern configured to visually indicate to the user of the wearable apparatus an active field of view of the at least one image sensor; and
at least one processing device programmed to activate or deactivate the at least one projector based at least on an amount of a time that an object remains present in the active field of view of the at least one image sensor.

### Claim 2 (depends on 1)

The wearable apparatus of claim 1, wherein the light pattern coincides with one or more borders of the active field of view of the at least one image sensor.

### Claim 3 (depends on 1)

The wearable apparatus of claim 1, wherein the light pattern is included within the active field of view of the at least one image sensor.

### Claim 4 (depends on 1)

The wearable apparatus of claim 1, wherein the light pattern overlaps with the active field of view of the at least one image sensor.

### Claim 5 (depends on 1)

The wearable apparatus of claim 1, wherein the at least one processing device is further programmed to activate or deactivate the at least one projector in response to a user input.

### Claim 6 (depends on 5)

The wearable apparatus of claim 5, wherein the user input includes a voice command or an input associated with a depressible button of the wearable apparatus.

### Claim 7 (depends on 1)

The wearable apparatus of claim 1, wherein the at least one processing device is further programmed to activate or deactivate the at least one projector based at least on a visual trigger appearing in at least one of the plurality of images.

### Claim 8 (depends on 7)

The wearable apparatus of claim 7, wherein the visual trigger includes a hand gesture.

### Claim 9 (depends on 7)

The wearable apparatus of claim 7, wherein the visual trigger includes an appearance of a document or a bank note.

### Claim 10 (depends on 7)

The wearable apparatus of claim 7, wherein the visual trigger includes detecting an object in a hand of the user.

### Claim 11 (depends on 1)

The wearable apparatus of claim 1, wherein the at least one processing device is further programmed to: activate the at least one projector based at least on a first visual trigger appearing in at least a first one the plurality of images; and deactivate the at least one projector based at least on a second visual trigger appearing in at least a second one of the plurality of images.

### Claim 12 (depends on 1)

The wearable apparatus of claim 1, wherein the at least one processing device is further programmed to activate or deactivate the at least one projector based at least on a visual context associated with at least one of the plurality of images.

### Claim 13 (depends on 1)

The wearable apparatus of claim 1, wherein the light pattern includes at least two parallel lines, each of the two parallel lines being associated with a border of the active field of view of the at least one image sensor.

### Claim 14 (depends on 1)

The wearable apparatus of claim 1, wherein the light pattern includes at least two perpendicular lines, each of the two perpendicular lines being associated with a border of the active field of view of the at least one image sensor.

### Claim 15 (depends on 1)

The wearable apparatus of claim 1, wherein the light pattern includes lines or dashes in a rectangular pattern, the rectangular pattern being associated with a border of the active field of view of the at least one image sensor.

### Claim 16 (depends on 1)

The wearable apparatus of claim 1, wherein the projector includes one or more light path altering structures, one or more light hoods, or one or more shrouds.

### Claim 17 (depends on 1)

The wearable apparatus of claim 1, wherein the projector includes one or more solid state lasers.

### Claim 18 (depends on 17)

The wearable apparatus of claim 17, wherein the one or more solid state lasers are configured to scan at least a portion of a surface or object in the environment of the user.

### Claim 19 (depends on 1)

The wearable apparatus of claim 1, wherein the light pattern includes a circular or elliptical outline pattern, a rectangular outline pattern, a square outline pattern, a dashed pattern, one or more illuminated dots, a rectangular solid illumination pattern, a square solid illumination pattern, a circular solid illumination pattern, an elliptical solid illumination pattern, two parallel horizontal lines, or two parallel vertical lines.

### Claim 20 (depends on 1)

The wearable apparatus of claim 1, further comprising a switch or a button configured to change an illumination state of the projector.

### Claim 21 (depends on 1)

The wearable apparatus of claim 1, further comprising a microphone, wherein the at least one processing device is further programmed to change, based on a voice command captured at the microphone, an illumination state of the projector, a color of the light pattern, or a shape of the light pattern.

### Claim 22 (depends on 1)

The wearable apparatus of claim 1, further comprising an adjustment component configured to align the at least one projector with the active field of view of the at least one image sensor.

### Claim 23 (depends on 22)

The wearable apparatus of claim 22, wherein the adjustment component includes one or more micromotors, one or more splined or threaded rods, or one or more piezoelectric steppers.

### Claim 24 (depends on 1)

The wearable apparatus of claim 1, wherein the object worn by the user is glasses.

### Claim 25 (depends on 1)

The wearable apparatus of claim 1, wherein the object worn by the user is an article of clothing.

### Claim 26

A method for providing visual feedback to a user of a wearable apparatus, the method comprising:
capturing, via at least one image sensor included in the wearable apparatus, a plurality of images from an environment of the user of the wearable apparatus, the wearable apparatus configured to be secured to an object worn by the user;
activating at least one projector included in the wearable apparatus based at least on a visual trigger appearing in at least one of the plurality of images;
emitting, via the at least one projector, a light pattern configured to visually indicate to the user of the wearable apparatus an active field of view of the at least one image sensor; and
activating or deactivating the at least one projector based at least on an amount of a time that an object remains present in the active field of view of the at least one image sensor.

### Claim 27 (depends on 26)

The method of claim 26, further comprising:
activating or deactivating the at least one projector in response to a user input.

### Claim 28 (depends on 27)

The method of claim 27, wherein the user input includes a voice command or an input associated with a depressible button of the wearable apparatus.

### Claim 29

A non-transitory computer-readable medium that stores instructions that, when executed by at least one processing device, cause the at least one processing device to perform operations comprising:
receiving, from at least one image sensor included in the wearable apparatus, a plurality of images from an environment of the user of the wearable apparatus, the wearable apparatus configured to be secured to an object worn by the user;
activating at least one projector included in the wearable apparatus based at least on a visual trigger appearing in at least one of the plurality of images;
causing the at least one projector to emit a light pattern configured to visually indicate to the user of the wearable apparatus an active field of view of the at least one image sensor; and
activating or deactivating the at least one projector based at least on an amount of a time that an object remains present in the active field of view of the at least one image sensor.
