# US 10,372,988 B2 · Systems and methods for automatically varying privacy settings of wearable camera systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,372,988 B2
- Document ID: US10372988B2
- Status: Granted
- Kind: B2
- Application number: 15/493,894
- Filed: 2017-04-21
- Published: 2017-08-17
- Granted: 2019-08-06
- Earliest claimed: 2016-01-06
- Assignees: OrCam Technologies Ltd.
- Applicants: OrCam Technologies Ltd.
- Inventors: Yonatan Wexler; Amnon Shashua
- Web page: https://patentgrep.com/patent/US10372988B2

## CPC

- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G05B 15/02: electric
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/002: {Specific input/output arrangements not covered by G06F3/01 - G06F3/16 (other optical apparatus G02B27/00)}
- G06F 3/005: {Input arrangements through a video camera}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G06F 16/22: Indexing; Data structures therefor; Storage structures
- G06F 16/51: Indexing; Data structures therefor; Storage structures
- G06F 16/583: using metadata automatically derived from the content
- G06F 16/5866: {using information manually generated, e.g. tags, keywords, comments, manually generated location and time information}
- G06F 16/587: using geographical or spatial information, e.g. location
- G06F 18/24: Classification techniques
- G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes}
- G06K 7/10366: {the interrogation device being adapted for miscellaneous applications}
- G06Q 10/103: {Workflow collaboration or project management}
- G06V 10/10: Image acquisition (document image scanning and transmission H04N1/00; control of digital cameras H04N23/60)
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 10/764: using classification, e.g. of video objects
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G06V 20/20: in augmented reality scenes
- G06V 20/35: {Categorising the entire scene, e.g. birthday party or wedding scene}
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06V 40/113: {Recognition of static hand signs}
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G08B 21/18: Status alarms (G08B21/02 takes precedence)
- H04L 65/61: for supporting one-way streaming services, e.g. Internet radio
- H04N 1/00342: {with a radio frequency tag transmitter or receiver (storage of additional information in an RFID tag attached to an image bearing paper sheet H04N1/32138)}
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 7/15: Conference systems
- H04N 7/185: {from a mobile camera, e.g. for remote control}
- H04N 23/11: for generating image signals from visible and infrared light wavelengths
- H04N 23/56: provided with illuminating means
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
- H04W 4/02: Services making use of location information
- H04W 4/029: Location-based management or tracking services
- G06Q 30/0631: {Recommending goods or services}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A wearable imaging apparatus is provided for capturing and processing images from an environment of a user. In one implementation, the wearable apparatus may be configured with a memory for storing privacy mode triggers and associated automatically variable privacy mode settings, and at least one processing device. The processing device may analyze the images captured by the wearable apparatus, and recognize the presence of at least one of the privacy mode triggers within the images. After recognizing the at least one trigger, the processing device may cause one or more adjustments to the wearable apparatus based on the privacy mode settings associated with the at least one trigger.

## Claims

### Claim 1

A wearable imaging apparatus having variable privacy settings, the wearable apparatus comprising:
a wearable image sensor configured to capture a plurality of images from an environment of a wearer of the wearable imaging apparatus;
a memory for storing privacy mode triggers and associated privacy mode settings;
at least one processing device programmed to:
analyze the plurality of images and recognize within one or more of the plurality of images a presence of at least one of the privacy mode triggers, the at least one recognized privacy mode trigger including a representation of at least one recognized individual in at least one of the plurality of images;
identify, based on the representation of the recognized individual, a private contextual situation and automatically alter the privacy mode settings based on the identification;
identify multiple portions of one image from the plurality of images and perform at least one processing action on each of the multiple portions independently;
automatically cause one or more adjustments to the wearable imaging apparatus based on the processing actions and the privacy mode settings associated with the at least one recognized individual, wherein the one or more adjustments include causing transmission, via a wireless transmitter and to a paired device, information indicative of the identity of the individual, without transmitting to the paired device the one or more of the plurality of images, to thereby enable the paired device to execute a function relating to the individual, and wherein the function includes displaying information relating to the individual; and
revert the privacy mode settings to their original state once the identified private contextual situation is determined to no longer exist.

### Claim 2 (depends on 1)

The wearable apparatus of claim 1, wherein the at least one recognized privacy mode trigger includes a presence in the one or more of the plurality of images features associated with a bathroom.

### Claim 3 (depends on 2)

The wearable apparatus of claim 2, wherein the one or more adjustments include causing a suspension of image capture by the wearable image sensor.

### Claim 4 (depends on 2)

The wearable apparatus of claim 2, wherein the one or more adjustments include causing a suspension of storage of images captured by the wearable image sensor.

### Claim 5 (depends on 1)

The wearable apparatus of claim 1, further comprising a microphone, and wherein recognition of the presence of the at least one privacy mode trigger is based, at least in part, on analysis of audio information received via the microphone.

### Claim 6 (depends on 5)

The wearable apparatus of claim 5, wherein the audio information includes an indicator of a confidential conversation.

### Claim 7 (depends on 5)

The wearable apparatus of claim 5, wherein the audio information includes an indicator of a desire of an individual not to be recorded.

### Claim 8 (depends on 1)

The wearable apparatus of claim 1, further comprising a transmitter, and wherein the one or more adjustments include a limitation placed on a type of information transmitted by the wearable imaging apparatus.

### Claim 9 (depends on 1)

Use wearable apparatus of claim 1, wherein the recognized privacy mode trigger includes at least one of: entry into a bathroom, exit from a bathroom, a child, nudity, a sign prohibiting recording, or a tag associated with a limitation on recording.

### Claim 10 (depends on 1)

The wearable apparatus of claim 1, wherein the one or more adjustments include enabling capturing of images but prohibiting storage of captured images.

### Claim 11 (depends on 1)

The wearable apparatus of claim 1, wherein the one or more adjustments include enabling capturing of images but prohibiting transmission of captured images.

### Claim 12 (depends on 11)

The wearable apparatus of claim 11, wherein the one or more adjustments include enabling transmission of caricature or cartoon representations of captured images.

### Claim 13 (depends on 11)

The wearable apparatus of claim 11, wherein the one or more adjustments include enabling transmission of low resolution, distorted, and/or blurred versions of captured images.

### Claim 14 (depends on 1)

The wearable apparatus of claim 1, wherein the one or more adjustments include suspending capture of audio information from a microphone.

### Claim 15 (depends on 1)

The wearable apparatus of claim 1, wherein the one or more adjustments include suspending transmission of audio information front a microphone.

### Claim 16 (depends on 1)

The wearable apparatus of claim 1, wherein the one or more adjustments include prohibiting posting of captured images on social media.

### Claim 17 (depends on 1)

The wearable apparatus of claim 1, wherein the one or more adjustments include applying an image filter to images captured by the wearable image sensor.

### Claim 18 (depends on 1)

The wearable apparatus of claim 1, wherein the at least one processing device is further programmed to: based on the presence of at least one of the privacy mode triggers, identify a first portion and a second portion of at least one image of the plurality of images; process the first portion using a first processing scheme, and the process the second portion using a second processing scheme.

### Claim 19

A method for adjusting variable privacy settings of a wearable imaging apparatus, the method comprising:
receiving a plurality of images captured from an environment of a wearer of the wearable imaging apparatus;
analyzing the plurality of images and recognizing within one or more of the plurality of images a presence of at least one privacy mode trigger, the at least one recognized privacy mode trigger including a representation of at least one recognized individual in at least one of the plurality of images;
identifying, based on the representation of the recognized individual, a private contextual situation and automatically after the privacy mode settings based on the identification;
identifying multiple portions of one image from the plurality of images and performing at least one processing acting on each of the multiple portions independently;
automatically causing one or more adjustments to the wearable imaging apparatus based on processing actions and the privacy mode settings associated with the at least one recognized individual, wherein the one or more adjustments include causing transmission, via a wireless transmitter and to a paired device, information indicative of the identity of the individual, without transmitting to the paired device the one or more of the plurality of the images, to thereby enable the paired device to execute a function relating to the individual, and wherein the function includes displaying information relating to the individual; and
reverting the privacy mode settings to their original state once the identified private contextual situation is determined to no longer exist.

### Claim 20 (depends on 19)

The method of claim 19, wherein the one or more adjustments include a limitation placed on a type of information transmitted by the wearable imaging apparatus.

### Claim 21 (depends on 19)

The method of claim 19, wherein the recognized privacy mode trigger includes at least one of: entry into a bathroom, exit from a bathroom, a child, nudity, a sign prohibiting recording, or a tag associated with a limitation on recording.

### Claim 22 (depends on 19)

The method of claim 19, wherein the one or more adjustments include prohibiting positing of captured images on social media.

### Claim 23 (depends on 19)

The method of claim 19, whereto the one or more adjustments include applying an image filter to images captured by the wearable image sensor.

### Claim 24 (depends on 19)

The method of claim 19, further comprising:
based on the presence of at least one of the privacy mode triggers, identifying a first portion and a second portion of at least one image of the plurality of images; processing the first potion using a first processing scheme, and processing the second portion using a second processing scheme.

### Claim 25 (depends on 19)

A non-transitory computer readable medium comprising instructions that are executable by at least one processing device to cause the at least one processing device to perform the method of claim 19.