# US 2021/0004444 A1 · Wearable Electronic Device Having a Light Field Camera

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0004444 A1
- Document ID: US20210004444A1
- Status: Published application
- Kind: A1
- Application number: 17/024,574
- Filed: 2020-09-17
- Published: 2021-01-07
- Earliest claimed: 2017-09-28
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Dale Setlak; Giovanni Gozzini; Manohar B. Srikanth; Mohammad Yeke Yazdandoost
- Web page: https://patentgrep.com/patent/US20210004444A1

## CPC

- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 1/1686: {the I/O peripheral being an integrated camera}
- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- G06V 10/141: Control of illumination
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V 40/11: {Hand-related biometrics; Hand pose recognition}
- G06V 40/14: Vascular patterns
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method of authenticating a user of a wearable electronic device includes emitting light into a dorsal side of a forearm near a wrist of the user; receiving, using a light field camera, remissions of the light from the dorsal side of the forearm near the wrist of the user; generating a light field image from the remissions of the light; performing a synthetic focusing operation on the light field image to construct at least one image of at least one layer of the forearm near the wrist; extracting a set of features from the at least one image; determining whether the set of features matches a reference set of features; and authenticating the user based on the matching. In some embodiments, the method may further include compensating for a tilt of the light field camera prior to or while performing the synthetic focusing operation.

## Claims

### Claim 1

A watch body, comprising:
a housing;
a cover mounted to the housing, the cover having:
a first surface exterior to the watch body; and
a second surface interior to the watch body;
a light emitter positioned to emit light through the cover into a dorsal side of a forearm near a wrist of a user when the first surface of the cover is positioned adjacent the dorsal side of the forearm near the wrist of the user;
a light field camera positioned adjacent the second surface to receive remissions of the light through the cover from the dorsal side of the forearm near the wrist; and
a processor configured to operate the light emitter and the light field camera, obtain a light field image from the light field camera, and perform a synthetic focusing operation on the light field image to construct at least one image of at least one layer of the forearm near the wrist.

### Claim 2 (depends on 1)

The watch body of claim 1, wherein the light field camera comprises:
an array of non-overlapping image sensing regions;
a pinhole mask positioned between the array of non-overlapping image sensing regions and the second surface of the cover; and
a spacer between the array of non-overlapping image sensing regions and the pinhole mask; wherein,
the array of non-overlapping image sensing regions is aligned with an array of pinholes in the pinhole mask to form a set of micro-cameras having fields of view that overlap exterior to the watch body; and
the processor is further configured to extract a set of features from the at least one image, determine whether the set of features matches a reference set of features, and perform an operation in response to whether the set of features matches the reference set of features.

### Claim 3 (depends on 1)

The watch body of claim 1, wherein the processor is further configured to extract a set of features from the at least one image, determine whether the set of features matches a reference set of features, and perform an operation in response to whether the set of features matches the reference set of features.

### Claim 4 (depends on 3)

The watch body of claim 3, wherein the operation comprises a bioauthentication operation.

### Claim 5 (depends on 1)

The watch body of claim 1, wherein the light field camera comprises:
a first array of non-overlapping image sensing regions; and
a second array of light-transmissive elements positioned between the first array and the second surface of the cover; wherein,
the first array is aligned with the second array to form a set of micro-cameras having fields of view that overlap exterior to the watch body.

### Claim 6 (depends on 5)

The watch body of claim 5, wherein the non-overlapping image sensing regions comprise discrete image sensors.

### Claim 7 (depends on 5)

The watch body of claim 5, wherein the non-overlapping image sensing regions comprise regions of a single image sensor.

### Claim 8 (depends on 5)

The watch body of claim 5, wherein the light-transmissive elements comprise lenses.

### Claim 9 (depends on 5)

The watch body of claim 5, further comprising:
a pinhole mask positioned between the first array and the second surface of the cover; wherein,
the light-transmissive elements comprise pinholes defined by the pinhole mask.

### Claim 10 (depends on 5)

The watch body of claim 5, wherein the light field camera further comprises:
a spacer between the first array and the second array.

### Claim 11 (depends on 10)

The watch body of claim 10, wherein the spacer comprises a layer of glass.

### Claim 12 (depends on 1)

The watch body of claim 1, further comprising:
a set of light emitters including the light emitter, wherein the light emitters are positioned to emit light from around the light field camera.

### Claim 13 (depends on 1)

The watch body of claim 1, further comprising:
a set of light emitters including the light emitter; wherein,
the light field camera comprises a set of micro-cameras having fields of view that overlap exterior to the watch body; and
the set of light emitters is positioned to emit light from within a boundary defined by the set of micro-cameras.

### Claim 14 (depends on 1)

The watch body of claim 1, wherein the processor is further configured to:
determine, using the light field camera, a tilt of the light field camera with respect to the dorsal side of the forearm near the wrist; and
compensate for the determined tilt prior to or while performing the synthetic focusing operation.

### Claim 15 (depends on 1)

The watch body of claim 1, wherein the light emitter comprises an infrared emitter.

### Claim 16

A watch body, comprising:
a housing;
a cover mounted to the housing, the cover having:
a first surface exterior to the watch body; and
a second surface interior to the watch body;
a light emitter positioned to emit light through the cover into a dorsal side of a forearm near a wrist of a user when the first surface of the cover is positioned adjacent the dorsal side of the forearm near the wrist;
a light field camera positioned adjacent the second surface to receive remissions of the light through the cover from the dorsal side of the forearm near the wrist; and
a tilt sensor configured to detect a tilt of the light field camera with respect to the dorsal side of the forearm near the wrist.

### Claim 17 (depends on 16)

The watch body of claim 16, wherein the tilt sensor comprises a set of proximity sensors.

### Claim 18 (depends on 17)

The watch body of claim 17, wherein the set of proximity sensors comprises at least one capacitive sensor.

### Claim 19 (depends on 17)

The watch body of claim 17, wherein the set of proximity sensors comprises at least one optical sensor.

### Claim 20

A method of authenticating a user of a wearable electronic device, comprising:
emitting light into a dorsal side of a forearm near a wrist of the user;
receiving, using a light field camera, remissions of the light from the dorsal side of the forearm near the wrist of the user;
generating a light field image from the remissions of the light;
performing a synthetic focusing operation on the light field image to construct at least one image of at least one layer of the forearm near the wrist;
extracting a set of features from the at least one image;
determining whether the set of features matches a reference set of features; and
authenticating the user in response to the set of features matching the reference set of features.
