# US 2018/0268747 A1 · Face recognition triggered digital assistant and led light ring for a smart mirror

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0268747 A1
- Document ID: US20180268747A1
- Status: Published application
- Kind: A1
- Application number: 15/922,798
- Filed: 2018-03-15
- Published: 2018-09-20
- Earliest claimed: 2017-03-15
- Assignees: Aether, Inc.
- Applicants: Aether Inc.
- Inventors: Max Braun
- Web page: https://patentgrep.com/patent/US20180268747A1

## CPC

- G06V 10/82: using neural networks
- G02B 27/144: {using partially transparent surfaces without spectral selectivity (G02B27/147 takes precedence)}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 18/24143: {Distances to neighbourhood prototypes, e.g. restricted Coulomb energy networks [RCEN]}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 10/764: using classification, e.g. of video objects
- G06V 20/20: in augmented reality scenes
- G06V 40/172: {Classification, e.g. identification}
- G09F 9/30: in which the desired character or characters are formed by combining individual elements (panels comprising a number of electrodes in a single cell controlling light arriving from an independent light source, e.g. electro-optical or magneto-optical cell, G02F1/00)
- G09F 13/12: using a transparent mirror or other light reflecting surface transparent to transmitted light whereby a sign, symbol, picture or other is visible only when illuminated
- H04N 1/00408: {Display of information to the user, e.g. menus}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09F: DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Embodiments are directed to a method and apparatus for displaying information on and interacting with a mirror. An embodiment includes a method of triggering a digital assistant by recognizing a face, the method comprising using a camera to constantly process frames, detecting a face in the frames, comparing the detected face to a set of known authorized faces, determining if the face is an authorized face, and triggering a digital assistant that can access the data of the authorized face. Additional features include combining two-way mirrors with displays, computing hardware, cameras, speakers, and LED lights. In another aspect, the present disclosure is directed to a smart mirror displaying information to a user. This includes detecting the user and displaying information to the user through LED status lights, display device, and augmented reality filter overlays.

## Claims

### Claim 1

A smart mirror comprising:
a two-way mirror that is capable of reflecting an image of the user on a front side of said two-way mirror;
at least one display device that is capable of displaying information through a back side of said two-way mirror onto said front side of said two-way mirror;
a spacer that surrounds the exterior of said at least one display devices and is capable of blocking the light from passing between said spacer and said at least one display devices;
a circuit board;
a computer processor;
a back cover;
at least one LED light forming an LED light ring, wherein said LED light ring is located on said circuit board, and wherein said LED light ring is capable of shining through said two-way mirror, wherein the at least one display devices, when turned off or displaying black, is configured to blend in with said spacer blocking light when viewed from said front side of said two-way mirror.

### Claim 2 (depends on 1)

The smart mirror of claim 1, further comprising a camera located on said circuit board that is capable of capturing pictures and film through said two-way mirror.

### Claim 3 (depends on 2)

The smart mirror of claim 2, wherein the camera is an infrared (IR) camera capable of measuring the distance between the smart mirror and an object.

### Claim 4 (depends on 1)

The smart mirror of claim 1, further comprising a speaker.

### Claim 5 (depends on 1)

The smart mirror of claim 1, further comprising a light sensor capable of dynamically adjusting the display device's background brightness as to make the edge of said display device's borders appear invisible.

### Claim 6 (depends on 1)

The smart mirror of claim 1, further comprising a sealant capable of sealing the border between said display device and said spacer, as to prevent any light leakage.

### Claim 7 (depends on 1)

The smart mirror of claim 1, further comprising a microphone.

### Claim 8 (depends on 1)

The smart mirror of claim 1, further comprising a stand attached to said back cover.

### Claim 9 (depends on 8)

The smart mirror of claim 8, further comprising a base attached to the bottom end of said stand, wherein said base comprises a pad for wireless charging of electronic devices.

### Claim 10

A method for taking a picture with a smart mirror, comprising:
activating a camera that is located behind the back side of a two-way mirror and capable of taking a picture through a back and a front sides of said two-way mirror;
turning on at least one LED light from a set of LED lights that are located behind the surface of said back side of said two-way mirror and are capable of shining light through said back side and said front side of said two-way mirror; and
taking a picture with said camera.

### Claim 11 (depends on 10)

The method of claim 10, further comprising activating the camera upon detection of a user's smile.

### Claim 12 (depends on 10)

The method of claim 10, further comprising activating the camera upon detection of an authorized voice input.

### Claim 13 (depends on 10)

The method of claim 10, wherein the activation of the camera is accomplished by a facial recognition program.

### Claim 14 (depends on 10)

The method of claim 10, wherein after said camera takes a picture, the picture of the user is displayed to the user on the front side of said two-way mirror, wherein said picture is displayed using a display device located on said back side of said two-way mirror.

### Claim 15

A method for triggering a digital assistant on a smart mirror, the method comprising:
receiving a face input from a camera device located behind a two-way mirror;
determining whether the face input satisfies a predetermined condition;
determining whether the face input corresponds to a predetermined condition;
determining whether a sound input is detected;
determining whether said sound input is a recognized voice; and
initiating a speech-based service.

### Claim 16 (depends on 15)

The method of claim 15, wherein determining whether the face input corresponds to a predetermined condition further comprises recognizing an audible command.

### Claim 17 (depends on 15)

The method of claim 15, wherein the determining whether a sound input is detected further comprises detecting a trigger word.

### Claim 18 (depends on 15)

The method of claim 15, further comprising detecting the presence of a user in front of said mirror device.

### Claim 19

A non-transitory computer readable medium storing a program which when executed by at least one processing unit of a computing device provides an augmented-reality experience on a smart mirror, the program comprising instructions for:
tracking a user's face;
calculating the viewport from the user's perspective relative to a display device located behind said smart mirror; and
displaying an augmented reality overly onto the user's reflection on the surface of said smart mirror.

### Claim 20 (depends on 19)

The non-transitory computer readable medium of claim 19, wherein the augmented reality overlay is overlaid over the reflection of the user's face.
