# US 2022/0032162 A1 · Reflective video display apparatus for interactive training and demonstration and methods of using same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0032162 A1
- Document ID: US20220032162A1
- Status: Published application
- Kind: A1
- Application number: 17/504,066
- Filed: 2021-10-18
- Published: 2022-02-03
- Earliest claimed: 2018-05-29
- Assignees: Curiouser Products Inc.
- Applicants: Curiouser Products Inc.
- Inventors: Brynn PUTNAM
- Web page: https://patentgrep.com/patent/US20220032162A1

## CPC

- A45D 42/00: Hand, pocket, or shaving mirrors
- A63B 71/0622: {Visual, audio or audio-visual systems for entertaining, instructing or motivating the user}
- A45D 44/00: Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
- A61B 5/0079: {using mirrors, i.e. for self-examination}
- A61B 5/0205: Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
- A61B 5/024: Measuring pulse rate or heart rate
- A61B 5/1128: {using image analysis (A61B5/1127 takes precedence)}
- A61B 5/4884: {inducing physiological or psychological stress, e.g. applications for stress testing}
- A61B 5/6891: {Furniture}
- A61B 5/743: {Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots}
- A61B 5/7435: {Displaying user selection data, e.g. icons in a graphical user interface}
- A63B 24/0062: {Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance}
- A63B 24/0075: {Means for generating exercise programmes or schemes, e.g. computerized virtual trainer, e.g. using expert databases}
- G02B 27/144: {using partially transparent surfaces without spectral selectivity (G02B27/147 takes precedence)}
- G06F 1/1605: {Multimedia displays, e.g. with integrated or attached speakers, cameras, microphones}
- G06F 3/06: Digital input from, or digital output to, record carriers {, e.g. RAID, emulated record carriers or networked record carriers}
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- G09B 5/06: with both visual and audible presentation of the material to be studied
- G09B 19/00: Teaching not covered by other main groups of this subclass (teaching or practice apparatus for gun-aiming or gun-laying F41G3/26)
- G09B 19/003: {Repetitive work cycles; Sequence of movements}
- G09B 19/0038: {Sports}
- G09F 13/12: using a transparent mirror or other light reflecting surface transparent to transmitted light whereby a sign, symbol, picture or other is visible only when illuminated
- G16H 40/63: for local operation
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- H04L 65/613: for the control of the source by the destination (control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637)
- H04L 65/80: Responding to QoS
- H04M 1/72409: by interfacing with external accessories (hands-free H04M1/60)
- H04N 5/445: for displaying additional information (H04N5/50 takes precedence)
- H04N 21/2187: Live feed
- H04N 21/4126: {The peripheral being portable, e.g. PDAs or mobile phones}
- H04N 21/41265: {having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204)}
- H04N 21/414: Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 21/431: Generation of visual interfaces {for content selection or interaction}; Content or additional data rendering
- H04N 21/44: Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N 21/44029: {for generating different versions}
- H04N 21/4415: using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning {(cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861)}
- H04N 21/47205: {for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally}
- H04N 21/8545: for generating interactive applications
- H04W 4/38: for collecting sensor information
- A47G 1/16: Devices for hanging or supporting pictures, mirrors, or the like
- A61B 2503/10: Athletes
- A63B 2024/0068: {Comparison to target or threshold, previous performance or not real time comparison to other individuals}
- A63B 2071/063: {Spoken or verbal instructions}
- A63B 2071/065: {Visualisation of specific exercise parameters}
- A63B 2071/068: {Input by voice recognition}
- A63B 2220/806: Video cameras
- A63B 2225/12: with mirrors
- A63B 2225/20: with means for remote communication, e.g. internet or the like
- A63B 2225/50: Wireless data transmission, e.g. by radio transmitters or telemetry
- A63B 2230/06: heartbeat rate only
- A63B 2230/50: temperature
- G16Y 10/70: Broadcasting
- G16Y 20/40: relating to personal data, e.g. biometric data, records or preferences
- H04M 1/724095: {Worn on the wrist, hand or arm}
- H04M 1/72412: using two-way short-range wireless interfaces
- H04W 88/08: Access point devices
- A45D: HAIRDRESSING OR SHAVING EQUIPMENT (wigs, toupees or the like A41G3/00, A41G5/00; hairdressers' chairs A47C1/04; hair cutting appliances, razors B26B); EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
- A63B: APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT (apparatus for passive exercising, massage A61H)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G09F: DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- A47G: HOUSEHOLD OR TABLE EQUIPMENT (book-ends A47B5/00; knives B26B)
- G16Y: INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]

## Abstract

A smart mirror can show live or recorded streaming video of an instructor performing a workout in a package that is attractive and unobtrusive enough to hang in a living room. The smart mirror includes a mirror surface with a fully reflecting section and a partially reflecting section. A display behind the partially reflecting section shows the video when the smart mirror is on and is almost invisible when the smart mirror is off. The smart mirror also has a speaker, a microphone, and a camera to enable a user to view the video content and interact with the instructor. The smart mirror may connect to the user's smart phone, a peripheral device (e.g., a Bluetooth speaker) to augment user experience, a biometric sensor to provide biometric data to assess user performance, and/or a network router to connect the smart mirror to a content provider, an instructor, and/or other users.

## Claims

### Claim 1

An apparatus, comprising:
a communications interface to receive heart rate data associated with a user and broadcast exercise content;
a display operatively coupled to the communications interface, the display configured to display to the user the broadcast exercise content and the heart rate data associated with the user;
a mirror disposed in front of the display, the mirror to reflect an image of the user opposite the display, the broadcast exercise content appearing one of superimposed on or adjacent to a portion of the image of the user reflected by the mirror when the broadcast exercise content is displayed by the display; and
a processor operably coupled to the display,
the processor configured to receive via the communications interface the heart rate data associated with the user while the broadcast exercise content is displayed to the user,
the processor configured to determine, based on the heart rate data, that a heart rate of the user is outside a target range for the user, and
the processor configured to modify, in response to determining that the heart rate data is outside the target range for the user, the displayed broadcast exercise content to bring the heart rate of the user to within the target range.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the broadcast exercise content includes previously recorded broadcast exercise content.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the broadcast exercise content includes real-time broadcast exercise content.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein:
the processor is configured to evaluate exercise performance of the user based on the heart rate data concurrently with the display of the broadcast exercise content to the user; and
the processor is configured to cause display, on at least one of the display or a smartphone of the user, of an indication of the exercise performance of the user.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein:
the processor is configured to evaluate the exercise performance of the user by determining a difference between the heart rate and a target heart rate, and
the processor is configured to display the indication of the exercise performance by displaying the heart rate and/or the target heart rate.

### Claim 6 (depends on 4)

The apparatus of claim 4, wherein:
the user is a first user,
the processor is configured to evaluate an exercise performance of a second user based on heart rate data associated with the second user, and
the processor is configured to cause display, on at least one of the display or on a smartphone of the first user, of an indication of the exercise performance of the second user.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the display is configured to display at least one of historical exercise performance or historical heart rate data of the user.

### Claim 8

A method, comprising:
receiving, at a processor of a smart mirror, via a communications interface of the smart mirror and when broadcast exercise content is displayed via a display of the smart mirror, heart rate data associated with a user, the smart mirror including a mirror disposed in front of the display, the mirror configured to reflect an image of the user, the broadcast exercise content appearing one of superimposed on or adjacent to a portion of the reflected image of the user when the broadcast exercise content is displayed by the display;
determining, via the processor and based on the heart rate data, that a heart rate of the user is outside a target range for the user; and
causing modification of the broadcast exercise content when displayed, via the processor, in response to determining that the heart rate data is outside the target range for the user, to bring the heart rate of the user to within the target range.

### Claim 9 (depends on 8)

The method of claim 8, wherein the broadcast exercise content includes previously recorded broadcast exercise content.

### Claim 10 (depends on 8)

The method of claim 8, wherein the broadcast exercise content includes real-time broadcast exercise content.

### Claim 11 (depends on 8)

The method of claim 8, further comprising:
evaluating exercise performance of the user based on the heart rate data concurrently with the display of the broadcast exercise content to the user; and
causing display, on at least one of the display or a smartphone of the user, of an indication of the exercise performance of the user.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
evaluating the exercise performance of the user by determining a difference between the heart rate and the target range for the user, and
displaying the indication of the exercise performance by displaying the heart rate and/or the target range for the user.

### Claim 13 (depends on 11)

The method of claim 11, wherein the user is a first user, the method further comprising:
evaluating an exercise performance of a second user based on heart rate data associated with the second user, and
causing display, on at least one of the display or on a smartphone of the first user, of an indication of the exercise performance of the second user.

### Claim 14 (depends on 8)

The method of claim 8, wherein the display is configured to display at least one of historical exercise performance data of the user or historical heart rate data of the user.

### Claim 15

A non-transitory, processor-readable medium storing instructions to cause a processor to:
receive, at a smart mirror, via a communications interface of the smart mirror and when broadcast exercise content is displayed via a display of the smart mirror, heart rate data associated with a user, the smart mirror including a mirror configured to reflect an image of the user, the broadcast exercise content appearing one of superimposed on or adjacent to a portion of the reflected image of the user when the broadcast exercise content is displayed by the display;
determine, based on the heart rate data, that a heart rate of the user is outside a target range for the user, and
cause modification of the broadcast exercise content when displayed, in response to determining that the heart rate data is outside the target range for the user, to bring the heart rate of the user to within the target range.

### Claim 16 (depends on 15)

The non-transitory, processor-readable medium of claim 15, wherein the broadcast exercise content includes previously recorded broadcast exercise content.

### Claim 17 (depends on 15)

The non-transitory, processor-readable medium of claim 15, wherein the broadcast exercise content includes real-time broadcast exercise content.

### Claim 18 (depends on 15)

The non-transitory, processor-readable medium of claim 15, further storing instructions to cause the processor to:
evaluate exercise performance of the user based on the heart rate data; and
cause display, on at least one of the display or a smartphone of the user, of an indication of the exercise performance of the user.

### Claim 19 (depends on 18)

The non-transitory, processor-readable medium of claim 18, further storing instructions to cause the processor to:
evaluate the exercise performance of the user by determining a difference between the heart rate and the target range for the user, and
display the indication of the exercise performance by displaying the heart rate and/or the target range for the user.

### Claim 20 (depends on 18)

The non-transitory, processor-readable medium of claim 18, wherein the user is a first user, the medium further storing instructions to cause the processor to:
evaluate an exercise performance of a second user based on heart rate data associated with the second user, and
cause display, on at least one of the display or on a smartphone of the first user, of an indication of the exercise performance of the second user.
