# US 2021/0343085 A1 · Augmented reality field of view based on sensed user data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0343085 A1
- Document ID: US20210343085A1
- Status: Published application
- Kind: A1
- Application number: 16/864,353
- Filed: 2020-05-01
- Published: 2021-11-04
- Earliest claimed: 2020-05-01
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Divya Kannan CHAKRAVARTHI; Kriteshwar Kaur KOHLI; Vinod A. VALECHA; John A. LYONS
- Web page: https://patentgrep.com/patent/US20210343085A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- A61M 21/02: for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia (for massage A61H; electrotherapy A61N, e.g. applying alternating or intermittent electric currents for producing anaesthesia A61N1/36021)
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/0172: {characterised by optical features}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06N 20/00: Machine learning
- G06V 10/82: using neural networks
- G06V 20/20: in augmented reality scenes
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- G06V 40/15: {Biometric patterns based on physiological signals, e.g. heartbeat, blood flow}
- A61M 2021/005: {images, e.g. video}
- A61M 2205/3561: local, e.g. within room or hospital
- A61M 2205/3592: using telemetric means, e.g. radio or optical transmission
- A61M 2230/06: Heartbeat rate only
- A61M 2230/30: Blood pressure (A61M2230/04 takes precedence)
- A61M 2230/42: Rate
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G06F 2203/011: Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A61M: DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY (introducing media into or onto the bodies of animals A61D7/00; means for inserting tampons A61F13/26; devices for administering food or medicines orally A61J; containers for collecting, storing or administering blood or medical fluids A61J1/05); DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY (surgery A61B; chemical aspects of surgical articles A61L); DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR {(Electrotherapy, e.g. producing anaesthesia by the use of alternating or intermittent currents A61N1/36021)}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

User-specific augmentation of a real word field of view viewable through an augmented reality (AR) device is facilitated by a processor(s) receiving image data representative of a real world field of view viewable by a user through the AR device, and receiving sensor data indicative of the user's stress level, which is related, at least in part, to the user's real world field of view viewable through the AR device. The processor(s) processes the image data, based on the user's stress level, to identify one or more stress-inducing elements to be hidden in the real world field of view viewable through the AR device. Further, the processor(s) provides an augmented real world field of view for display to the user through the AR device, where the one or more stress-inducing elements are hidden from the user in the augmented real world field of view.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving, by one or more processors, image data on a real world field of view viewable by a user through an augmented reality (AR) device;
receiving, by the one or more processors, sensor data indicative of a stress level of the user, where the user's stress level is related, at least in part, to the real world field of view viewable by the user through the AR device;
based on the user's stress level, processing, by the one or more processors, the image data to:
identify an element in the real world field of view inducing stress for the user, the user and the element being in motion relative to each other;
predict, by the one or more processors, that the user and the element may intersect;
identify another element in the real world field of view inducing stress for the user, the user and the other element being in motion relative to each other; and
predict, by the one or more processors, that the user and the other element will not intersect; and
providing, by the one or more processors, an augmented real world field of view for display to the user through the AR device, where the element is not hidden from the user in the augmented real world field of view viewable through the AR device, and the other element is hidden from the user in the augmented real world field of view viewable through the AR device.

### Claim 2

(canceled)

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the element and the other element each comprise one or more people in the real world field of view viewable through the AR device.

### Claim 4

(canceled)

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising receiving, by the one or more processors, location data for the user to predict whether the user is approaching a crowded area, and wherein the processing is further based on the location data predicting that the user approaching the crowded area.

### Claim 6

(canceled)

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the providing comprises:
based on identifying the other element for the user to be hidden, generating, by the one or more processors, a spatial mapping of the image data around the other element; and
using, by the one or more processors, the spatial mapping to provide the augmented real world field of view by selectively hiding the other element.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, further comprising using machine learning and the sensor data to classify the user's stress level, and the processing comprises processing the image data to identify the element and the other element based, at least in part, on the user's classified stress level.

### Claim 9

(canceled)

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the sensor data comprises data indicative of the user's heart rate.

### Claim 11

A system comprising:
a memory;
one or more processors in communication with the memory; and
program instructions executable by the one or more processors via the memory to perform a method comprising:
receiving, by the one or more processors, image data on a real world field of view viewable by a user through an augmented reality (AR) device;
receiving, by the one or more processors, sensor data indicative of a stress level of the user, where the user's stress level is related, at least in part, to the real world field of view viewable by the user through the AR device;
based on the user's stress level, processing, by the one or more processors, the image data to:
identify an element in the real world field of view inducing stress for the user, the user and the element being in motion relative to each other;
predict, by the one or more processors, that the user and the element may intersect;
identify another element in the real world field of view inducing stress for the user, the user and the other element being in motion relative to each other; and
predict, by the one or more processors, that the user and the other element will not intersect; and
providing, by the one or more processors, an augmented real world field of view for display to the user through the AR device, where the element is not hidden from the user in the augmented real world field of view viewable through the AR device, and the other element is hidden from the user in the augmented real world field of view viewable through the AR device.

### Claim 12 (depends on 11)

The system of claim 11, wherein the element and the other element each comprise one or more people in the real world field of view viewable through the AR device.

### Claim at position 13

13-14. (canceled)

### Claim 15 (depends on 11)

The system of claim 11, wherein the providing comprises:
based on identifying the other element for the user to be hidden, generating, by the one or more processors, a spatial mapping of the image data around the other element; and
using, by the one or more processors, the spatial mapping to provide the augmented real world field of view by selectively hiding the other element.

### Claim 16 (depends on 11)

The system of claim 11, further comprising using machine learning and the sensor data to classify the user's stress level, and the processing comprises processing the image data to identify the element and the other element based, at least in part, on the user's classified stress level.

### Claim 17

A computer program product comprising:
a computer-readable storage medium having computer-readable code embodied therein, the computer-readable code being executable by one or more processors to cause the one or more processors to:
receive, by the one or more processors, image data on a real world field of view viewable by a user through an augmented reality (AR) device;
receive, by the one or more processors, sensor data indicative of a stress level of the user, where the user's stress level is related, at least in part, to the real world field of view viewable by the user through the AR device;
based on the user's stress level, process, by the one or more processors, the image data to:
identify an element in the real world field of view inducing stress for the user, the user and the element being in motion relative to each other;
predict, by the one or more processors, that the user and the element may intersect;
identify another element in the real world field of view inducing stress for the user, the user and the other element being in motion relative to each other; and
predict, by the one or more processors, that the user and the other element will not intersect; and
provide, by the one or more processors, an augmented real world field of view for display to the user through the AR device, where the element is not hidden from the user in the augmented real world field of view viewable through the AR device, and the other element is hidden from the user in the augmented real world field of view viewable through the AR device.

### Claim 18 (depends on 17)

The computer program product of claim 17, wherein the element and the other element each comprise one or more people in the real world field of view viewable through the AR device.

### Claim at position 18

19-20. (canceled)
