# US 2017/0255255 A1 · Systems and Methods for Viewport-Based Augmented Reality Haptic Effects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0255255 A1
- Document ID: US20170255255A1
- Status: Published application
- Kind: A1
- Application number: 15/600,141
- Filed: 2017-05-19
- Published: 2017-09-07
- Earliest claimed: 2014-05-05
- Assignees: Immersion Corporation
- Applicants: Immersion Corporation
- Inventors: Vincent Levesque; Danny Grant
- Web page: https://patentgrep.com/patent/US20170255255A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

One illustrative system disclosed herein includes a display configured to receive a display signal and output an image, and an image capture device configured to capture an area image and transmit an image signal. The illustrative system also includes a processor in communication with the image capture device and the display, the processor configured to: receive the image signal; determine a virtual object based in part on the image signal; determine the display signal based in part on the image signal, wherein the display signal includes data associated with the virtual object; determine a haptic effect based at least in part on the virtual object; and transmit a haptic signal associated with the haptic effect. The illustrative system further includes a haptic output device configured to receive the haptic signal and output the haptic effect.

## Claims

### Claim 1

A system comprising:
a display configured to receive a display signal and output an image;
an image capture device configured to capture an area image and transmit an image signal;
a processor in communication with the image capture device and the display, the processor configured to:
receive the image signal;
determine a virtual object based in part on the image signal;
determine the display signal based in part on the image signal, wherein the display signal comprises data associated with the virtual object;
determine a haptic effect based at least in part on the virtual object;
transmit a haptic signal associated with the haptic effect; and
a haptic output device configured to receive the haptic signal and output the haptic effect.

### Claim 2 (depends on 1)

The system of claim 1, wherein the display comprises a touch screen display.

### Claim 3 (depends on 1)

The system of claim 1, wherein the display signal comprises the virtual object overlaid over the area image.

### Claim 4 (depends on 1)

The system of claim 1, wherein the virtual object comprises: an automobile, a bike, a piece of furniture, an insect, a building, a house, an animal, a person, a computing device, a cartoon character, a logo, or a plant.

### Claim 5 (depends on 1)

The system of claim 1, wherein the haptic output device is coupled to an article configured to be worn by a user.

### Claim 6 (depends on 5)

The system of claim 5, wherein the article comprises: a sleeve, a watch, a bracelet, a wristband, an article of clothing, a jacket, glasses, a glove, a ring, a headband, a hat, or a shoe.

### Claim 7 (depends on 1)

The system of claim 1, wherein the haptic effect comprises one or more of: a vibration, a simulated texture, a change in a perceived coefficient of friction, or an emission of one or more of solids, liquids, gasses, plasmas, or concentrated pressure waves.

### Claim 8 (depends on 1)

The system of claim 1, wherein determining the haptic effect further comprises:
determining a user interaction with the virtual object and wherein the haptic effect is based at least in part on the user interaction.

### Claim 9

A method comprising:
receiving an image signal, wherein the image signal comprises an area image;
determining a virtual object based in part on the image signal;
determining a display signal based in part on the image signal, wherein the display signal comprises data associated with the virtual object;
transmitting the display signal to a display, wherein the display is configured to output an image;
determining a haptic effect based at least in part on the virtual object;
transmitting a haptic signal associated with the haptic effect to a haptic output device; and
outputting the haptic effect.

### Claim 10 (depends on 9)

The method of claim 9, wherein the display comprises a touch screen display.

### Claim 11 (depends on 9)

The method of claim 9, wherein display signal comprises the virtual object overlaid over the area image.

### Claim 12 (depends on 9)

The method of claim 9, wherein the virtual object comprises: an automobile, a bike, a piece of furniture, an insect, a building, a house, an animal, a person, a computing device, a cartoon character, a logo, or a plant.

### Claim 13 (depends on 9)

The method of claim 9, wherein the haptic output device is coupled to an article configured to be worn by a user.

### Claim 14 (depends on 13)

The method of claim 13, wherein the article comprises: a sleeve, a watch, a bracelet, a wristband, an article of clothing, a jacket, glasses, a glove, a ring, a headband, a hat, or a shoe.

### Claim 15 (depends on 9)

The method of claim 9, wherein the haptic effect comprises one or more of: a vibration, a simulated texture, a change in a perceived coefficient of friction, or an emission of one or more of solids, liquids, gasses, plasmas, or concentrated pressure waves.

### Claim 16 (depends on 9)

The method of claim 9, wherein determining the haptic effect further comprises:
determining a user interaction with the virtual object and wherein the haptic effect is based at least in part on the user interaction.

### Claim 17

A non-transient computer readable medium comprising program code, which when executed by a processor is configured to cause the processor to:
receive an image signal, wherein the image signal comprises an area image;
determine a virtual object based in part on the image signal;
determine a display signal based in part on the image signal, wherein the display signal comprises data associated with the virtual object;
transmit the display signal to a display, wherein the display is configured to output an image;
determine a haptic effect based at least in part on the virtual object;
transmit a haptic signal associated with the haptic effect to a haptic output device; and
output the haptic effect.

### Claim 18 (depends on 17)

The non-transient computer readable medium of claim 17, wherein the virtual object comprises: an automobile, a bike, a piece of furniture, an insect, a building, a house, an animal, a person, a computing device, a cartoon character, a logo, or a plant.

### Claim 19 (depends on 17)

The non-transient computer readable medium of claim 17, wherein the haptic output device is coupled to an article configured to be worn by a user.

### Claim 20 (depends on 17)

The non-transient computer readable medium of claim 17, wherein determining the haptic effect further comprises: determining a user interaction with the virtual object and wherein the haptic effect is based at least in part on the user interaction.
