# US 2021/0255728 A1 · Interactive environment with virtual environment space scanning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0255728 A1
- Document ID: US20210255728A1
- Status: Published application
- Kind: A1
- Application number: 17/182,909
- Filed: 2021-02-23
- Published: 2021-08-19
- Earliest claimed: 2009-03-25
- Assignees: MEP Tech, Inc.
- Applicants: MEP Tech, Inc.
- Inventors: Mark L. Davis; Timothy Alan Tabor; Roger H. Hoole; Jeffrey Taylor; John M. Black
- Web page: https://patentgrep.com/patent/US20210255728A1

## CPC

- G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)}
- A63F 9/0468: {Electronic dice; electronic dice simulators}
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/40: Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
- A63F 13/42: by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
- A63F 13/52: involving aspects of the displayed game scene
- A63F 13/65: automatically by game devices or servers from real world data, e.g. measurement in live racing competition
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- A63F 1/00: Card games
- A63F 9/04: Dice; Dice-boxes; Mechanical dice-throwing devices
- A63F 2001/008: {adapted for being playable on a screen}
- A63F 2009/2425: {Scanners, e.g. for scanning regular characters}
- A63F 2009/2463: {on a screen, e.g. using a video projector}
- A63F 2250/30: with a three-dimensional image
- A63F 2300/1087: comprising photodetecting means, e.g. a camera
- A63F 2300/6045: for mapping control signals received from the input arrangement into game commands
- A63F 2300/66: for rendering three dimensional images
- A63F 2300/69: Involving elements of the real world in the game world, e.g. measurement in live races, real video
- G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR

## Abstract

An interactive environment image may be displayed in a virtual environment space, and interaction with the interactive environment image may be detected within a three-dimensional space that corresponds to the virtual environment space. The interactive environment image may be a three-dimensional image, or it may be two-dimensional. An image is displayed to provide a visual representation of an interactive environment image including one or more virtual objects, which may be spatially positioned. User interaction with the visualized representation in the virtual environment space may be detected and, in response to user interaction, the interactive environment image may be changed.

## Claims

### Claim 1

A method for projecting an interactive environment image, comprising:
displaying an environment image including at least one virtual object; and
detecting user interaction with a three-dimensional space corresponding to the environment image, including:
scanning the three-dimensional space; and
detecting interaction between a manipulating element and a location in the three-dimensional space corresponding to a location of the at least one virtual object.

### Claim 2 (depends on 1)

The method of claim 1, wherein detecting the user interaction comprises detecting a physical movement or manipulation of a physical object within the three-dimensional space.

### Claim 3 (depends on 1)

The method of claim 1, wherein detecting the user interaction further includes:
detecting extension of the manipulating element from a location outside of the three-dimensional space into the three-dimensional space.

### Claim 4 (depends on 3)

The method of claim 3, wherein detecting the user interaction comprises distinguishing between a plurality of elements simultaneously extending from locations outside of the three-dimensional space into the three-dimensional space.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
changing the environment image in response to interaction between the manipulating element and the three-dimensional space.

### Claim 6 (depends on 5)

The method of claim 5, wherein changing the visualized representation comprises affecting the at least one virtual object.

### Claim 7 (depends on 6)

The method of claim 6, wherein affecting the at least one virtual object comprises moving, manipulating, or changing the at least one virtual object.

### Claim 8 (depends on 5)

The method of claim 5, wherein changing the visualized representation comprises adding a new virtual object to the visualized representation.

### Claim 9 (depends on 1)

The method of claim 1, wherein displaying the environment image includes displaying at least a portion of the environment image on a surface.

### Claim 10 (depends on 9)

The method of claim 9, wherein displaying the environment image includes displaying at least the portion of the environment image on a substantially flat surface.

### Claim 11 (depends on 9)

The method of claim 9, wherein displaying the environment image comprises displaying a prepared image tailored to a topography of the surface to ensure that features of the environment image are proportionately displayed on the surface.

### Claim 12 (depends on 9)

The method of claim 9, wherein detecting user interaction includes detecting user interaction with a topography of the surface.

### Claim 13 (depends on 1)

The method of claim 1, wherein the environment image includes three-dimensional information viewable by a user as a three-dimensional image.

### Claim 14 (depends on 1)

The method of claim 1, wherein displaying the environment image comprises displaying a plurality of discrete sub-images.

### Claim 15

A computing system, comprising:
a display that displays an environment image including at least one virtual object; and
a scanning mechanism that detects a user interaction with the environment image by:
scanning a three-dimensional space corresponding to the virtual environment space; and
detecting interaction between a manipulating element and a location within the three-dimensional space that corresponds to a location of the at least one virtual object.

### Claim 16 (depends on 15)

The computing system of claim 15, wherein the scanning mechanism is detects interaction by:
detecting extension of the manipulating element from a location outside of the three-dimensional space into the three-dimensional space.

### Claim 17 (depends on 15)

The computing system of claim 15, further comprising:
at least one processing element programmed to change the environment image in response to the user interaction with the three-dimensional space.

### Claim 18 (depends on 17)

The computing system of claim 17, wherein the scanning mechanism comprises the at least one processing element and at least one camera.

### Claim 19

A portable display system, comprising:
at least one display that displays an environment image representing at least one virtual object positioned in a virtual environment space; and
a scanning mechanism that scans a three-dimensional space corresponding to the virtual environment space to determine one or more locations of interactivity by:
scanning the three-dimensional space that corresponds to the virtual environment space of the environment image; and
detecting interaction between a manipulating element and a location within the three-dimensional space that corresponds to a location of a virtual object of the plurality of virtual objects within the virtual environment space.

### Claim 20 (depends on 19)

The portable display system of claim 19, wherein the scanning mechanism further:
detects extension of the manipulating element into the three-dimensional space from a location outside of the three-dimensional space.
