# US 2012/0249762 A1 · Interactive input system having a 3d input space

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0249762 A1
- Document ID: US20120249762A1
- Status: Published application
- Kind: A1
- Application number: 13/436,603
- Filed: 2012-03-30
- Published: 2012-10-04
- Earliest claimed: 2011-03-31
- Assignees: SMART Technologies ULC
- Inventors: ANDREW MICHAEL EXNER
- Web page: https://patentgrep.com/patent/US20120249762A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An interactive input system comprises computing structure; and an input device detecting at least one electronic device displaying a recognizable pattern within a three-dimensional (3D) input space and providing output to the computing structure. The computing structure processes the output of the input device to recognize the pattern displayed by the at least one electronic device in the 3D input space; detect the state of the at least one electronic device; and modify image data by applying a transition to digital content associated with the displayed pattern based on the detected state of the at least one electronic device.

## Claims

### Claim 1

An interactive input system comprising:
computing structure; and
an input device detecting at least one electronic device displaying a recognizable pattern within a three-dimensional (3D) input space and providing output to said computing structure, wherein said computing structure processes the output of the input device to:
recognize the pattern displayed by the at least one electronic device in the 3D input space;
detect the state of the at least one electronic device; and
modify image data by applying a transition to digital content associated with the displayed pattern based on the detected state of the at least one electronic device.

### Claim 2 (depends on 1)

The interactive input system of claim 1 wherein said input device is a camera device capturing images of said 3D input space.

### Claim 3 (depends on 1)

The interactive input system of claim 1 wherein said recognizable pattern is associated with at least one secondary recognizable pattern located at predetermined positions on said at least one electronic device.

### Claim 4 (depends on 3)

The interactive input system of claim 3 wherein said at least one electronic device has a generally cuboid-shape and comprises at least one secondary recognizable pattern on each face of the electronic device.

### Claim 5 (depends on 4)

The interactive input system of claim 4 wherein the at least one secondary recognizable pattern is located adjacent each corner of the electronic device.

### Claim 6 (depends on 5)

The interactive input system of claim 5 wherein the at least one electronic device comprises processing structure, memory for storing instructions executable by the processing structure, and data representing at least one recognizable pattern, and a display for presenting at least one recognizable pattern.

### Claim 7 (depends on 6)

The interactive input system of claim 6 wherein said data represents a library of recognizable patterns.

### Claim 8 (depends on 7)

The interactive input system of claim 7 wherein said data is downloadable by the processing structure of said electronic device from a remote source.

### Claim 9 (depends on 8)

The interactive input system of claim 8 wherein said at least one electronic device is an ebook.

### Claim 10 (depends on 1)

The interactive input system of claim 1 wherein said at least one electronic device has a plurality of display panels for displaying recognizable patterns.

### Claim 11 (depends on 10)

The interactive input system of claim 10 wherein said at least one electronic device is a cube comprising display panels on faces thereof.

### Claim 12 (depends on 11)

The interactive input system of claim 11 wherein said display panels are liquid crystal display panels.

### Claim 13 (depends on 1)

The interactive input system of claim 1 wherein said at least one electronic device comprises a liquid crystal display panel.

### Claim 14 (depends on 1)

The interactive input system of claim 1 further comprising a display coupled to said computing structure, said display presenting an image based on said image data.

### Claim 15 (depends on 14)

The interactive input system of claim 14 wherein said display is an interactive surface.

### Claim 16 (depends on 1)

The interactive input system of claim 1, wherein the computing structure processes the output of the input device to detect at least one of orientation, position and movement of the at least one electronic device in the 3D input space.

### Claim 17 (depends on 16)

The interactive input system of claim 16, wherein when the detected state of the at least one electronic device signifies that a new recognizable pattern is visible thereon, the image data is modified to associate digital content therewith, the associated digital content appearing in an image using a visual effect.

### Claim 18 (depends on 17)

The interactive input system of claim 17, wherein when the detected state of the at least one electronic device signifies removal of a previously recognizable pattern thereon, the image data is modified to remove associated digital content therefrom, the associated digital content disappearing from the image using a different visual effect.

### Claim 19 (depends on 17)

The interactive input system of claim 17, wherein the visual effect is a fade-in visual effect or a scale-up visual effect.

### Claim 20 (depends on 18)

The interactive input system of claim 18, wherein the different visual effect is a fade-out visual effect or a scale-down visual effect.

### Claim 21 (depends on 1)

The interactive input system of claim 1, wherein the computing structure further processes the output of the input device to detect gestures made using said at least one electronic device.

### Claim 22 (depends on 21)

The interactive input system of claim 21, wherein said computing structure manipulates digital content associated with the at least one electronic device in response to detected gestures.

### Claim 23

An interactive input system comprising:
computing structure; and
an input device detecting at least one electronic device displaying a recognizable pattern within a three-dimensional (3D) input space and providing output to said computing structure, wherein said computing structure processes the output of the input device to:
recognize the pattern displayed by the at least one electronic device in the 3D input space;
determine when the location of the pattern within the 3D input space and the location of digital content in an image presented on a display surface satisfy defined criteria; and
associate the pattern to the digital content.

### Claim 24

An apparatus comprising:
a processing device receiving data representing an electronic device displaying a recognizable pattern positioned within a three-dimensional (3D) input space; and
memory storing computer program code executable by the processing device, the processing device communicating with the memory and executing the program code and causing the apparatus at least to:
recognize the pattern carried by the electronic device in the 3D input space;
determine when the location of the pattern within the 3D input space and the location of digital content in an image presented on a display surface satisfy defined criteria; and
associate the pattern to the digital content.

### Claim 25

A method comprising:
detecting a unique pattern displayed by an electronic device positioned within a three-dimensional input space;
determining when the pattern is positioned within the input space at a location within a threshold distance of a location corresponding to digital content within a presented image; and
associating the pattern to the digital content so that manipulation of the electronic device within the input spaces manipulates the digital content.
