# US 2013/0086533 A1 · Device for interacting with real-time streams of content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0086533 A1
- Document ID: US20130086533A1
- Status: Published application
- Kind: A1
- Application number: 13/684,792
- Filed: 2012-11-26
- Published: 2013-04-04
- Earliest claimed: 2003-11-12
- Assignees: Koninklijke Philips Electronics N.V.
- Inventors: MARCELLE A. STIENSTRA
- Web page: https://patentgrep.com/patent/US20130086533A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G10H 1/00: Details of electrophonic musical instruments
- H04N 21/42201: {biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user (input arrangements for interaction with the human body based on nervous system activity detection G06F3/015)}
- A63F 2300/1068: being specially adapted to detect the point of contact of the player on a surface, e.g. floor mat, touch pad
- A63F 2300/1087: comprising photodetecting means, e.g. a camera
- A63F 2300/8047: Music games
- G10H 2220/201: for movement interpretation, i.e. capturing and recognizing a gesture or a specific kind of movement, e.g. to control a musical instrument
- G10H 2220/341: Floor sensors, e.g. platform or groundsheet with sensors to detect foot position, balance or pressure, steps, stepping rhythm, dancing movements or jumping
- G10H 2220/411: Light beams
- G10H 2220/415: Infrared beams
- G10H 2220/455: Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR

## Abstract

An end-user system (10) for transforming real-time streams of content into an output presentation includes a user interface (30) that allows a user to interact with the streams. The user interface (30) includes sensors (32a-f) that monitor an interaction area (36) to detect movements and/or sounds made by a user. The sensors (32a-f) are distributed among the interaction area (36) such that the user interface (30) can determine a three-dimensional location within the interaction area (36) where the detected movement or sound occurred. Different streams of content can be activated in a presentation based on the type of movement or sound detected, as well as the determined location. The present invention allows a user to interact with and adapt the output presentation according to his/her own preferences, instead of merely being a spectator.

## Claims

### Claim 1

A user interface (30) for interacting with a device that receives and transforms streams of content into a presentation to be output, comprising:
at least one sensor (32) for detecting a movement made by a user positioned in an interaction area (36) proximate to a location at which the presentation is output, wherein said sensor (32) is arranged to be aimed towards said interaction area;
wherein a type of movement corresponding to said detected movement is determined by analyzing a detection signal from said at least one sensor (32);
wherein the type of movement is different facial expressions or hand gestures made by the user, a gesture that imitates the use of a device or a tool, or an amount of force or speed with which the user makes a gesture; and
wherein the presentation is controlled by manipulating one or more streams of content based on said determined type of movement and a received stream of content is activated or deactivated in the presentation based on the determined type of movement.

### Claim at position 2

2-3. (canceled)

### Claim 4 (depends on 1)

The user interface (30) according to claim 1, wherein said at least one sensor (32) includes a plurality of sensors, and
wherein detection signals from said plurality of sensors are analyzed to determine a location within said interaction area (36) in which said detected movement occurs.

### Claim 5 (depends on 4)

The user interface (30) according to claim 4, wherein a received stream of content is activated or deactivated in the presentation based on said determined location.

### Claim at position 5

6-7. (canceled)

### Claim 8 (depends on 1)

The user interface (30) according to claim 1, wherein said presentation includes a narrative.

### Claim 9

A process in a system for transforming streams of content into a presentation to be output, comprising:
Detecting by means of at least one sensor a movement made by a user which is positioned in an interaction area (36) proximate to a location at which the presentation is output, wherein said sensor (32) is arranged to be aimed towards said interaction area (36);
wherein a type of movement corresponding to said detected movement is determined by analyzing a detection signal;
wherein the type of movement is different facial expressions or hand gestures made by the user, a gesture that imitates the use of a device or a tool, or an amount of force or speed with which the user makes the gesture;
wherein the presentation is controlled by manipulating one or more streams of content based on said determined movement, and a received stream of content is activated or deactivated in the presentation based on the determined type of movement.

### Claim 10

A system comprising:
an end-user device (10) for receiving and transforming streams of content into a presentation;
an output device (15) for outputting said presentation;
a user interface (30) including at least one sensor (32) for detecting a movement made by a user which is positioned in an interaction area (36) proximate to the output device (15), wherein said sensor (32) is arranged to be aimed towards said interaction area;
wherein a type of movement corresponding to said detected movement is determined by analyzing a detection signal from said sensor (32);
wherein the type of movement is different facial expressions or had gestures made by the user, a gesture that imitates the use of a device or a tool, or an amount of force or speed with which the user makes a gesture; and
wherein said end-user device (10) manipulates said transformed streams of content based on said determined type of movement, thereby controlling said presentation, and a received stream of content is activated or deactivated in the presentation based on the determined type of movement.

### Claim 11 (depends on 10)

The system according to claim 10, wherein each stream of content includes control data that links the stream to a particular gesture.

### Claim 12 (depends on 10)

The system according to claim 10, wherein said manipulated streams of content correspond to parts of a narrative.

### Claim 13 (depends on 7)

The process according to claim 7, wherein each stream of content includes control data that links the stream to a particular gesture.

### Claim 14 (depends on 7)

The process according to claim 7, wherein said manipulated streams of content correspond to parts of a narrative.
