# US 2021/0240255 A1 · Methods and systems for associating input schemes with physical world objects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0240255 A1
- Document ID: US20210240255A1
- Status: Published application
- Kind: A1
- Application number: 17/169,799
- Filed: 2021-02-08
- Published: 2021-08-05
- Earliest claimed: 2016-01-29
- Assignees: Rovi Guides, Inc.
- Applicants: Rovi Guides, Inc.
- Inventors: Edison Lin
- Web page: https://patentgrep.com/patent/US20210240255A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/4532: {involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)}
- H04N 21/47202: {for requesting content on demand, e.g. video on demand}
- H04N 21/4755: {for defining user preferences, e.g. favourite actors or genre (retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306)}
- H04N 21/4821: {using a grid, e.g. sorted out by channel and broadcast time}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods and systems are described herein for a media guidance application that allows users to associate input schemes with physical objects in an augmented reality environment. Specifically, the media guidance application may recognize physical objects in an augmented reality environment and allow users to identify input schemes to associate with the physical objects, wherein the input schemes are ways in which users may control presentation of media content by interacting with the physical objects.

## Claims

### Claim at position 1

1-50. (canceled)

### Claim 51

A method for controlling of media content with physical world objects, the method comprising:
storing digital descriptions of a plurality of physical objects in an augmented reality environment of a user;
receiving a user input from the user assigning a media asset to a first physical object of the plurality of physical objects;
detecting the first physical object and a second physical object of the plurality of physical object in the augmented reality environment by comparing digital descriptions of physical objects in the augmented reality environment to the digital description of the first physical object and to the digital description of the second physical object;
in response to identifying user interaction with the second physical object after user interaction with the first physical object in the augmented reality environment, reassigning the media asset from the first physical object to the second physical object.

### Claim 52 (depends on 51)

The method of claim 51 further comprising identifying the first physical object by detecting a first hand gesture over the first physical object.

### Claim 53 (depends on 52)

The method of claim 52 further comprising identifying the second physical object by detecting a second hand gesture over the second physical object, wherein the second hand gesture is different from the first hand gesture.

### Claim 54 (depends on 51)

The method of claim 51 further comprising initially identifying initially the first physical object by detecting a hand gesture over the first physical object followed by identifying the second physical object by detecting the hand gesture over the second physical object.

### Claim 55 (depends on 51)

The method of claim 51, wherein the user input assigning the media asset to the first physical object is a voice input identifying the media asset.

### Claim 56 (depends on 51)

The method of claim 51 wherein reassigning the media asset comprises receiving another user input assigning the media asset to the second physical object

### Claim 57 (depends on 51)

The method of claim 51 further comprising in response to detecting the first physical object, automatically causing the media asset to be presented.

### Claim 58 (depends on 51)

The method of claim 51 further comprising receiving another input controlling presentation of the media asset.

### Claim 59 (depends on 51)

The method of claim 51 wherein storing digital descriptions of the plurality of physical objects in the augmented reality environment comprises:
creating an object identifier associated with the respective physical object; and
storing the object identifier and the first digital description in a database listing object identifiers, each corresponding to a digital description.

### Claim 60 (depends on 59)

The method of claim 59 further comprising storing a media asset identifier associated with the media asset and the object identifier in a database listing object identifiers, each corresponding to a media asset.

### Claim 61

A system for controlling of media content with physical world objects, the system comprising:
storage circuitry configure to store digital descriptions of a plurality of physical objects in an augmented reality environment of a user;
an input/output circuitry configured to receive a user input from the user assigning a media asset to a first physical object of the plurality of physical objects;
a control circuitry configured to:
detect the first physical object and a second physical object of the plurality of physical object in the augmented reality environment by comparing digital descriptions of physical objects in the augmented reality environment to the digital description of the first physical object and to the digital description of the second physical object;
in response to identifying user interaction with the second physical object after user interaction with the first physical object in the augmented reality environment, reassign the media asset from the first physical object to the second physical object.

### Claim 62 (depends on 61)

The system of claim 61 wherein the control circuitry is further configured to identify the first physical object by detecting a first hand gesture over the first physical object.

### Claim 63 (depends on 62)

The system of claim 62 wherein the control circuitry is further configured to identify the second physical object by detecting a second hand gesture over the second physical object, wherein the second hand gesture is different from the first hand gesture.

### Claim 64 (depends on 61)

The system of claim 61 wherein the control circuitry is further configured to initially identify the first physical object by detecting a hand gesture over the first physical object followed by identifying the second physical object by detecting the hand gesture over the second physical object.

### Claim 65 (depends on 61)

The system of claim 61, wherein the user input assigning the media asset to the first physical object is a voice input identifying the media asset.

### Claim 66 (depends on 61)

The system of claim 61 wherein to reassign the media asset, the control circuitry is further configured to receive another user input assigning the media asset to the second physical object

### Claim 67 (depends on 61)

The system of claim 61 wherein the control circuitry is further configured to automatically cause the media asset to be presented in response to detecting the first physical object.

### Claim 68 (depends on 61)

The system of claim 61 wherein the control circuitry is further configured to receive another input controlling presentation of the media asset.

### Claim 69 (depends on 61)

The system of claim 61 wherein to store digital descriptions of a plurality of physical objects in the augmented reality environment, the control circuitry is further configured to:
create an object identifier associated with the respective physical object; and
store the object identifier and the first digital description in a database listing object identifiers, each corresponding to a digital description.

### Claim 70 (depends on 69)

The system of claim 69 wherein the control circuitry is further configured to store a media asset identifier associated with the media asset and the object identifier in a database listing object identifiers, each corresponding to a media asset.
