# US 2021/0064205 A1 · Method and apparatus for controlling display of video content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0064205 A1
- Document ID: US20210064205A1
- Status: Published application
- Kind: A1
- Application number: 17/020,525
- Filed: 2020-09-14
- Published: 2021-03-04
- Earliest claimed: 2013-09-06
- Assignees: Seespace Ltd.
- Applicants: SeeSpace Ltd.
- Inventors: Dale Alan HERIGSTAD; Nam Hoai DO; Nhan Minh DANG; Hieu Trung TRAN; Quang Sy DINH; Thang Viet NGUYEN; Long Hai NGUYEN; Linh Chi NGUYEN
- Web page: https://patentgrep.com/patent/US20210064205A1

## CPC

- G06F 3/0485: Scrolling or panning
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- H04N 21/41265: {having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204)}
- H04N 21/422: Input-only peripherals {, i.e. input devices connected to specially adapted client devices}, e.g. global positioning system [GPS] {(input devices also receiving signals from specially adapted client devices H04N21/4104)}
- H04N 21/42224: {Touch pad or touch panel provided on the remote control}
- H04N 21/431: Generation of visual interfaces {for content selection or interaction}; Content or additional data rendering
- H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window}
- H04N 21/4622: {Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859)}
- H04N 21/47: End-user applications
- H04N 21/478: Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- H04N 21/8126: {involving additional data, e.g. news, sports, stocks, weather forecasts}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A controller for controlling the display of secondary digital content displayed in an overlay above a primary video stream. The controller includes a touch interface device, a processor, and a memory storing non-transitory instructions. These instructions, when executed, can include (i) detecting a first input gesture by a user on the touch interface device, (ii) in response to detecting the first input gesture, selecting an application for display, (iii) detecting a second input gesture by the user on the touch interface device, (iv) in response to detecting the second input gesture, scrolling through a currently-displayed layer of the selected application displayed, (v) detecting a third input gesture by the user on the touch interface device, and (vi) in response to detecting the third input gesture, scrolling between layers of the selected application in a simulated Z-space.

## Claims

### Claim 1

(canceled)

### Claim 2

A method comprising:
controlling, by one or more hardware processors, secondary digital content overlaid on primary digital content, the secondary digital content comprising a plurality of layers arranged in a simulated Z-space;
receiving, by the one or more hardware processors, first gesture information that identifies a first gesture type among a plurality of predetermined gesture types;
determining, by the one or more hardware processors, a first action associated with the first gesture type, the first action comprising at least one of translating one or more of the plurality of layers in an X-Y plane or scrolling through the plurality of layers in the simulated Z-space; and
updating, by the one or more hardware processors, the secondary digital content based on the first action.

### Claim 3 (depends on 2)

The method of claim 2, wherein the plurality of predetermined gesture types include a gesture within a first region and a gesture within a second region.

### Claim 4 (depends on 3)

The method of claim 3, wherein:
when the first gesture type corresponds to the gesture within the first region, the first action includes translating one or more of the plurality of layers in the X-Y plane; and
when the first gesture type corresponds to the gesture within the second region, the first action includes scrolling through the plurality of layers in the simulated Z-space.

### Claim 5 (depends on 3)

The method of claim 3, wherein the plurality of predetermined gesture types further include a gesture extending between the first region and the second region.

### Claim 6 (depends on 2)

The method of claim 2, wherein the first gesture information comprises information associated with a plurality of user gestures including:
a first user gesture that triggers the first action; and
a second user gesture that comprises one or more interactions associated with the first action.

### Claim 7 (depends on 6)

The method of claim 6, wherein the one or more interactions comprise a least one of pushing, pulling, lifting, swiping, or grabbing a graphical element associated with the secondary digital content.

### Claim 8 (depends on 2)

The method of claim 2, further comprising:
receiving, by the one or more hardware processors, second gesture information that identifies a second gesture type among the plurality of second gesture types;
determining, by the one or more hardware processors, a second action associated with the second gesture type; and
updating, by the one or more hardware processors, the secondary digital content based on the second action.

### Claim 9 (depends on 8)

The method of claim 8, wherein the second action comprises at least one of showing or hiding the secondary digital content.

### Claim 10 (depends on 8)

The method of claim 8, wherein the second action comprises selecting one or more applications among a plurality of applications to provide the secondary digital content.

### Claim 11

A system comprising:
a non-transitory memory; and
one or more hardware processors that read instructions from the non-transitory memory that, when executed, cause the one or more hardware processors to perform operations comprising:
controlling secondary digital content overlaid on primary digital content, the secondary digital content comprising a plurality of layers arranged in a simulated Z-space;
receiving first gesture information that identifies a first gesture type among a plurality of predetermined gesture types;
determining a first action associated with the first gesture type, the first action comprising at least one of translating one or more of the plurality of layers in an X-Y plane or scrolling through the plurality of layers in the simulated Z-space; and
updating the secondary digital content based on the first action.

### Claim 12 (depends on 11)

The system of claim 11, wherein the plurality of predetermined gesture types include a gesture within a first region and a gesture within a second region.

### Claim 13 (depends on 12)

The system of claim 12, wherein:
when the first gesture type corresponds to the gesture within the first region, the first action includes translating one or more of the plurality of layers in the X-Y plane; and
when the first gesture type corresponds to the gesture within the second region, the first action includes scrolling through the plurality of layers in the simulated Z-space.

### Claim 14 (depends on 12)

The system of claim 12, wherein the plurality of predetermined gesture types further include a gesture extending between the first region and the second region.

### Claim 15 (depends on 11)

The system of claim 11, wherein the first gesture information comprises information associated with a plurality of user gestures including:
a first user gesture that triggers the first action; and
a second user gesture that comprises one or more interactions associated with the first action.

### Claim 16 (depends on 15)

The system of claim 15, wherein the one or more interactions comprise a least one of pushing, pulling, lifting, swiping, or grabbing a graphical element associated with the secondary digital content.

### Claim 17 (depends on 11)

The system of claim 11, wherein the operations further comprise:
receiving second gesture information that identifies a second gesture type among the plurality of second gesture types;
determining a second action associated with the second gesture type; and
updating the secondary digital content based on the second action.

### Claim 18 (depends on 17)

The system of claim 17, wherein the second action comprises at least one of showing or hiding the secondary digital content.

### Claim 19 (depends on 17)

The system of claim 17, wherein the second action comprises selecting one or more applications among a plurality of applications to provide the secondary digital content.

### Claim 20

A non-transitory computer-readable medium storing instructions that, when executed by one or more hardware processors, cause the one or more hardware processors to perform operations comprising:
controlling secondary digital content overlaid on primary digital content, the secondary digital content comprising a plurality of layers arranged in a simulated Z-space;
receiving first gesture information that identifies a first gesture type among a plurality of predetermined gesture types;
determining a first action associated with the first gesture type, the first action comprising at least one of translating one or more of the plurality of layers in an X-Y plane, scrolling through the plurality of layers in the simulated Z-space, or showing or hiding the secondary digital content; and
updating the secondary digital content based on the first action.

### Claim 21 (depends on 20)

The system of claim 20, wherein the plurality of predetermined gesture types include a gesture within a first region, a gesture within a second region, and a gesture extending between the first region and the second region, and wherein:
when the first gesture type corresponds to the gesture within the first region, the first action includes translating one or more of the plurality of layers in the X-Y plane;
when the first gesture type corresponds to the gesture within the second region, the first action includes scrolling through the plurality of layers in the simulated Z-space; and
when the first gesture type corresponds to the gesture extending between the first region and the second region, the first action includes showing or hiding the secondary digital content.
