# US 2017/0257671 A1 · Tracking-based branching of media content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0257671 A1
- Document ID: US20170257671A1
- Status: Published application
- Kind: A1
- Application number: 15/059,128
- Filed: 2016-03-02
- Published: 2017-09-07
- Earliest claimed: 2016-03-02
- Assignees: Calay Venture S.à r.l.
- Applicants: Calay Venture S.à r.l.
- Inventors: Cevat Yerli
- Web page: https://patentgrep.com/patent/US20170257671A1

## CPC

- H04N 21/44222: {Analytics of user selections, e.g. selection of programmes or purchase activity (monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33)}
- G11B 27/105: {of operating discs}
- H04N 21/4112: {having fewer capabilities than the client, e.g. thin client having less processing power or no tuning capabilities}
- H04N 21/4415: using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning {(cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861)}
- H04N 21/4668: {for recommending content, e.g. movies}
- H04N 21/8541: involving branching, e.g. to different story endings
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

A method for controlling media content and an apparatus are described. The method comprises providing media content including a plurality of virtual objects and a plurality of triggers, each of the triggers being associated with at least one of the virtual objects; presenting the media content to a plurality of viewers; continuously receiving tracking data of the viewers, matching the tracking data to the triggers; if the tracking data matches at least one trigger, branching the media content into a plurality of branches including a main branch and at least one auxiliary branch, each auxiliary branch associated with at least one viewer; for each matched trigger, automatically adjusting the virtual object(s) associated with the matched trigger in the corresponding auxiliary branch, simultaneously presenting the branches of the media content to respective viewers, and joining the auxiliary branch(es) with the main branch.

## Claims

### Claim 1

A method for controlling media, comprising:
providing media content including a plurality of virtual objects and a plurality of triggers, each of said plurality of triggers being associated with at least one virtual object of the plurality of virtual objects;
presenting the media content to a plurality of viewers;
continuously receiving tracking data of the plurality of viewers;
matching the tracking data to the plurality of triggers;
if the tracking data matches at least one trigger, branching the media content into a plurality of branches including a main branch and at least one auxiliary branch, each auxiliary branch associated with at least one viewer;
for each matched trigger, automatically adjusting the at least one virtual object associated with the matched trigger in the corresponding auxiliary branch;
simultaneously presenting the plurality of branches of the media content to respective viewers of the plurality of viewers; and
joining the at least one auxiliary branch with the main branch.

### Claim 2 (depends on 1)

The method according to claim 1, further comprising:
determining at least one viewer related to the tracking data matching a trigger;
associating the at least one viewer with a corresponding auxiliary branch; and
simultaneously presenting the associated auxiliary branch to the corresponding at least one viewer.

### Claim 3 (depends on 1)

The method according to claim 1, further comprising simultaneously presenting the main branch of the media content to at least some of the remaining viewers.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the at least one auxiliary branch is joined with the main branch according to at least one condition.

### Claim 5 (depends on 4)

The method according to claim 4, wherein the at least one condition is a time-based condition.

### Claim 6 (depends on 1)

The method according to claim 1, said joining including continuously transforming the adjusted at least one virtual object in the at least one auxiliary branch according to corresponding virtual objects in the main branch.

### Claim 7 (depends on 1)

The method according to claim 1, said branching including creating one or more instances of at least some of the plurality of virtual objects for each auxiliary branch.

### Claim 8 (depends on 1)

The method according to claim 1, said branching including creating one or more references for at least some of the plurality of virtual objects for each auxiliary branch, the references referring to corresponding virtual objects in the main branch.

### Claim 9 (depends on 1)

The method according to claim 1, wherein presenting an auxiliary branch includes processing the media content in the auxiliary branch according to one or more instances of virtual objects in the auxiliary branch and one or more references to virtual objects in the main branch.

### Claim 10 (depends on 1)

The method according to claim 1, wherein said matching the tracking data to the plurality of triggers includes determining whether, based on the tracking data, a viewing direction of a viewer corresponds to at least one trigger.

### Claim 11 (depends on 10)

The method according to claim 10, further including determining whether the viewing direction corresponds to an area associated with at least one trigger, wherein the area is defined based on the at least one virtual object associated with the at least one trigger.

### Claim 12 (depends on 1)

The method according to claim 1, wherein at least some of the virtual objects include a set of parameters for determining behavior of the virtual objects in the media content, and the set of parameters is adjusted responsive to said matching.

### Claim 13 (depends on 12)

The method according to claim 12, wherein the set of parameters defines a position and orientation of a respective virtual object, wherein the position and orientation of the virtual object is automatically adjusted responsive to said matching.

### Claim 14 (depends on 1)

The method according to claim 1, further comprising, for a matched trigger, inserting a further virtual object into the media content in the respective auxiliary branch.

### Claim 15 (depends on 14)

The method according to claim 14, wherein said joining includes removing the further virtual object from the media content in the respective auxiliary branch.

### Claim 16 (depends on 1)

The method according to claim 1, further comprising, for a matched trigger, removing one of the plurality of virtual objects from the media content in the respective auxiliary branch.

### Claim 17 (depends on 16)

The method according to claim 16, wherein said joining includes inserting the removed virtual object into the media content in the respective auxiliary branch.

### Claim 18 (depends on 1)

The method according to claim 1, wherein the media content is immersive media content.

### Claim 19

An apparatus comprising:
at least one output device for rendering media content including a plurality of virtual objects and a plurality of triggers, each of said plurality of triggers being associated with at least one virtual object of the plurality of virtual objects;
a tracking device for tracking a plurality of users of the apparatus; and
a controller configured to:
continuously receive, from the tracking device, tracking data of the plurality of users;
match the tracking data to the plurality of triggers;
if the tracking data matches at least one trigger, branch the media content into a plurality of branches including a main branch and at least one auxiliary branch, each auxiliary branch associated with at least one user;
for each matched trigger, automatically adjust the at least one virtual object associated with the matched trigger in the associated auxiliary branch;
simultaneously present the plurality of branches of the media content to respective users of the plurality of users; and
join the at least one auxiliary branch with the main branch.

### Claim 20 (depends on 19)

The apparatus according to claim 19, wherein the tracking device is configured to track at least one position and orientation of the plurality of users.

### Claim 21 (depends on 19)

The apparatus according to claim 19, wherein the tracking device is configured to track at least one gaze direction of the plurality of users.

### Claim 22 (depends on 19)

The apparatus according to claim 19, wherein the at least one output device includes a plurality of headsets.
