# US 2014/0192140 A1 · Visual Content Modification for Distributed Story Reading

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0192140 A1
- Document ID: US20140192140A1
- Status: Published application
- Kind: A1
- Application number: 13/735,892
- Filed: 2013-01-07
- Published: 2014-07-10
- Earliest claimed: 2013-01-07
- Assignees: Microsoft Corporation
- Applicants: Microsoft Corporation
- Inventors: Alan W. Peevers; John C. Tang; Nizamettin Gok; Gina Danielle Venolia; Kori Inkpen Quinn; Nitin Khanna; Simon Andrew Longbottom; Kurt A. Thywissen; Koray Can Oztekin; Vijay Chandrasekaran
- Web page: https://patentgrep.com/patent/US20140192140A1

## CPC

- H04N 7/14: Systems for two-way working ({H04N7/12, } H04N7/173 take precedence)
- A63F 13/54: involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
- A63F 13/61: using advertising information
- G09B 5/06: with both visual and audible presentation of the material to be studied
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

Various embodiments provide an interactive, shared, story-reading experience in which stories can be experienced from remote locations. Various embodiments enable augmentation or modification of audio and/or video associated with the story-reading experience. This can include augmentation and modification of a reader's voice, face, and/or other content associated with the story as the story is read.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving video data associated with a reader of an electronic story that is configured to be shared with one or more remote participants;
augmenting the video data to generate at least one new image; and
enabling the one or more remote participants to consume the augmented video data as part of the electronic story.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein receiving the video data further comprises:
displaying at least one visual cue associated with at least one location within the electronic story that can include augmented video data;
enabling selection of the at least one visual cue; and
responsive to selection of the at least one visual cue, receiving the augmented video data.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein augmenting the video data further comprises augmenting the video data by using a spatial filter.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1 further comprising:
detecting a face contained within the video data; and
augmenting the video data based, at least in part, upon said detected face.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein said receiving further comprises receiving audio data associated with the video data and further comprising augmenting the audio associated with the video data.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein enabling the one or more remote participants to consume the augmented video data further comprises transmitting the augmented video data to the one or more remote participants over a network.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein augmenting the video data further comprises:
analyzing the video data for movement; and
responsive to said analyzing, mimicking said movement via an image associated with the electronic story.

### Claim 8

One or more computer readable storage media embodying computer readable instructions which, when executed, implement a method comprising:
receiving video data associated with a reader of an electronic story that is configured to be shared with one or more remote participants;
enabling augmentation of the video data to generate at least one new image; and
enabling the one or more remote participants to consume the augmented video data as part of the electronic story.

### Claim 9 (depends on 8)

The one or more computer readable storage media of claim 8, wherein the method further comprises receiving the video data from at least one of the remote participants.

### Claim 10 (depends on 8)

The one or more computer readable storage media of claim 8, wherein the method further comprises:
determining one or more locations where one or more video augmentation effects can be applied;
visually indicating when the one or more augmentation effects can be applied; and
receiving user input to initiate one or more augmentation effects;
applying the one or more augmentation effects within the electronic story.

### Claim 11 (depends on 8)

The one or more computer readable storage media of claim 8, wherein the instructions to augment the video data are further configured to transmit the video data to another computer for augmentation.

### Claim 12 (depends on 8)

The one or more computer readable storage media of claim 8, wherein said enabling the one or more remote participants to consume the augmented video data comprises using a peer-to-peer network.

### Claim 13 (depends on 8)

The one or more computer readable storage media of claim 8, wherein enabling augmentation of the video data further comprises applying a rotoscoping filter to the video data.

### Claim 14 (depends on 8)

The one or more computer readable storage media of claim 8, wherein said enabling the one or more remote participants to consume the augmented video data further comprises:
establishing a communication connection between the reader and the one or more remote participants; and
transferring the augmented video data to the one or more remote participants using the communication connection.

### Claim 15

A system comprising:
one or more processors;
one or more computer readable storage media; and
at least one augmentation effect module embodied on the one or more computer readable storage media and configured, when executed by the one or more processors, to:
receive video data associated with a reader of an electronic story that is configured to be shared with one or more remote participants;
detect one or more facial features contained within the video data;
augment the video data based, at least in part, on said one or more facial features; and
enable the one or more remote participants to consume said augmented video data.

### Claim 16 (depends on 15)

The system of claim 15, wherein the at least one augmentation effect module is further configured to:
receive audio data associated with the video data; and
augment the audio data effective to morph a voice contained within the audio data.

### Claim 17 (depends on 15)

The system of claim 15, wherein the system is further configured to:
establish a peer-to-peer communication connection between the one or more remote participants over which the electronic story is to be shared; and
share the electronic story over the peer-to-peer communication connection.

### Claim 18 (depends on 15)

The system of claim 15, wherein the at least one augmentation effect module is further configured to blend at least one image of said one or more facial features with an image associated with the electronic story.

### Claim 19 (depends on 15)

The system of claim 15, wherein the at least one augmentation effect module is further configured to detect the one or more facial features automatically.

### Claim 20 (depends on 15)

The system of claim 15, wherein the at least one augmentation effect module is further configured to:
detect at least one gesture contained within the video data; and
animate at least one object associated with the electronic story based, at least in part, on said detected at least one gesture.
