# US 2022/0286733 A1 · Video output method and video output apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0286733 A1
- Document ID: US20220286733A1
- Status: Published application
- Kind: A1
- Application number: 17/685,537
- Filed: 2022-03-03
- Published: 2022-09-08
- Earliest claimed: 2021-03-03
- Assignees: Yamaha Corporation
- Applicants: Yamaha Corporation
- Inventors: Masato SUZUKI; Shintaro NOGUCHI
- Web page: https://patentgrep.com/patent/US20220286733A1

## CPC

- H04N 21/2187: Live feed
- H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A video output method receives an operation from each of a plurality of users, generates a performance image and a performance sound based on the received operation, receives first video data, synthesizes the first video data and the performance image to generate output video data, and outputs the output video data and the performance sound.

## Claims

### Claim 1

A video output method comprising:
receiving an operation from each of a plurality of users;
generating a performance image and a performance sound based on the received operation;
receiving first video data;
synthesizing the first video data and the performance image to generate output video data; and
outputting the output video data and the performance sound.

### Claim 2

A video output method comprising:
receiving an operation from each of a plurality of users;
receiving first video data obtained by photographing a device that performs a performance based on the received operation; and
outputting output video data based on the first video data.

### Claim 3 (depends on 1)

The video output method according to claim 1, further comprising
changing a display position of the performance image in the output video data based on the operation.

### Claim 4 (depends on 1)

The video output method according to claim 1, wherein
the output video data includes a plurality of performance images, and
the performance sound includes a plurality of performance sounds,
wherein
an upper limit of a number of the plurality of performance sounds is less than an upper limit of a number of the plurality of performance images.

### Claim 5 (depends on 1)

The video output method according to claim 1, further comprising
determining sound quality of the performance sound based on the operation.

### Claim 6 (depends on 5)

The video output method according to claim 5, wherein
the sound quality includes pitch and panning.

### Claim 7 (depends on 1)

The video output method according to claim 1, further comprising
receiving second video data that include a video image of a first performer and third video data that include a video image of a second performer,
wherein
the output video data further include the second video data and the third video data,
the performance image and the performance sound are constituted by performance information including a performance image and a performance sound that are generated corresponding to the operation from each of the plurality of users, and
the performance information is associated with either the first performer or the second performer.

### Claim 8 (depends on 7)

The video output method according to claim 7, wherein
the associating is determined based on the second video data, the third video data, and the performance information, the second video data and the third video data being included in the output video data.

### Claim 9 (depends on 1)

The video output method according to claim 1, wherein
the first video data include a video image obtained by photographing a performer.

### Claim 10

A video output apparatus comprising:
a user operation receptor that receives an operation from each of a plurality of users;
a performance data generator that generates a performance image and a performance sound based on the received operation;
a video data receptor that receives first video data;
a video data generator that synthesizes the first video data and the performance image to generate output video data; and
an outputter that outputs the output video data and the performance sound.

### Claim 11 (depends on 10)

The video output apparatus according to claim 10, wherein
the video data generator changes a display position of the performance image in the output video data based on the operation.

### Claim 12 (depends on 10)

The video output apparatus according to claim 10, further including:
the output video data includes a plurality of performance images, and
the performance sound includes a plurality of performance sounds,
wherein
an upper limit of a number of the plurality of performance sounds is less than an upper limit of a number of the plurality of performance images.

### Claim 13 (depends on 10)

The video output apparatus according to claim 10, wherein
the performance data generator determines sound quality of the performance sound based on the operation.

### Claim 14 (depends on 13)

The video output apparatus according to claim 13, wherein
the sound quality includes pitch and panning.

### Claim 15 (depends on 10)

The video output apparatus according to claim 10, wherein
the video data receptor further receives second video data that include a video image of a first performer and third video data that include a video image of a second performer,
wherein
the output video data further include the second video data and the third video data,
the performance image and the performance sound are constituted by performance information including a performance image and a performance sound that are generated corresponding to the operation from each of the plurality of users, and
the performance information is associated with either the first performer or the second performer.

### Claim 16 (depends on 15)

The video output apparatus according to claim 15, wherein
the associating is determined based on the second video data, the third video data, and the performance information, the second video data and the third video data being included in the output video data.

### Claim 17 (depends on 10)

The video output apparatus according to claim 10, wherein
the first video data include a video image obtained by photographing a performer.
