# US 12,763,052 B2 · Rhythm interaction method and device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,763,052 B2
- Document ID: US12763052B2
- Status: Granted
- Kind: B2
- Application number: 18/557,908
- Filed: 2022-04-26
- Published: 2024-07-11
- Granted: 2026-10-13
- Earliest claimed: 2021-04-27
- Assignees: Beijing Bytedance Network Technology Co., Ltd.
- Applicants: Beijing Bytedance Network Technology Co., Ltd.
- Inventors: Xiaochun Cai; Jiajie Ye; Cong Ye
- Web page: https://patentgrep.com/patent/US12763052B2

## CPC

- G10H 1/40: Rhythm
- G10H 1/0008: {Associated control or indicating means}
- H04N 21/2187: Live feed
- H04N 21/472: End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content {(end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612)}
- G10H 2210/071: for rhythm pattern analysis or rhythm style recognition
- G10H 2220/081: Beat indicator, e.g. marks or flashing LEDs to indicate tempo or beat positions
- G10H 2220/161: with 2D or x/y surface coordinates sensing
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present application provides a rhythm interaction method and device. The method includes: the first client sending a song identification to a server, the first client playing a song according to the audio data sent by the server, and the first client displaying the rhythm interaction result sent by the server within a preset time period before an end of the playing of the song.

## Claims

### Claim 1

A rhythm interaction method, applied to a first client, the method comprising:
sending, by the first client, a song identification to a server to enable the server to obtain audio data and song rhythm point information according to the song identification, wherein the audio data is sent from the server to the first client and at least one second client, and wherein the song rhythm point information is sent from the server to at least one third client, and used by the at least one third client to obtain a score of the at least one third client, wherein the score of the at least one third client is sent from the at least one third client to the server and used by the server to obtain a rhythm interaction result, and wherein the rhythm interaction result is sent from the server to the first client and the at least one third client; wherein the at least one second client is a client that enters a live stream of the first client, and the at least one third client is a second client of the at least one second client that participates in rhythm interaction;
wherein a score of each third client is obtained by performing addition on a score of each touch operation of a user on an operating area comprised in a user interface of the third client, the operating area comprises a first edge and a second edge, the first edge is an edge passed by a plurality of visualized rhythm objects, and the second edge is an edge opposite to the first edge; the score of the touch operation is determined as a first preset score if the user performs a touch operation on the operating area when a visualized rhythm object moves to a position that is outside the operating area and not in contact with the first edge, the score of the touch operation is determined as a second preset score if the user performs a touch operation on the operating area when the visualized rhythm object moves to a position that is outside the operating area and in contact with the first edge, the score of the touch operation is determined as a third preset score if the user performs a touch operation on the operating area when the visualized rhythm object moves to a position that is within the operating area and in contact with the first edge, the score of the touch operation is determined as the second preset score if the user performs a touch operation on the operating area when the visualized rhythm object moves to a position that is within the operating area and not in contact with the first edge, the score of the touch operation is determined as the first preset score if the user performs a touch operation when the visualized rhythm object moves to a position intersecting with the second edge, wherein the first preset score is less than the second preset score, and the second preset score is less than the third preset score;
playing, by the first client, a song according to the audio data sent by the server; and
displaying, by the first client, the rhythm interaction result sent by the server, within a preset time period before an end of the playing of the song.

### Claim 2

A rhythm interaction method, applied to a server, the method comprising:
receiving, by the server, a song identification sent by a first client;
obtaining, by the server, audio data and song rhythm point information according to the song identification;
sending, by the server, the audio data to the first client and at least one second client, sending the song rhythm point information to at least one third client so that the at least one third client obtains a score of the at least one third client according to the song rhythm point information and sends the score of the at least one third client to the server; wherein the at least one second client is a client that enters a live stream of the first client, and the at least one third client is a second client of the at least one second client that participates in rhythm interaction;
wherein a score of each third client is obtained by performing addition on a score of each touch operation of a user on an operating area comprised in a user interface of the third client, the operating area comprises a first edge and a second edge, the first edge is an edge passed by a plurality of visualized rhythm objects, and the second edge is an edge opposite to the first edge; the score of the touch operation is determined as a first preset score if the user performs a touch operation on the operating area when a visualized rhythm object moves to a position that is outside the operating area and not in contact with the first edge, the score of the touch operation is determined as a second preset score if the user performs a touch operation on the operating area when the visualized rhythm object moves to a position that is outside the operating area and in contact with the first edge, the score of the touch operation is determined as a third preset score if the user performs a touch operation on the operating area when the visualized rhythm object moves to a position that is within the operating area and in contact with the first edge, the score of the touch operation is determined as the second preset score if the user performs a touch operation on the operating area when the visualized rhythm object moves to a position that is within the operating area and not in contact with the first edge, the score of the touch operation is determined as the first preset score if the user performs a touch operation when the visualized rhythm object moves to a position intersecting with the second edge, wherein the first preset score is less than the second preset score, and the second preset score is less than the third preset score;
obtaining, by the server, a rhythm interaction result according to the score of the at least one third client; and
sending, by the server, the rhythm interaction result to the first client and the at least one third client.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the obtaining, by the server, the rhythm interaction result according to the score of the at least one third client comprises:
sorting, by the server, the score of the at least one third client from most to least; and
taking, by the server, avatars of users of top N scored third clients and an avatar of a user of the first client as the rhythm interaction result, wherein N is a positive integer greater than or equal to 1.

### Claim 4

A rhythm interaction method, applied to a third client, wherein a user interface of the third client comprises an operating area, and the method comprises:
receiving, by the third client, audio data and song rhythm point information sent by a server, wherein the third client is a second client of at least one second client that participates in rhythm interaction, and the at least one second client is a client that enters a live stream of a first client;
playing, by the third client, a song according to the audio data;
generating, by the third client, a plurality of visualized rhythm objects according to the song rhythm point information, controlling the plurality of visualized rhythm objects to move toward the operating area, and determining a score of the third client according to at least one touch operation of a user on the operating area;
sending, by the third client, the score of the third client to the server so that the server determines a rhythm interaction result according to the score of the third client;
receiving, by the third client, the rhythm interaction result sent by the server; and
displaying, by the third client, the rhythm interaction result;
wherein the determining the score of the third client according to the at least one touch operation of the user on the operating area comprises:
obtaining, by the third client, a score of each touch operation; and
performing, by the third client, addition on the score of each touch operation to obtain the score of the third client;
wherein the operating area comprises a first edge and a second edge, the first edge is an edge passed by the plurality of visualized rhythm objects, and the second edge is an edge opposite to the first edge; wherein the obtaining the score of each touch operation comprises:
if the user performs a touch operation on the operating area when a visualized rhythm object moves to a position that is outside the operating area and not in contact with the first edge, determining, by the third client, that the score of the touch operation is a first preset score;
if the user performs a touch operation on the operating area when the visualized rhythm object moves to a position that is outside the operating area and in contact with the first edge, determining, by the third client, that the score of the touch operation is a second preset score;
if the user performs a touch operation on the operating area when the visualized rhythm object moves to a position that is within the operating area and in contact with the first edge, determining, by the third client, that the score of the touch operation is a third preset score;
if the user performs a touch operation on the operating area when the visualized rhythm object moves to a position that is within the operating area and not in contact with the first edge, determining, by the third client, that the score of the touch operation is the second preset score; or
if the user performs a touch operation when the visualized rhythm object moves to a position intersecting with the second edge, determining, by the third client. that the score of the touch operation is the first preset score, wherein the first preset score is less than the second preset score, and the second preset score is less than the third preset score.

### Claim 5 (depends on 4)

The method according to claim 4, before determining the score of the third client according to the at least one touch operation of the user on the operating area, further comprising:
displaying, by the third client, a guiding gesture in the operating area, wherein the guiding gesture is used to instruct the user to perform a touch operation in the operating area.

### Claim 6 (depends on 5)

The method according to claim 5, further comprising:
displaying, by the third client, a progress bar in the operating area, wherein the progress bar is positively correlated with a current score of the third client.

### Claim 7 (depends on 5)

The method according to claim 5, wherein the displaying, by the third client, the rhythm interaction result comprises:
displaying, by the third client, the rhythm interaction result within a preset time period before an end of the playing of the song.

### Claim 8 (depends on 6)

The method according to claim 6, further comprising:
setting, by the third client, a state of the progress bar to an initial state within a preset time period before an end of the playing of the song.

### Claim 9 (depends on 1)

A first client, comprising:
a processor; and
memory, configured to store an executable instruction executed by the processor;
wherein the processor is configured to execute the executable instruction to implement the method according to claim 1.

### Claim 10 (depends on 2)

A server, comprising:
a processor; and
memory, configured to store an executable instruction executed by the processor;
wherein the processor is configured to execute the executable instruction to implement the method according to claim 2.

### Claim 11 (depends on 4)

A third client, comprising:
a processor, and
memory, configured to store an executable instruction executed by the processor;
wherein the processor is configured to execute the executable instruction to implement the method according to claim 4.

### Claim 12 (depends on 10)

The server according to claim 10, wherein the processor is further configured to execute the executable instruction to:
sort the score of the at least one third client from most to least, and
take avatars of users of top N scored third clients and an avatar of a user of the first client as the rhythm interaction result.

### Claim 13 (depends on 11)

The third client according to claim 11, wherein the processor is further configured to execute the executable instruction to:
display a guiding gesture in the operating area, wherein the guiding gesture is used to instruct the user to perform a touch operation in the operating area.

### Claim 14 (depends on 13)

The third client according to claim 13, wherein the processor is further configured to execute the executable instruction to:
display a progress bar in the operating area, wherein the progress bar is positively correlated with a current score of the third client.

### Claim 15 (depends on 1)

The method according to claim 1, wherein the rhythm interaction result comprises an avatar of a user of the first client, and avatars of users of the at least one third client determined based on the score of the at least one third client.

### Claim 16 (depends on 4)

The method according to claim 4, wherein the rhythm interaction result comprises an avatar of a user of the first client, and avatars of users of the third client determined based on the score of the third client.