# US 10,454,986 B2 · Video synchronous playback method, apparatus, and system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,454,986 B2
- Document ID: US10454986B2
- Status: Granted
- Kind: B2
- Application number: 15/269,133
- Filed: 2016-09-19
- Published: 2017-01-05
- Granted: 2019-10-22
- Earliest claimed: 2014-03-27
- Assignees: Tencent Technology (Shenzhen) Company Limited
- Applicants: Tencent Technology (Shenzhen) Company Limited
- Inventors: Liang Fang; Peng Wang; Dejun Zhang; Dawei Sun
- Web page: https://patentgrep.com/patent/US10454986B2

## CPC

- H04N 21/4126: {The peripheral being portable, e.g. PDAs or mobile phones}
- H04L 65/70: Media network packetisation
- H04L 65/75: Media network packet handling
- H04L 67/1095: Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
- H04N 21/2387: Stream processing in response to a playback request from an end-user, e.g. for trick-play
- H04N 21/4302: {Content synchronisation processes, e.g. decoder synchronisation}
- H04N 21/4402: involving reformatting operations of video signals for household redistribution, storage or real-time display {(details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764)}
- H04N 21/8153: {comprising still images, e.g. texture, background image}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A video synchronous playback system includes: a mobile terminal, a personal computer (PC), an encoding server, a streaming server, and a playback device, where the mobile terminal is configured to capture a current displayed frame of a played video to obtain a first image, perform bitmap scaling processing on the first image to obtain a second image, perform image compression processing on the second image to obtain a third image, and send the third image to the encoding server by using the PC; and the encoding server is configured to restore the third image into a bitmap image to obtain a fourth image, perform bitmap scaling processing on the fourth image to obtain a fifth image, perform format conversion, encoding processing, and encapsulation on the fifth image to obtain a video stream, and send the video stream to a target playback device by using the streaming server.

## Claims

### Claim 1

A video synchronous playback system, comprising:
a mobile terminal, a personal computer (PC), an encoding server, a streaming server, and a playback device;
the mobile terminal being connected to the PC by using a universal serial bus (USB), the PC being capable of performing data exchange with the encoding server, the encoding server being capable of performing data exchange with the streaming server, and the streaming server being capable of performing data exchange with the playback device;
the mobile terminal being configured to capture a current displayed frame of a played video to obtain a first image, perform bitmap scaling processing on the first image to obtain a second image, perform image compression processing on the second image to obtain a third image, and send the third image to the PC, and the PC sending the third image to the encoding server; and
the encoding server being configured to: after receiving the third image, restore the third image into a bitmap image to obtain a fourth image, perform bitmap scaling processing on the fourth image to obtain a fifth image, perform format conversion, encoding processing, and encapsulation on the fifth image to obtain a video stream, and send the video stream to the streaming server, and the streaming server sending the video stream to a target playback device.

### Claim 2

A video synchronous playback method, comprising:
capturing, by a mobile terminal, a current displayed frame of a played video to obtain a first image, the first image being a first bitmap image;
performing bitmap scaling processing on the first image according to a current resolution of the mobile terminal to obtain a second image;
performing image compression processing on the second image to obtain a third image;
sending the third image from the mobile terminal to an encoding server;
receiving the third image by the encoding server;
restoring, by the encoding server, the received third image, into a second bitmap image to obtain a fourth image;
performing bitmap scaling processing on the fourth image according to a preset resolution to obtain a fifth image;
performing format conversion, encoding processing, and encapsulation on the fifth image to obtain a video stream;
and
sending the image video stream to a target playback device.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the performing bitmap scaling processing on the first image according to a current resolution of the mobile terminal to obtain a second image comprises: querying a correspondence table between a resolution and a scaling ratio, to determine the scaling ratio corresponding to the current resolution of the mobile terminal; and performing bitmap scaling processing on the first image according to the corresponding scaling ratio to obtain the second image.

### Claim 4 (depends on 2)

The method according to claim 2, wherein the performing image compression processing on the second image to obtain a third image comprises: compressing the second image into a third image in a Joint Photographic Experts Group (JPEG) format.

### Claim 5 (depends on 2)

The method according to claim 2, further comprising: performing, by the encoding server if an image sent by the mobile terminal is not received within a preconfigured time period after the encoding server sends the video stream, frame interpolation processing by using the fourth image.

### Claim 6

An encoding server, comprising:
an interface configured to receive a first video image that has been bitmap scaled by a mobile terminal to form second image and compression processed by a mobile terminal to form a second image: and one or more processors executing instruction modules, the instruction modules comprising:
a restoring module, configured to restore a received third image, into a bitmap image to obtain a fourth image;
a bitmap scaling module, configured to:
after the restoring module obtains the fourth image, perform bitmap scaling processing on the fourth image according to a preset resolution to obtain a fifth image;
a processing module, configured to: after the bitmap scaling module obtains the fifth image, perform format conversion, encoding processing, and encapsulation on the fifth image to obtain a video stream; and
a video stream sending module, configured to: after the processing module obtains the video stream, send the video stream to a target playback device.

### Claim 7 (depends on 6)

The encoding server according to claim 6, further comprising:
a frame interpolation module, configured to:
if an image sent by the mobile terminal is not received within a preconfigured time period after the encoding server sends the video stream, perform frame interpolation processing by using the fourth image.

### Claim 8 (depends on 1)

The video synchronous playback system according to claim 1, wherein the second image through the fifth image are sequentially derived from the first image.

### Claim 9 (depends on 2)

The video synchronous playback method according to claim 2, wherein the second image through the fifth image are sequentially derived from the first image.

### Claim 10 (depends on 6)

The encoding server according to claim 6, wherein the second image through the fifth image are sequentially derived from the first image.