# US 2023/0144966 A1 · Method, apparatus, and device for video-based interaction, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0144966 A1
- Document ID: US20230144966A1
- Status: Published application
- Kind: A1
- Application number: 18/090,302
- Filed: 2022-12-28
- Published: 2023-05-11
- Earliest claimed: 2020-09-30
- Assignees: Beijing Zitiao Network Technology Co., Ltd.
- Applicants: Beijing Zitiao Network Technology Co., Ltd.
- Inventors: Yu ZHAO; Ji LI
- Web page: https://patentgrep.com/patent/US20230144966A1

## CPC

- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)}
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method for video-based interaction method includes: when a target video is played back to a target time, determining whether a resource corresponding to a mask in the target video is successfully loaded, the resource comprising an interactive display image having a correlation with a target display element; if the resource is successfully loaded, assigning the interactive display image as a display image of an interactive control, displaying a mask comprising the interactive control on a current playback interface; and when a trigger operation with respect to the interactive control is received, skipping from the current playback interface to a target page, thus implementing the displaying of the target page. For the present solution, because the interactive control is related to a display element in a video image frame, a user can be immersively brought from the video playback interface to browsing the target page, thus ensuring user experience.

## Claims

### Claim 1

A video-based interaction method, comprising:
determining whether a resource corresponding to an obscuration in a target video is successfully loaded, in response to playing the target video to a target time instant, wherein the resource comprises an interaction display image having a correspondence with a target display element on a current image frame corresponding to the target time instant;
determining the interaction display image as a display image of an interaction control, in response to determining that the resource corresponding to the obscuration is successfully loaded; and displaying the obscuration comprising the interaction control, on a current play interface corresponding to the current image frame; and
jumping from the current play interface to a target page in response to a trigger operation on the interaction control, wherein content presented on the target page corresponds to content presented on the current image frame.

### Claim 2 (depends on 1)

The method according to claim 1, wherein after jumping from the current play interface to the target page, the method further comprises:
jumping from the target page to a video play interface in response to a return operation triggered on the target page, and continuing to play the target video on the video play interface based on a predetermined time instant, wherein the predetermined time instant is a play time instant later than the target time instant in the target video.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the resource further comprises an interaction guidance animation, the interaction guidance animation comprises at least two image frames, the interaction guidance animation is played on the obscuration, and the method further comprises:
storing a current play frame of the interaction guidance animation played on the obscuration as a target play frame, in response to a trigger operation of switching an application program corresponding to the target video to a background; and
continuing to play the interaction guidance animation on the obscuration based on the target play frame, in response to a trigger operation of switching the application program to a foreground.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the jumping from the current play interface to a target page in response to a trigger operation on the interaction control comprises:
jumping from the current play interface to the target page in a transition animation manner, in response to the trigger operation on the interaction control.

### Claim 5 (depends on 4)

The method according to claim 4, wherein before jumping from the current play interface to the target page through the transition animation, the method further comprises:
pre-rendering the target page, to obtain a pre-rendered page; and
sending an audio play identifier and a page display identifier to a control module of the target page, wherein the audio play identifier indicates whether to play an audio resource corresponding to the target page, the page display identifier indicates whether to display the pre-rendered page, and the control module is configured to play the audio resource based on the audio play identifier and display the pre-rendered page based on the page display identifier.

### Claim 6 (depends on 1)

The method according to claim 1, wherein after determining whether the resource corresponding to the obscuration in the target video is successfully loaded, the method further comprises:
continuing to play the target video based on the target time instant, in response to determining that the resource corresponding to the obscuration fails to load.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the determining the interaction display image as the display image of the interaction control; and displaying the obscuration including the interaction control, on the current display interface corresponding to the current image frame comprises:
determining target display position information of the interaction display image on a screen of a current device, based on a screen size of the current device and display position information of the interaction display image in the target video; and
displaying the obscuration on the current play interface corresponding to the current image frame, and displaying the interaction control on the obscuration based on the target display position information, where the interaction display image is used as the display image of the interaction control.

### Claim 8

A non-transitory computer readable storage medium, wherein instructions is stored on the computer readable storage medium; and the instructions, when executed on a terminal device, cause the terminal device to:
determine whether a resource corresponding to an obscuration in a target video is successfully loaded, in response to playing the target video to a target time instant, wherein the resource comprises an interaction display image having a correspondence with a target display element on a current image frame corresponding to the target time instant;
determine the interaction display image as a display image of an interaction control, in response to determining that the resource corresponding to the obscuration is successfully loaded; and display the obscuration comprising the interaction control, on a current play interface corresponding to the current image frame; and
jump from the current play interface to a target page in response to a trigger operation on the interaction control, wherein content presented on the target page corresponds to content presented on the current image frame.

### Claim 9 (depends on 8)

The non-transitory computer readable storage medium according to claim 8, wherein the instructions, when executed on a terminal device, cause the terminal device to:
jump from the target page to a video play interface in response to a return operation triggered on the target page, and continue to play the target video on the video play interface based on a predetermined time instant, wherein the predetermined time instant is a play time instant later than the target time instant in the target video.

### Claim 10 (depends on 8)

The non-transitory computer readable storage medium according to claim 8, wherein the resource further comprises an interaction guidance animation, the interaction guidance animation comprises at least two image frames, the interaction guidance animation is played on the obscuration, and
wherein the instructions, when executed on a terminal device, cause the terminal device to:
store a current play frame of the interaction guidance animation played on the obscuration as a target play frame, in response to a trigger operation of switching an application program corresponding to the target video to a background; and
continue to play the interaction guidance animation on the obscuration based on the target play frame, in response to a trigger operation of switching the application program to a foreground.

### Claim 11 (depends on 8)

The non-transitory computer readable storage medium according to claim 8, wherein the instructions, when executed on a terminal device, cause the terminal device to:
jump from the current play interface to the target page in a transition animation manner, in response to the trigger operation on the interaction control.

### Claim 12 (depends on 11)

The non-transitory computer readable storage medium according to claim 11, wherein the instructions, when executed on a terminal device, cause the terminal device to:
pre-render the target page, to obtain a pre-rendered page; and
send an audio play identifier and a page display identifier to a control module of the target page, wherein the audio play identifier indicates whether to play an audio resource corresponding to the target page, the page display identifier indicates whether to display the pre-rendered page, and the control module is configured to play the audio resource based on the audio play identifier and display the pre-rendered page based on the page display identifier.

### Claim 13 (depends on 8)

The non-transitory computer readable storage medium according to claim 8, wherein the instructions, when executed on a terminal device, cause the terminal device to:
continue to play the target video based on the target time instant, in response to determining that the resource corresponding to the obscuration fails to load.

### Claim 14

A device, comprising:
a memory;
a processor; and
a computer program stored on the memory and executable on the processor,
wherein the processor, when executing the computer program, implements a video-based interaction method, and the video-based interaction method comprises:
determining whether a resource corresponding to an obscuration in a target video is successfully loaded, in response to playing the target video to a target time instant, wherein the resource comprises an interaction display image having a correspondence with a target display element on a current image frame corresponding to the target time instant;
determining the interaction display image as a display image of an interaction control, in response to determining that the resource corresponding to the obscuration is successfully loaded; and displaying the obscuration comprising the interaction control, on a current play interface corresponding to the current image frame; and
jumping from the current play interface to a target page in response to a trigger operation on the interaction control, wherein content presented on the target page corresponds to content presented on the current image frame.

### Claim 15 (depends on 14)

The device according to claim 14, wherein after jumping from the current play interface to the target page, the method further comprises:
jumping from the target page to a video play interface in response to a return operation triggered on the target page, and continuing to play the target video on the video play interface based on a predetermined time instant, wherein the predetermined time instant is a play time instant later than the target time instant in the target video.

### Claim 16 (depends on 14)

The device according to claim 14, wherein the resource further comprises an interaction guidance animation, the interaction guidance animation comprises at least two image frames, the interaction guidance animation is played on the obscuration, and the method further comprises:
storing a current play frame of the interaction guidance animation played on the obscuration as a target play frame, in response to a trigger operation of switching an application program corresponding to the target video to a background; and
continuing to play the interaction guidance animation on the obscuration based on the target play frame, in response to a trigger operation of switching the application program to a foreground.

### Claim 17 (depends on 14)

The device according to claim 14, wherein the jumping from the current play interface to a target page in response to a trigger operation on the interaction control comprises:
jumping from the current play interface to the target page in a transition animation manner, in response to the trigger operation on the interaction control.

### Claim 18 (depends on 17)

The device according to claim 17, wherein before jumping from the current play interface to the target page through the transition animation, the method further comprises:
pre-rendering the target page, to obtain a pre-rendered page; and
sending an audio play identifier and a page display identifier to a control module of the target page, wherein the audio play identifier indicates whether to play an audio resource corresponding to the target page, the page display identifier indicates whether to display the pre-rendered page, and the control module is configured to play the audio resource based on the audio play identifier and display the pre-rendered page based on the page display identifier.

### Claim 19 (depends on 14)

The device according to claim 14, wherein after determining whether the resource corresponding to the obscuration in the target video is successfully loaded, the method further comprises:
continuing to play the target video based on the target time instant, in response to determining that the resource corresponding to the obscuration fails to load.

### Claim 20 (depends on 14)

The device according to claim 14, wherein the determining the interaction display image as the display image of the interaction control; and displaying the obscuration including the interaction control, on the current display interface corresponding to the current image frame comprises:
determining target display position information of the interaction display image on a screen of a current device, based on a screen size of the current device and display position information of the interaction display image in the target video; and
displaying the obscuration on the current play interface corresponding to the current image frame, and displaying the interaction control on the obscuration based on the target display position information, where the interaction display image is used as the display image of the interaction control.
