# US 2020/0404378 A1 · Video-based information acquisition method and device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0404378 A1 - Document ID: US20200404378A1 - Status: Published application - Kind: A1 - Application number: 17/013,686 - Filed: 2020-09-07 - Published: 2020-12-24 - Earliest claimed: 2018-10-18 - Assignees: Baidu Online Network Technology (Beijing) Co., Ltd. - Applicants: Baidu Online Network Technology (Beijing) Co., Ltd. - Inventors: Qun WANG; Weishan DONG; Chunyang MA - Web page: https://patentgrep.com/patent/US20200404378A1 ## CPC - H04N 21/4722: for requesting additional data associated with the content - G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames} - H04N 5/445: for displaying additional information (H04N5/50 takes precedence) - H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/2393: {involving handling client requests (scheduling or organising the servicing of application requests H04L67/60)} - H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)} - H04N 21/42653: {for processing graphics} - H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/4622: {Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859)} - H04N 21/4668: {for recommending content, e.g. movies} - H04N 21/4826: {using recommendation lists, e.g. of programmes or channels sorted out according to their score} - H04N 21/4828: {for searching programme descriptors (retrieval of video data G06F16/739)} - H04N 21/658: Transmission by the client directed to the server - H04N 21/8133: {specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video programme} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract The application provides a video-based information acquisition method and device. The method includes: detecting, by a terminal apparatus, a main body in a currently played video picture; intercepting an image of the main body from the video picture; acquiring relevant information of the main body according to the image of the main body; displaying the video picture and the relevant information of the main body on a same screen. The terminal apparatus can actively recommend relevant content of a main body in a video for a user, by actively detecting the main body in a video picture, triggering an acquisition of the relevant information of the main body and displaying the relevant information to the user, which does not require any operations by the user, thereby improving the user experience. ## Claims ### Claim 1 A video-based information acquisition method, wherein the method comprises: detecting, by a terminal apparatus, a main body in a currently played video picture; intercepting, by the terminal apparatus, an image of the main body from the video picture; acquiring, by the terminal apparatus, relevant information of the main body according to the image of the main body; displaying, by the terminal apparatus, the video picture and the relevant information of the main body on a same screen. ### Claim 2 (depends on 1) The method according to claim 1, wherein the acquiring, by the terminal apparatus, relevant information of the main body according to the image of the main body comprises: sending, by the terminal apparatus, the image of the main body to a server, so as to enable the server to recognize the main body according to the image of the main body; receiving, by the terminal apparatus, the relevant information of the main body sent by the server. ### Claim 3 (depends on 2) The method according to claim 2, wherein before the receiving, by the terminal apparatus, the relevant information of the main body sent by the server, the method further comprises: receiving, by the terminal apparatus, a recognition result of the main body sent by the server; judging, by the terminal apparatus, whether the main body has been detected according to the recognition result; if the main body has not been detected, sending, by the terminal apparatus, a data request to the server, wherein the data request is configured to request the relevant information of the main body. ### Claim 4 (depends on 1) The method according to claim 1, wherein the acquiring, by the terminal apparatus, relevant information of the main body according to the image of the main body comprises: recognizing, by the terminal apparatus, the main body according to the image of main body to obtain a recognition result; judging, by the terminal apparatus, whether the main body has been detected according to the recognition result; if the main body has not been detected, sending, by the terminal apparatus, a data request to the server, wherein the data request is configured to request the relevant information of the main body; receiving, by the terminal apparatus, the relevant information of the main body sent by the server. ### Claim 5 (depends on 1) The method according to claim 1, wherein the method further comprises: displaying, by the terminal apparatus, prompt information on a screen, wherein the prompt information is configured to prompt that relevant information on the screen is the relevant information of the main body. ### Claim 6 (depends on 1) The method according to claim 1, wherein the displaying, by the terminal apparatus, the video picture and the relevant information of the main body on a same screen comprises: overlapped-displaying, by the terminal apparatus, the relevant information of the main body on a preset position of the video picture, and a display window of the relevant information of the main body is less than half of a display window of the video picture. ### Claim 7 (depends on 1) The method according to claim 1, wherein the displaying, by the terminal apparatus, the video picture and the relevant information of the main body on a same screen comprises: displaying, by the terminal apparatus, the relevant information of the main body in a preset area outside a display window of the video picture. ### Claim 8 (depends on 1) The method according to claim 1, wherein, the detecting, by a terminal apparatus, a main body in a currently played video picture, comprises: detecting, by the terminal apparatus, a contour of a detection object in the video picture; determining, by the terminal apparatus, the main body according to the contour of the detection object in the video picture. ### Claim 9 (depends on 1) The method according to claim 1, wherein before the detecting, by the terminal apparatus, a main body in currently played video picture, the method further comprises: displaying, by the terminal apparatus, a recommendation function button on a user interface; receiving, by the terminal apparatus, a first operation of the recommendation function button by a user; and starting, by the terminal apparatus, a recommendation function according to the first operation; and wherein the detecting, by the terminal apparatus, a main body in a currently played video picture comprises: detecting, by the terminal apparatus, the main body in the currently played video picture when the recommendation function started. ### Claim 10 (depends on 9) The method according to claim 9, wherein after the displaying, by the terminal apparatus, the video picture and the relevant information of the main body on a same screen the method further comprises: receiving, by the terminal apparatus, a second operation of the recommendation function button by a user; closing, by the terminal apparatus, a recommendation function according to the second operation. ### Claim 11 (depends on 1) The method according to claim 1, wherein the detecting, by the terminal apparatus, the main body in a currently played video picture comprises: detecting, by the terminal apparatus, substances in the video picture according to a preset priority order of detection objects from high to low; determining the main body from the detected detection object, when the detection object corresponding to a current priority is detected from the substances in the video picture according to the detection object corresponding to the current priority. ### Claim 12 A terminal apparatus, comprising a processor, a memory and a transceiver, wherein the memory is configured to store instructions, the transceiver is configured to communicate with other apparatuses; and the processor is configured to execute instructions stored in the memory for performing following steps: detecting a main body in a currently played video picture; intercepting an image of the main body from the video picture; acquiring relevant information of the main body according to the image of the main body; displaying the video picture and the relevant information of the main body on a same screen. ### Claim 13 (depends on 12) The terminal apparatus according to claim 12, wherein the step of acquiring relevant information of the main body according to the image of the main body comprises: sending the image of the main body to a server, so as to enable the server to recognize the main body according to the image of the main body; receiving the relevant information of the main body sent by the server. ### Claim 14 (depends on 13) The terminal apparatus according to claim 13, wherein before the step of receiving, the relevant information of the main body sent by the server, the processor is further configured to execute instructions stored in the memory for performing following steps: receiving a recognition result of the main body sent by the server; judging whether the main body has been detected according to the recognition result; sending a data request to the server if the main body has not been detected, wherein the data request is configured to request the relevant information of the main body. ### Claim 15 (depends on 12) The terminal apparatus according to claim 12, wherein the step of acquiring relevant information of the main body according to the image of the main body comprises: recognizing the main body according to the image of main body to obtain a recognition result; judging whether the main body has been detected according to the recognition result; sending a data request to the server if the main body has not been detected, wherein the data request is configured to request the relevant information of the main body; receiving the relevant information of the main body sent by the server. ### Claim 16 (depends on 12) The terminal apparatus according to claim 12, wherein the processor is further configured to execute instructions stored in the memory for performing following steps: displaying prompt information on a screen, wherein the prompt information is configured to prompt that relevant information on the screen is the relevant information of the main body. ### Claim 17 (depends on 12) The terminal apparatus according to claim 12, wherein the step of displaying the video picture and the relevant information of the main body on a same screen comprises: overlapped-displaying a relevant information of the main body on a preset position of the video picture, and a display window of the relevant content of the main body is less than half of a display window of the video. ### Claim 18 (depends on 12) The terminal apparatus according to claim 12, wherein the step of the displaying the video picture and the relevant information of the main body on a same screen comprises: displaying a relevant information of the main body in a preset area outside a display window of the video. ### Claim 19 (depends on 1) A non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores instructions which, when being executed, cause a computer to execute the method according to claim 1. ### Claim 20 (depends on 1) A computer program, comprising program codes, wherein the program codes execute the method according to claim 1 when the computer program is running by a computer.