# US 12,223,717 B2 · Method, apparatus, device, and storage medium for determining implantation location of recommendation information > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,223,717 B2 - Document ID: US12223717B2 - Status: Granted - Kind: B2 - Application number: 18/434,655 - Filed: 2024-02-06 - Published: 2024-05-30 - Granted: 2025-02-11 - Earliest claimed: 2019-07-19 - Assignees: Tencent Technology (Shenzhen) Company Limited - Applicants: Tencent Technology (Shenzhen) Company Limited - Inventors: Hui Sheng; Dongbo Huang - Web page: https://patentgrep.com/patent/US12223717B2 ## CPC - G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)} - G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44) - G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames} - G06V 20/48: {Matching video sequences} - G06V 20/49: {Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes} - G11B 27/036: Insert-editing - G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)} - H04N 5/265: Mixing - H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)} - H04N 21/854: Content authoring - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract This application discloses a method for implementing recommendation information in a video performed at a computer device. The method includes: acquiring a target video; identifying a video segment within the target video according to a scene change status of video frames in the target video, the video segment including a target video frame; performing image recognition on the target video frame to obtain a region corresponding to an object in the target video frame that is compatible with the recommendation information; and implanting the recommendation information in the region of the target video frame. Image recognition processing is performed on the target video frame to obtain a video segment including the target video frame, so as to determine the implantation location in the target video frame on the basis of the object of the target type in the target video frame. ## Claims ### Claim 1 A method for implanting recommendation information into a video performed at a computer device, the method comprising: acquiring a target video; identifying a video segment within the target video according to a scene change status of video frames in the target video, the video segment including a target video frame; performing image recognition on the target video frame to obtain a region corresponding to an object in the target video frame that is compatible with the recommendation information; and implanting the recommendation information in the region of the target video frame, further including: determining, from the region of the target video frame, a target sub-region related to the target video frame corresponding to a second object that is compatible with both the object in the target video frame and the recommendation information; determining, within the target sub-region, an implantation location of the recommendation information in the target video frame; and implanting the recommendation information in the target sub-region of the target video frame. ### Claim 2 (depends on 1) The method according to claim 1, wherein the determining, from the region of the target video frame, a target sub-region related to the target video frame corresponding to a second object that is compatible with both the object in the target video frame and the recommendation information comprises: determining n candidate regions related to the target video frame from the region of the target video frame, n being a positive integer; determining a second region corresponding to a central role from the region of the target video frame; determining a distance between each of the n candidate regions and the second region; and using a region in the n candidate regions that has the largest distance to the second region as the target sub-region. ### Claim 3 (depends on 2) The method according to claim 2, wherein the determining a second region corresponding to a central role from the region of the target video frame comprises: determining m role regions corresponding to a role type from the region of the target video frame, m being a positive integer; and using a role region with the largest region area in the m role regions as the second region corresponding to the central role. ### Claim 4 (depends on 1) The method according to claim 1, wherein the determining, within the target sub-region, an implantation location of the recommendation information in the target video frame comprises: multiplying a region area of the target sub-region by a preset multiple as a target area of the recommendation information displayed in the target video frame; determining a target region corresponding to the recommendation information in the target video frame according to the target area and a display shape of the recommendation information; and using a location at which the target region covers the target sub-region as the implantation location of the recommendation information in the target video frame. ### Claim 5 (depends on 1) The method according to claim 1, wherein the region of the target video frame comprises at least two candidate sub-regions corresponding to a target type, and the determining a target sub-region including the target video frame from the region of the target video frame comprises: identifying a candidate sub-region with a largest area corresponding to one of the at least two candidate sub-regions as the target sub-region. ### Claim 6 (depends on 1) The method according to claim 1, wherein the identifying a video segment within the target video according to a scene change status of video frames in the target video comprises: performing video segmentation on the target video to obtain a video segment corresponding to the scene change status; and acquiring a first key frame in the video segment as the target video frame, the target video frame being a video frame used for determining an implantation location of the recommendation information in the video segment. ### Claim 7 (depends on 1) The method according to claim 1, wherein the performing image recognition on the target video frame to obtain a region corresponding to an object in the target video frame that is compatible with the recommendation information comprises: performing image recognition on the target video frame to obtain a masking result set in the target video frame, each masking result set comprising an object category, an object region, and a confidence level that are of a recognized object; and removing a masking result with a confidence level less than a required confidence level in the masking result set from the masking result set to obtain the region corresponding to the object in the target video frame. ### Claim 8 A computer device, comprising a processor and a memory, the memory storing at least one instruction, the at least one instruction, when executed by the processor, causing the computer device to perform a plurality of operations including: acquiring a target video; identifying a video segment within the target video according to a scene change status of video frames in the target video, the video segment including a target video frame; performing image recognition on the target video frame to obtain a region corresponding to an object in the target video frame that is compatible with the recommendation information; and implanting the recommendation information in the region of the target video frame, further including: determining, from the region of the target video frame, a target sub-region related to the target video frame corresponding to a second object that is compatible with both the object in the target video frame and the recommendation information; determining, within the target sub-region, an implantation location of the recommendation information in the target video frame; and implanting the recommendation information in the target sub-region of the target video frame. ### Claim 9 (depends on 8) The computer device according to claim 8, wherein the determining, from the region of the target video frame, a target sub-region related to the target video frame corresponding to a second object that is compatible with both the object in the target video frame and the recommendation information comprises: determining n candidate regions related to the target video frame from the region of the target video frame, n being a positive integer; determining a second region corresponding to a central role from the region of the target video frame; determining a distance between each of the n candidate regions and the second region; and using a region in the n candidate regions that has the largest distance to the second region as the target sub-region. ### Claim 10 (depends on 9) The computer device according to claim 9, wherein the determining a second region corresponding to a central role from the region of the target video frame comprises: determining m role regions corresponding to a role type from the region of the target video frame, m being a positive integer; and using a role region with the largest region area in the m role regions as the second region corresponding to the central role. ### Claim 11 (depends on 8) The computer device according to claim 8, wherein the determining, within the target sub-region, an implantation location of the recommendation information in the target video frame comprises: multiplying a region area of the target sub-region by a preset multiple as a target area of the recommendation information displayed in the target video frame; determining a target region corresponding to the recommendation information in the target video frame according to the target area and a display shape of the recommendation information; and using a location at which the target region covers the target sub-region as the implantation location of the recommendation information in the target video frame. ### Claim 12 (depends on 8) The computer device according to claim 8, wherein the region of the target video frame comprises at least two candidate sub-regions corresponding to a target type, and the determining a target sub-region including the target video frame from the region of the target video frame comprises: identifying a candidate sub-region with a largest area corresponding to one of the at least two candidate sub-regions as the target sub-region. ### Claim 13 (depends on 8) The computer device according to claim 8, wherein the identifying a video segment within the target video according to a scene change status of video frames in the target video comprises: performing video segmentation on the target video to obtain a video segment corresponding to the scene change status; and acquiring a first key frame in the video segment as the target video frame, the target video frame being a video frame used for determining an implantation location of the recommendation information in the video segment. ### Claim 14 (depends on 8) The computer device according to claim 8, wherein the performing image recognition on the target video frame to obtain a region corresponding to an object in the target video frame that is compatible with the recommendation information comprises: performing image recognition on the target video frame to obtain a masking result set in the target video frame, each masking result set comprising an object category, an object region, and a confidence level that are of a recognized object; and removing a masking result with a confidence level less than a required confidence level in the masking result set from the masking result set to obtain the region corresponding to the object in the target video frame. ### Claim 15 A non-transitory computer-readable storage medium, storing at least one instruction, the at least one instruction, when executed by a processor of a computer device, causing the computer device to perform a plurality of operations including: acquiring a target video; identifying a video segment within the target video according to a scene change status of video frames in the target video, the video segment including a target video frame; performing image recognition on the target video frame to obtain a region corresponding to an object in the target video frame that is compatible with the recommendation information; and implanting the recommendation information in the region of the target video frame, further including: determining, from the region of the target video frame, a target sub-region related to the target video frame corresponding to a second object that is compatible with both the object in the target video frame and the recommendation information; determining, within the target sub-region, an implantation location of the recommendation information in the target video frame; and implanting the recommendation information in the target sub-region of the target video frame. ### Claim 16 (depends on 15) The non-transitory computer-readable storage medium according to claim 15, wherein the identifying a video segment within the target video according to a scene change status of video frames in the target video comprises: performing video segmentation on the target video to obtain a video segment corresponding to the scene change status; and acquiring a first key frame in the video segment as the target video frame, the target video frame being a video frame used for determining an implantation location of the recommendation information in the video segment. ### Claim 17 (depends on 15) The non-transitory computer-readable storage medium according to claim 15, wherein the performing image recognition on the target video frame to obtain a region corresponding to an object in the target video frame that is compatible with the recommendation information comprises: performing image recognition on the target video frame to obtain a masking result set in the target video frame, each masking result set comprising an object category, an object region, and a confidence level that are of a recognized object; and removing a masking result with a confidence level less than a required confidence level in the masking result set from the masking result set to obtain the region corresponding to the object in the target video frame. ### Claim 18 (depends on 15) The non-transitory computer-readable storage medium according to claim 15, wherein the determining, from the region of the target video frame, a target sub-region related to the target video frame corresponding to a second object that is compatible with both the object in the target video frame and the recommendation information comprises: determining n candidate regions related to the target video frame from the region of the target video frame, n being a positive integer; determining a second region corresponding to a central role from the region of the target video frame; determining a distance between each of the n candidate regions and the second region; and using a region in the n candidate regions that has the largest distance to the second region as the target sub-region. ### Claim 19 (depends on 15) The non-transitory computer-readable storage medium according to claim 15, wherein the determining, within the target sub-region, an implantation location of the recommendation information in the target video frame comprises: multiplying a region area of the target sub-region by a preset multiple as a target area of the recommendation information displayed in the target video frame; determining a target region corresponding to the recommendation information in the target video frame according to the target area and a display shape of the recommendation information; and using a location at which the target region covers the target sub-region as the implantation location of the recommendation information in the target video frame. ### Claim 20 (depends on 15) The non-transitory computer-readable storage medium according to claim 15, wherein the region of the target video frame comprises at least two candidate sub-regions corresponding to a target type, and the determining a target sub-region including the target video frame from the region of the target video frame comprises: identifying a candidate sub-region with a largest area corresponding to one of the at least two candidate sub-regions as the target sub-region.