# US 12,604,053 B1 · Method for outputting media content in live interaction, electronic device, and program product > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,604,053 B1 - Document ID: US12604053B1 - Status: Granted - Kind: B1 - Application number: 19/419,211 - Filed: 2025-12-15 - Granted: 2026-04-14 - Earliest claimed: 2025-12-15 - Assignees: Uc Global Trade Inc. - Applicants: Uc Global Trade Inc. - Inventors: Junjun Chen - Web page: https://patentgrep.com/patent/US12604053B1 ## CPC - H04N 21/266: Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel - G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)} - G06V 40/174: {Facial expression recognition} - G06V 40/176: {Dynamic expression} - G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) - G10L 15/25: using position of the lips, movement of the lips or face analysis - G10L 25/63: for estimating an emotional state - H04N 21/2187: Live feed - H04N 21/233: Processing of audio elementary streams {(monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/234336: {by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text} - H04N 21/251: {Learning process for intelligent management, e.g. learning user preferences for recommending movies (details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08)} - H04N 21/25891: {being end-user preferences (retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)} - H04N 21/42203: {sound input device, e.g. microphone} - H04N 21/4223: Cameras (H04N23/00 takes precedence) - H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/44213: {Monitoring of end-user related data (arrangements for monitoring the users' behaviour or opinions in broadcast systems H04H60/33)} - H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)} - H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)} - H04N 21/6582: {Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number (arrangements where receivers interact with the broadcast H04H20/38)} - H04N 21/8146: {involving graphical data, e.g. 3D object, 2D graphics} - H04N 21/816: {involving special video data, e.g 3D video} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract The present application relates to the field of multimedia technologies, and proposes a method for outputting media content in live interaction, an electronic device, and a computer program product. The method includes: in a process in which a streamer performs live streaming by using a target product, obtaining live streaming feature information used to determine media content to be output; determining target media content based on the live streaming feature information; and outputting the target media content. In this method, when watching live streams, a viewer not only obtains regular live streaming information of the streamer, but also can receive additional target media content. With the target media content, the viewer can more intuitively perceive experience of using the target product by the streamer, thereby significantly improving the sense of novelty and immersion of the viewer while watching live streams, to improve viewership of live streams and boost product sales. ## Claims ### Claim 1 A method for outputting media content in live interaction, comprising: in a process in which a streamer performs live streaming by using a target product, obtaining live streaming feature information used to determine media content to be output; determining target media content based on the live streaming feature information; synthesizing the target media content based on the live streaming feature information in a preset media content synthesis manner; obtaining interaction data between the viewer and the streamer, wherein the interaction data comprises tipping information; determining a quantity of participants corresponding to the interaction data, wherein the quantity of participants comprises a quantity of viewers who tip; determining a corresponding weight allocation of the interaction data based on the quantity of participants; controlling the target product based on the interaction data and the weight allocation of the interaction data; and outputting the target media content; wherein after the outputting the target media content determining a trend of change in tipping information from a viewer toward the streamer; adjusting the media content synthesis manner based on the trend of change. ### Claim 2 (depends on 1) The method according to claim 1, wherein the obtaining live streaming feature information used to determine media content to be output comprises: obtaining a real-time facial image of the streamer; recognizing a facial expression feature of the streamer based on the real-time facial image; and determining the facial expression feature as the live streaming feature information. ### Claim 3 (depends on 1) The method according to claim 1, wherein the obtaining live streaming feature information used to determine media content to be output comprises: obtaining a real-time voice signal of the streamer; recognizing an audio emotion feature of the streamer based on the real-time voice signal; and determining the audio emotion feature as the live streaming feature information. ### Claim 4 (depends on 1) The method according to claim 1, wherein the obtaining live streaming feature information used to determine media content to be output comprises: detecting an operation action of the streamer; recognizing a trigger command and/or an emotion cue of the streamer based on the operation action; and determining the trigger command and/or the emotion cue as the live streaming feature information. ### Claim 5 (depends on 1) The method according to claim 1, wherein the obtaining live streaming feature information used to determine media content to be output comprises: obtaining a physiological status signal of the streamer; recognizing an emotional state of the streamer based on the physiological status signal; and determining the emotional state as the live streaming feature information. ### Claim 6 (depends on 1) The method according to claim 1, wherein the obtaining live streaming feature information used to determine media content to be output comprises: obtaining text content involved in the live streaming process; determining a text emotion feature based on the text content; and determining the text emotion feature as the live streaming feature information. ### Claim 7 (depends on 1) The method according to claim 1, wherein the obtaining live streaming feature information used to determine media content to be output comprises: obtaining a real-time lip-shape image of the streamer; performing visual speech recognition on the real-time lip-shape image to determine an intended-to-speak text of the streamer; and determining the intended-to-speak text as the live streaming feature information. ### Claim 8 (depends on 1) The method according to claim 1, wherein the obtaining live streaming feature information used to determine media content to be output comprises: obtaining real-time feedback information provided by a viewer for the streamer; and determining the real-time feedback information as the live streaming feature information. ### Claim 9 (depends on 1) The method according to claim 1, wherein the obtaining live streaming feature information used to determine media content to be output comprises: obtaining a modality signal of the streamer, wherein the modality signal comprises at least one of a real-time facial image, a real-time voice signal, a text input signal, or a gesture signal; and determining the modality signal as the live streaming feature information. ### Claim 10 (depends on 1) The method according to claim 1, wherein the obtaining live streaming feature information used to determine media content to be output comprises: recognizing environment feature information of an environment in which the streamer is located; and determining the environment feature information as the live streaming feature information. ### Claim 11 (depends on 1) The method according to claim 1, wherein the synthesizing the target media content based on the live streaming feature information in a preset media content synthesis manner comprises: synthesizing target voice as the target media content based on the live streaming feature information in a preset voice synthesis manner; or synthesizing target music as the target media content based on the live streaming feature information in a preset music synthesis manner; or synthesizing a target animation as the target media content based on the live streaming feature information in a preset animation synthesis manner; or synthesizing a target image as the target media content based on the live streaming feature information in a preset image synthesis manner. ### Claim 12 (depends on 1) The method according to claim 1, wherein the determining target media content based on the live streaming feature information comprises: searching a pre-created media content library for at least one media content associated with the live streaming feature information; and determining the at least one media content as the target media content. ### Claim 13 (depends on 1) The method according to claim 1, wherein the outputting the target media content comprises: outputting the target media content in the live streaming process; or outputting the target media content after the live streaming process ends or after a delay time period confirmed by the streamer. ### Claim 14 (depends on 1) The method according to claim 1, wherein the method further comprises: obtaining the tipping information from the viewer toward the streamer; generating a target control parameter of the target product based on the tipping information; and controlling the target product based on the target control parameter. ### Claim 15 (depends on 14) The method according to claim 14, wherein the tipping information comprises a tipping amount, and the generating a target control parameter of the target product based on the tipping information comprises: determining a target amount tier in which the tipping amount falls; and searching, based on a preset mapping relationship, for a control parameter corresponding to the target amount tier as the target control parameter, wherein the preset mapping relationship records a control parameter corresponding to each amount tier. ### Claim 16 (depends on 1) An electronic device, comprising a memory, a processor, and a computer program stored in the memory and capable of running on the processor, wherein when the processor executes the computer program, the method for outputting media content in live interaction according to claim 1 is implemented. ### Claim 17 (depends on 1) A non-transitory computer readable medium storing a computer program product, wherein when the computer program product runs on an electronic device, the electronic device is enabled to perform the method for outputting media content in live interaction according to claim 1.