# US 2021/0243243 A1 · Method and system for utilizing network conditions feedback for improving quality of a collaborative media production > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0243243 A1 - Document ID: US20210243243A1 - Status: Published application - Kind: A1 - Application number: 17/269,794 - Filed: 2019-07-26 - Published: 2021-08-05 - Earliest claimed: 2018-08-20 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Rickard LJUNG; Daniel LONNBLAD; Peter ISBERG - Web page: https://patentgrep.com/patent/US20210243243A1 ## CPC - H04L 65/764: {at the destination (reformatting of additional data in video clients H04N21/4355)} - H04L 65/765: {intermediate} - H04L 65/80: Responding to QoS - H04N 21/2187: Live feed - H04N 21/23439: {for generating different versions} - H04N 21/2662: Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities - H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)} - H04N 21/64723: {Monitoring of network processes or resources, e.g. monitoring of network load (traffic related reporting in data switching networks H04L43/062)} - H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments} - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract The media production element combines media content from a plurality of streaming electronic devices when they are registered to be within the same streaming event. The media production element can produce a combined live video stream or a combined media production using selections and combinations of the streamed content provided by the multiple electronic devices. A network assistance device can provide feedback to the media production element regarding network conditions for the electronic devices that are registered to an event. Such feedback can prevent bad network connections from affecting the final media production by helping the media production element to decide which data stream to use in the production and when to switch from an electronic device that can be on its way to losing optimum radio conditions. ## Claims ### Claim 1 A method of providing event-coordinated uplink network assistance by a network assistance service to a plurality of electronic devices, comprising: obtaining, by the network assistance service provided by a network assistance device, data regarding a plurality of uplink data sessions that have been registered to an event, each uplink data session being between a respective electronic device of the plurality of electronic devices and a media production service provided by a media production element, the event being a live situation from which the plurality of electronic devices simultaneously produce and transmit uplink media streams to the media production service in the respective uplink data sessions, allowing the media production service to create a combined media production using selections and combinations of content from the uplink media streams provided by the plurality of electronic devices; collecting, by the network assistance service, connection status information about radio conditions of one or more of the uplink media streams of the plurality of data streams during the event; determining, by the network assistance service, network condition information from the connection status information, wherein the network condition information is regarding network conditions for the plurality of electronic devices; and transmitting, by the network assistance service, network condition information to the media production service to help the media production service decide which uplink media streams to use in the combined media production. ### Claim 2 (depends on 1) The method of claim 1, wherein the network assistance service is hosted by a DASH-aware network element (DANE). ### Claim 3 (depends on 1) The method of claim 1, wherein the network assistance service is hosted by a framework for live uplink streaming (FLUS). ### Claim 4 (depends on 1) The method of claim 1, wherein the connection status information comprises one or more link parameters including at least one of a received signal strength, a radio condition variation parameter, a data load for a present cell, or an indication of a switching between cells. ### Claim 5 (depends on 1) The method of claim 1, wherein the connection status information comprises one or more application parameters including at least one of an aggregated media rate for the event, an aggregated data rate for the event, a media rate for an individual electronic device of the plurality of electronic devices, or a data rate for the individual electronic device of the plurality of electronic devices. ### Claim 6 (depends on 1) The method of claim 1, wherein determining the network conditions information comprises comparing the connection status information to a network conditions requirement parameter. ### Claim 7 (depends on 1) The method of claim 1, further comprising: determining future expected connection status information; and wherein determining the network conditions information includes comparing the future expected connection status information to a network conditions requirement parameter. ### Claim 8 (depends on 1) The method of claim 1, wherein the network condition information is transmitted to the media production service at a predetermined periodicity. ### Claim 9 (depends on 1) The method of claim 1, wherein the network condition information is transmitted to the media production service based on a triggering event. ### Claim 10 (depends on 1) The method of claim 1, wherein the network condition information comprises a packet loss rate. ### Claim 11 (depends on 1) The method of claim 1, wherein the network condition information comprises raw radio condition parameters. ### Claim 12 (depends on 1) The method of claim 1, wherein determining the network condition information comprises calculating a weighted quality of service value from the connection status information. ### Claim 13 (depends on 1) The method of claim 1, wherein determining the network condition information comprises using a mean opinion score prediction model to determine a predicted quality of experience value. ### Claim 14 (depends on 1) The method of claim 1, wherein the network assistance service is implemented in or connected to a base station. ### Claim 15 (canceled) ### Claim 16 A method of producing a combined media production, comprising: receiving, by a media production service provided by a media production element, a plurality of uplink data streams, each uplink data stream from a respective electronic device that is registered to an event, the event being a live situation from which the electronic devices simultaneously produce and transmit the uplink data streams to the media production service in respective uplink data sessions; receiving, by the media production service, network condition information for the plurality of uplink data streams from a network assistance service; and selecting, by the media production service, a first uplink data stream from the plurality of uplink data streams, based at least partially on the network condition information, to include in the combined media production during a first time segment. ### Claim 17 (depends on 16) The method of claim 16, wherein the electronic devices comprises a first electronic device that communicates through a first operator network and is associated with a first network assistance service, and a second electronic device that communicates through a second operator network and is associated with a second network assistance service. ### Claim 18 (depends on 17) The method of claim 17, wherein the network condition information is received from the first network assistance service and the second network assistance service. ### Claim 19 (depends on 16) The method of claim 16, further comprising: determining, by the media production service, based on the network condition information, that the first uplink data stream has, or will have, a quality of service value less than a threshold quality of service value; and selecting, by the media production service, based on determining that the first uplink data stream has, or will have, a quality of service value less than the threshold quality of service value, a second uplink data stream from the plurality of uplink data streams to include in the combined media production during a second time segment following the first time segment. ### Claim 20 (depends on 16) The method of claim 16, further comprising: determining, by the media production service, based on the network condition information, that communications from a first electronic device corresponding with the first uplink data stream are, or will soon be, throttled; and selecting, by the media production service, based on determining that communications from the first electronic device corresponding with the first uplink data stream are, or will soon be, throttled, a second uplink data stream from the plurality of uplink data streams to include in the combined media production during a second time segment following the first time segment. ### Claim 21 (canceled) ### Claim 22 (canceled) ### Claim 23 (canceled) ### Claim 24 A network element that hosts a network assistance service, comprising a network interface and a control circuit configured to: obtain data regarding a plurality of uplink data sessions that have been registered to an event, each uplink data session being between a respective electronic device of the plurality of electronic devices and a media production service provided by a media production element, the event being a live situation from which the plurality of electronic devices simultaneously produce and transmit uplink media streams to the media production service in the respective uplink data sessions, allowing the media production service to create a combined media production using selections and combinations of content from the uplink media streams provided by the plurality of electronic devices; collect connection status information about radio conditions of one or more of the uplink media streams of the plurality of data streams during the event; determine network condition information from the connection status information, wherein the network condition information is regarding network conditions for the plurality of electronic devices; and transmit network condition information to the media production service to help the media production service decide which uplink media streams to use in the combined media production.