# US 11,310,616 B2 · Method for outputting audio signal using scene orientation information in an audio decoder, and apparatus for outputting audio signal using the same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,310,616 B2 - Document ID: US11310616B2 - Status: Granted - Kind: B2 - Application number: 16/738,522 - Filed: 2020-01-09 - Published: 2020-05-14 - Granted: 2022-04-19 - Earliest claimed: 2017-03-31 - Assignees: LG Electronics Inc. - Applicants: LG Electronics Inc. - Inventors: Tung Chin Lee; Sejin Oh - Web page: https://patentgrep.com/patent/US11310616B2 ## CPC - H04S 7/30: {Control circuits for electronic adaptation of the sound field} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - H04N 21/439: Processing of audio elementary streams - H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)} - H04N 21/4852: {for modifying audio parameters, e.g. switching between mono and stereo} - H04N 21/8106: {involving special audio data, e.g. different tracks for different languages} - H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)} - H04N 21/85406: {involving a specific file format, e.g. MP4 format} - H04S 3/004: {For headphones} - H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)} - H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved - H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) - H04S 2420/03: Application of parametric coding in stereophonic audio systems - H04S: STEREOPHONIC SYSTEMS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method for decoding a bitstream by an apparatus, includes obtaining a decoded audio signal and metadata from the bitstream, the metadata comprising scene orientation information; and rendering the decoded audio signal based on the scene orientation information, wherein the scene orientation information is information for a direction of a video scene related to the decoded audio signal. ## Claims ### Claim 1 A method for decoding a bitstream by an apparatus, the method comprising: obtaining an audio signal and metadata from the bitstream, the metadata comprising object metadata and information for indicating whether scene orientation information is present in the bitstream; receiving external control information including environmental setup information and element interaction information; modifying the object metadata based on the external control information; rendering the audio signal based on the modified object metadata; and rendering the rendered audio signal based on the scene orientation information, wherein the scene orientation information is information for an orientation of a video scene related to the audio signal, wherein the environmental setup information includes rendering type information for selecting one of a loudspeaker rendering and a binaural rendering and setup information indicating whether another output device is to be connected, and wherein the element interaction information includes interaction signature information, zoom area information, and user interaction mode information. ### Claim 2 (depends on 1) The method of claim 1, wherein the scene orientation information comprises yaw information for an angle of the orientation of the video scene in a z-axis, pitch information for an angle of the orientation of the video scene in an x-axis, and roll information for an angle of the orientation of the video scene in a y-axis. ### Claim 3 (depends on 1) The method of claim 1, wherein the external control information further comprises information for a number of speakers and information for positions of the speakers. ### Claim 4 (depends on 1) The method of claim 1, wherein modifying the object metadata includes modifying a position and a gain of an audio object according to the external control information. ### Claim 5 (depends on 1) The method of claim 1, further comprising: performing binaural rendering on the rendered audio signal based on a Binaural Room Impulse Response (BRIR) to output the rendered audio signal as a 2-channel surround audio signal. ### Claim 6 An apparatus for decoding a bitstream, the apparatus comprising: an audio decoder configured to obtain an audio signal and metadata from the bitstream, the metadata comprising object metadata and information for indicating whether scene orientation information is present in the bitstream; and a renderer configured to receive external control information including environmental setup information and element interaction information, modify the object metadata based on the external control information, render the audio signal based on the modified object metadata, and render the rendered audio signal based on the scene orientation information, wherein the scene orientation information is information for an orientation of a video scene related to the audio signal, wherein the environmental setup information includes rendering type information for selecting one of a loudspeaker rendering and a binaural rendering and setup information indicating whether another output device is to be connected, and wherein the element interaction information includes interaction signature information, zoom area information, and user interaction mode information. ### Claim 7 (depends on 6) The apparatus of claim 6, wherein the scene orientation information comprises yaw information for an angle of the orientation of the video scene in a z-axis, pitch information for an angle of the orientation of the video scene in an x-axis, and roll information for an angle of the orientation of the video scene in a y-axis. ### Claim 8 (depends on 6) The apparatus of claim 6, wherein the external control information further comprises information for a number of speakers and information for positions of the speakers. ### Claim 9 (depends on 6) The apparatus of claim 6, wherein the renderer modifies a position and a gain of an audio object according to the external control information. ### Claim 10 (depends on 6) The apparatus of claim 6, further comprising: a binaural renderer configured to perform binaural rendering on the rendered audio signal based on a Binaural Room Impulse Response (BRIR) to output the rendered audio signal as a 2-channel surround audio signal.