# US 2019/0320114 A1 · Display apparatus and recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0320114 A1
- Document ID: US20190320114A1
- Status: Published application
- Kind: A1
- Application number: 16/317,424
- Filed: 2017-05-22
- Published: 2019-10-17
- Earliest claimed: 2016-07-11
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Sang-moon LEE; Sang-chul KO; Byeong-geun CHEON
- Web page: https://patentgrep.com/patent/US20190320114A1

## CPC

- H04N 5/445: for displaying additional information (H04N5/50 takes precedence)
- H04N 5/607: {for more than one sound signal, e.g. stereo, multilanguages (H04N5/602 takes precedence)}
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 5/60: for the sound signals
- H04N 9/802: involving processing of the sound signal (H04N9/806, H04N9/835 take precedence)
- H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)}
- H04N 21/4318: {by altering the content in the rendering process, e.g. blanking, blurring or masking an image region (image enhancement or restoration in general G06T5/00)}
- H04N 21/47205: {for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally}
- H04N 21/8106: {involving special audio data, e.g. different tracks for different languages}
- H04N 21/816: {involving special video data, e.g 3D video}
- H04N 21/845: Structuring of content, e.g. decomposing content into time segments
- H04S 1/00: Two-channel systems (H04S5/00, H04S7/00 take precedence)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04S: STEREOPHONIC SYSTEMS

## Abstract

A display apparatus including: a display; a loudspeaker; a user input unit; a video processor configured to process a video signal to be displayed as an image on the display, and change a viewpoint of the image displayed on the display in response to a user input made through the user input unit; and an audio processor configured to process an audio signal to be output as a sound from the loudspeaker, determine acoustic features of the audio signal, and adjust the output of the sound from the loudspeaker according to the acoustic features in response to the user input.

## Claims

### Claim 1

A display apparatus comprising:
a display;
a loudspeaker;
a user input unit;
a video processor configured to process a video signal to be displayed as an image on the display, and change a viewpoint of the image displayed on the display in response to a user input made through the user input unit; and
an audio processor configured to process an audio signal to be output as a sound from the loudspeaker, determine acoustic features of the audio signal, and adjust the output of the sound from the loudspeaker according to the acoustic features in response to the user input.

### Claim 2 (depends on 1)

The display apparatus according to claim 1, wherein the audio processor determines the acoustic features by determining whether the audio signal is generated by live recording.

### Claim 3 (depends on 2)

The display apparatus according to claim 2, wherein the audio processor derives a first component corresponding to an audio component of a center channel from the audio signal, and a second component corresponding to an audio component obtained by subtracting the first component from either of a left channel or a right channel, and determines that the audio signal is generated by the live recording when a power ratio between the first component and the second component is greater than a preset threshold value.

### Claim 4 (depends on 2)

The display apparatus according to claim 2, wherein the audio processor determines that the audio signal is generated by the live recording when similarity between an audio component of a left channel and an audio component of a right channel is lower than a preset level in the audio signal.

### Claim 5 (depends on 1)

The display apparatus according to claim 1, wherein the audio processor does not adjust the output of the sound from the loudspeaker regardless of the user input, when it is determined that the audio signal is generated by post-process recording.

### Claim 6 (depends on 1)

The display apparatus according to claim 1, wherein the video signal comprises a wide-angle image captured by a wide-angle camera, and
the video processor processes a partial area of the wide-angle image to be displayed as the image on the display.

### Claim 7 (depends on 6)

The display apparatus according to claim 6, wherein the video processor processes the wide-angle image to be panned in response to the user input made to move a viewpoint of the user and displayed on the display, and
the audio processor determines change in position of a sound source due to the panning, and adjusts the output of the sound by controlling output power of audio components according to channels of the sound source in the audio signal corresponding to the changed position of the sound source.

### Claim 8 (depends on 7)

The display apparatus according to claim 7, wherein the user input comprises information about an angle between a default user viewpoint to the image and the moved user viewpoint.

### Claim 9 (depends on 6)

The display apparatus according to claim 6, wherein the video processor processes the image to be zoomed in or out in response to the user input made to change a zoom depth of the image and displayed on the display, and
the audio processor determines change in distance of a sound source within the changed image with respect to a user, and adjusts the output of the sound by increasing and decreasing output power of an audio component of the sound source in the audio signal corresponding to the changed distance of the sound source.

### Claim 10 (depends on 1)

The display apparatus according to claim 1, wherein the audio processor acquires view information provided along with the audio signal from a content provider, and adjusts the output of the sound from the loudspeaker in accordance with the acoustic features corresponding to the view information.

### Claim 11

A recording medium, in which a program code of a method implementable and processible by a processor of a display apparatus comprising a display and a loudspeaker,
the method comprising:
displaying an image on the display;
outputting a sound from the loudspeaker;
changing a viewpoint of the image displayed on the display in response to a user input;
determining acoustic features of an audio signal, and adjusting the output of the sound from the loudspeaker according to the acoustic features in response to the user input.

### Claim 12 (depends on 11)

The recording medium according to claim 11, wherein the adjusting of the output of the sound from the loudspeaker comprises determining the acoustic features by determining whether the audio signal is generated by live recording.

### Claim 13 (depends on 12)

The recording medium according to claim 12, wherein the determining of the acoustic features comprises:
deriving a first component corresponding to an audio component of a center channel from the audio signal, and a second component corresponding to an audio component obtained by subtracting the first component from either of a left channel or a right channel; and
determining that the audio signal is generated by the live recording when a power ratio between the first component and the second component is greater than a preset threshold value.

### Claim 14 (depends on 12)

The recording medium according to claim 12, wherein the determining of the acoustic features comprises:
determining that the audio signal is generated by the live recording when similarity between an audio component of a left channel and an audio component of a right channel is lower than a preset level in the audio signal.

### Claim 15 (depends on 11)

The recording medium according to claim 11, wherein the adjusting of the output of the sound from the loudspeaker comprises preventing the output of the sound from the loudspeaker from being adjusted regardless of the user input, when it is determined that the audio signal is generated by post-process recording.
