# US 2021/0344974 A1 · Electronic device and control method therefor > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0344974 A1 - Document ID: US20210344974A1 - Status: Published application - Kind: A1 - Application number: 17/286,324 - Filed: 2019-11-26 - Published: 2021-11-04 - Earliest claimed: 2018-11-28 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Yeonguk YU - Web page: https://patentgrep.com/patent/US20210344974A1 ## CPC - H04N 21/233: Processing of audio elementary streams {(monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04N 21/4884: {for displaying subtitles} - H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04N 21/440236: {by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text} - H04N 21/42203: {sound input device, e.g. microphone} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An electronic device is disclosed. The present electronic device comprises a display, a speaker, an input unit, and a processor for controlling the display so that an image signal inputted through the input unit is displayed, controlling the speaker so that an audio signal synchronized with the displayed image signal is outputted, and controlling the display so that caption information corresponding to the audio signal outputted during a preset previous time is displayed on the basis of the point of time when a user command is inputted. ## Claims ### Claim 1 An electronic device comprising: a display; a speaker; an inputter; and a processor configured to: control the display to display an image signal inputted through the inputter, control the speaker to output an audio signal synchronized with the displayed image signal, and based on a user command being input, control the display to display caption information corresponding to the audio signal outputted during a preset previous time based on a point of time of inputting the user command. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein the processor is further configured to: identify a voice signal from an audio signal outputted during the preset previous time, obtain a text corresponding to the voice signal, and control the display to display the caption information based on the obtained text. ### Claim 3 (depends on 2) The electronic device of claim 2, wherein the processor is further configured to identify a voice signal corresponding to the additional information from the audio signal based on the additional information included in the user command. ### Claim 4 (depends on 1) The electronic device of claim 1, wherein the processor is further configured to, while the image signal inputted through the inputter is displayed, control the display to display caption information corresponding to the audio signal outputted during the preset previous time. ### Claim 5 (depends on 4) The electronic device of claim 4, wherein the processor is further configured to control the display to display the image signal displayed during the preset previous time on a partial region of the display along with the caption information. ### Claim 6 (depends on 5) The electronic device of claim 5, wherein the processor is further configured to, based on the partial region of the display being selected according to a user command, adjust an output volume of an audio signal corresponding to the image signal inputted through the inputter. ### Claim 7 (depends on 6) The electronic device of claim 6, wherein the processor is further configured to, based on a partial region of the display being selected according to a user command, control not to output the audio signal corresponding to the image signal inputted through the inputter and control to output the audio signal corresponding to the image signal displayed on the partial region of the display. ### Claim 8 (depends on 1) The electronic device of claim 1, further comprising: a memory; wherein the processor is further configured to store the audio signal inputted through the inputter in the memory, and delete, from the memory, the audio signal inputted prior to the preset time with respect to a current point of time, among the stored audio signals. ### Claim 9 (depends on 1) The electronic device of claim 1, further comprising: a microphone; and a memory, wherein the processor is further configured to: while the audio signal is outputted through the speaker, control the microphone to perform recording, store a signal recorded through the microphone in the memory, obtain a signal recorded during the preset previous time based on a point of time of inputting the user command, among the recorded signals stored in the memory, and control the display to display the caption information based on the obtained signal. ### Claim 10 (depends on 1) The electronic device of claim 1, wherein the processor is further configured to, based on receiving a user voice command, identify whether the user voice command is the user command to display the caption information. ### Claim 11 A method of controlling an electronic device, the method comprising: displaying an image signal inputted through an inputter; outputting an audio signal synchronized with the displayed image signal; and based on a user command being input, displaying caption information corresponding to the audio signal outputted during a preset previous time based on a point of time of inputting the user command. ### Claim 12 (depends on 11) The method of claim 11, wherein the displaying the caption information comprises identifying a voice signal from an audio signal outputted during the preset previous time, obtaining a text corresponding to the voice signal, and displaying the caption information based on the obtained text. ### Claim 13 (depends on 12) The method of claim 12, wherein the method further comprises identifying a voice signal corresponding to the additional information from the audio signal based on the additional information included in the user command. ### Claim 14 (depends on 11) The method of claim 11, wherein the displaying the caption information comprises, while the image signal inputted through the inputter is displayed, displaying caption information corresponding to the audio signal outputted during the preset previous time. ### Claim 15 (depends on 14) The method of claim 14, wherein the displaying the caption information comprises displaying the image signal displayed during the preset previous time on a partial region of the display along with the caption information.