# US 2019/0174242 A1 · Electronic device and music visualization method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0174242 A1 - Document ID: US20190174242A1 - Status: Published application - Kind: A1 - Application number: 16/268,556 - Filed: 2019-02-06 - Published: 2019-06-06 - Earliest claimed: 2015-10-07 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Jang-ho JIN; Myung-jae KIM; Ji-hun PARK; Young-jun RYU - Web page: https://patentgrep.com/patent/US20190174242A1 ## CPC - G10H 1/368: {displaying animated or moving pictures synchronized with the music or audio part} - H04R 29/008: {Visual indication of individual signal levels (visual indication of stereophonic sound image H04S7/40)} - A63J 17/00: Apparatus for performing colour-music - G06F 16/4393: {Multimedia presentations, e.g. slide shows, multimedia albums} - G06T 13/205: {driven by audio data} - G06T 13/80: Two-dimensional [2D] animation, e.g. using sprites - G10H 1/00: Details of electrophonic musical instruments - H05B 47/155: Coordinated control of two or more light sources - H05B 47/165: following a pre-assigned programmed sequence; Logic control [LC] - G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G10H 1/0025: {Automatic or semi-automatic music composition, e.g. producing random music, applying rules from music theory or modifying a musical piece (automatically producing a series of tones G10H1/26)} - G10H 1/40: Rhythm - G10H 2210/076: for extraction of timing, tempo; Beat detection - G10H 2220/005: Non-interactive screen display of musical or status data - G10H 2220/021: Indicator, i.e. non-screen output user interfacing, e.g. visual or tactile instrument status or guidance information using lights, LEDs or seven segments displays - G10H 2220/081: Beat indicator, e.g. marks or flashing LEDs to indicate tempo or beat positions - G10H 2240/085: Mood, i.e. generation, detection or selection of a particular emotional content or atmosphere in a musical piece - H05B 45/20: Controlling the colour of the light - H05B 47/12: by detecting audible sound - G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) - A63J: DEVICES FOR THEATRES, CIRCUSES, OR THE LIKE; CONJURING APPLIANCES OR THE LIKE - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H05B: ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL ## Abstract An electronic device and a method for controlling the electronic device, the method including receiving an input of a command to reproduce music contents, determining audio characteristics information on the music contents and situation information on an environment where the music contents are being reproduced; and displaying a visualization effect of visualizing the music contents using the audio characteristics information and the situation information, and reproducing the music contents. ## Claims ### Claim 1 An electronic device, comprising: an input unit; an output unit; a display; a communicator; and a processor configured to: based on a user command for playing a content being received through the input unit, control the output unit to output a processed content, control the display to display a first screen corresponding to information of the content, and based on situation information being at least one of received through the communicator and included in the content, control the display to display a second screen corresponding to the information of the content and the situation information. ### Claim 2 (depends on 1) The electronic device according to claim 1, wherein the content is music contents, and wherein the processor is further configured to: based on the command to reproduce the music contents input through the input unit, determine audio characteristics information of the music contents and situation information of an environment where the music contents are being reproduced, determine a visualization effect corresponding to the audio characteristics information, change the visualization effect based on the situation information, and control the display to display a changed visualization effect as the visualization effect of visualizing the music contents, and control the output unit to reproduce the music contents. ### Claim 3 (depends on 2) The electronic device according to claim 2, wherein the visualization effect corresponding to the audio characteristics information is an image effect where a basic image of a theme changes according to the audio characteristics information, and the processor changes at least one of a basic image, a background, a color, a brightness, a chroma, a speed of change and a range of change of an image effect corresponding to the audio characteristics information based on the situation information. ### Claim 4 (depends on 2) The electronic device according to claim 2, wherein the display comprises at least one LED (Light Emitting Diode) lamp, the visualization effect corresponding to the audio characteristics information is a visual effect where light emission of the at least one LED lamp changes according to the audio characteristics information, and the processor changes at least one of a color, a brightness, a chroma, a contrast, a speed of change and a range of change of the visualization effect corresponding to the audio characteristics information based on the situation information. ### Claim 5 (depends on 2) The electronic device according to claim 2, wherein the audio characteristics information comprises at least one of beat information, mood information and highlight information of the music contents, and the situation information comprises at least one of weather information, date information, time information, information on a brightness of an area surrounding the electronic device and information on attributes of a reproducing list. ### Claim 6 (depends on 2) The electronic device according to claim 2, wherein the processor controls the display to display the visualization effect of visualizing the music contents using only the audio characteristics information in a simple visualization mode, and to display the visualization effect of visualizing the music contents using the audio characteristics information and the situation information in a smart visualization mode, of the simple visualization mode of using only the audio characteristics information and the smart visualization mode of using the audio characteristics information and the situation information. ### Claim 7 (depends on 2) The electronic device according to claim 2, wherein the processor determines the visualization effect set through a simple visualization setting UI (user interface) for setting the visualization effect corresponding to the audio characteristics information as the visualization effect corresponding to the audio characteristics information, and changes the visualization effect corresponding to the audio characteristics information using the situation information selected through a smart visualization setting UI for selecting the situation information to be used to change the visualization effect corresponding to the audio characteristics information. ### Claim 8 (depends on 7) The electronic device according to claim 7, wherein the communicator is configured to communicate with an external device, and the processor controls the display to, when information on the visualization effect set through the simple visualization setting UI and information on the situation information selected through the smart visualization setting UI are received from the external device, display the visualization effect of visualizing the music contents using the received information. ### Claim 9 (depends on 2) The electronic device according to claim 2, wherein the processor determines in real time the situation information while the music contents are being reproduced, and reflects the situation information determined in real time to change the visualization effect corresponding to the audio characteristics information. ### Claim 10 (depends on 2) The electronic device according to claim 2, wherein the processor determines the situation information at a time point when the command to reproduce the music contents is input, selects a visualization effect changing method corresponding to the situation information at the time point the command to reproduce the music contents is input from a prestored table where the visualization effect changing method according to the situation information is matched, and applies the selected visualization effect changing method to the determined visualization effect. ### Claim 11 A music contents visualization method of an electronic device, the method comprising: based on a user command for playing a content being received through an input unit, controlling an output unit to output a processed content, controlling a display to display a first screen corresponding to information of the content, and based on situation information being at least one of received through a communicator and included in the content, controlling the display to display a second screen corresponding to the information of the content and the situation information. ### Claim 12 (depends on 11) The method according to claim 11, wherein the content is music contents, and wherein the method further comprises: based on the command to reproduce the music contents input through the input unit, determining audio characteristics information of the music contents and situation information of an environment where the music contents are being reproduced, determining the visualization effect corresponding to the audio characteristics information; changing the visualization effect to produce a determined visualization effect based on the situation information; displaying a changed visualization effect as the visualization effect of visualizing the music contents, and reproducing the music contents. ### Claim 13 (depends on 12) The method according to claim 12, wherein the visualization effect corresponding to the audio characteristics information is an image effect where a basic image of a theme changes according to the audio characteristics information, and the changing of the determined visualization effect based on the situation information changes at least one of the basic image, a background, a color, a brightness, a chroma, a speed of change and a range of change of the visualization effect corresponding to the audio characteristics information based on the situation information. ### Claim 14 (depends on 12) The method according to claim 12, wherein the visualization effect corresponding to the audio characteristics information is a visual effect where light emission of at least one LED (Light Emitting Diode) lamp changes according to the audio characteristics information, and the changing of the determined visualization effect based on the situation information changes at least one of a color, a brightness, a chroma, a contrast, a speed of change and a range of change of the visualization effect corresponding to the audio characteristics information based on the situation information. ### Claim 15 (depends on 12) The method according to claim 12, wherein the audio characteristics information comprises at least one of beat information, mood information and highlight information of the music contents, and the situation information comprises at least one of weather information, date information, time information, information on a brightness of an area surrounding the electronic device and information on attributes of a reproducing list. ### Claim 16 (depends on 12) The method according to claim 12, further comprising displaying a mode selecting UI (user interface) for selecting one of a simple visualization mode where the simple visualization mode uses only the audio characteristics information and a smart visualization mode where the smart visualization mode uses the audio characteristics information and the situation information, wherein when the simple visualization mode is selected from the mode selecting UI, the visualization effect of visualizing the music contents using only the audio characteristics information is displayed, and when the smart visualization mode is selected, the visualization effect of visualizing the music contents using the audio characteristics information and the situation information is displayed. ### Claim 17 (depends on 12) The method according to claim 12, further comprising determining the visualization effect set through a simple visualization setting UI (user interface) for setting the visualization effect corresponding to the audio characteristics information as the visualization effect corresponding to the audio characteristics information; and changing the visualization effect corresponding to the audio characteristics information using the situation information selected through a smart visualization setting UI for selecting the situation information being used to change the visualization effect corresponding to the audio characteristics information. ### Claim 18 (depends on 17) The method according to claim 17, further comprising receiving information on the visualization effect set through the simple visualization setting UI and information on the situation information selected through the smart visualization setting UI from an external device. ### Claim 19 (depends on 12) The method according to claim 12, wherein the determining the situation information determines the situation information in real time while the music contents are being reproduced, and the changing of the visualization effect reflects the situation information determined in real time to change the visualization effect corresponding to the audio characteristics information. ### Claim 20 A non-transitory computer readable recording medium storing a program that is executable by a computer to perform a method of an electronic device authenticating a user, the method comprising: based on a user command for playing a content being received through an input unit, controlling an output unit to output a processed content, controlling a display to display a first screen corresponding to information of the content, and based on situation information being at least one of received through a communicator and included in the content, controlling the display to display a second screen corresponding to the information of the content and the situation information.