# US 8,543,918 B2 · Media system with integrated clip views > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,543,918 B2 - Document ID: US8543918B2 - Status: Granted - Kind: B2 - Application number: 12/888,797 - Filed: 2010-09-23 - Published: 2011-01-20 - Granted: 2013-09-24 - Earliest claimed: 2006-09-20 - Assignees: Adobe Systems Incorporated - Applicants: Vlad Margulis - Inventors: Vlad Margulis - Web page: https://patentgrep.com/patent/US8543918B2 ## CPC - G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) ## Abstract Systems and methods for presenting audio data involve obtaining audio data that includes audio clips, and presenting the audio data for a first audio clip in a user interface having an audio play element configured to play audio from the audio data, a clip selection element configured to receive selections of the audio clips, and a timeline element configured to present both chronological and durational information for the first audio clip or the audio segment on a defined time scale. Techniques involve adjusting the defined time scale in the timeline element based on durational information of a selected second audio clip, and presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element. Animation is used in the timeline element for presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element. ## Claims ### Claim 1 A system comprising: a processor to process audio; a memory to store the audio; a graphical user interface configured to play and edit the audio, the graphical user interface comprising: an audio segment user interface element configured to play an audio segment, wherein the audio segment comprises a plurality of selectable audio clips; an audio clip user interface element configured to present a chronological representation of the plurality of selectable audio clips; and a timeline configured to present timing data associated with the audio segment; and a time scaler configured to remove a representation of the timing data associated with the audio segment or timing data for a displayed audio clip in the timeline, and scale a representation of timing data associated with a selected audio clip, wherein the graphical user interface is configured to present the representation of the timing data associated with the selected audio clip within a defined time scale in the timeline, and wherein the system is configured to animate the removal of the representation of the timing data associated with the audio segment or timing data for the displayed audio clip in the timeline, and animate the scaling of the representation of timing data associated with the selected audio clip. ### Claim 2 (depends on 1) The system in accordance with claim 1, wherein the chronological representation comprises thumbnail representations of the plurality of selectable audio clips. ### Claim 3 (depends on 1) The system in accordance with claim 1, wherein the timeline is further configured to present chronological and durational information about the plurality of selectable audio clips on the defined time scale. ### Claim 4 (depends on 1) The system in accordance with claim 1, wherein the system is configured to select a most recently-played audio clip for the selected audio clip. ### Claim 5 (depends on 1) The system in accordance with claim 1, wherein the graphical user interface is configured to concurrently present the selected audio clip presented in the audio segment user interface element and a chronological representation of at least one of the plurality of selectable audio clips that is chronologically adjacent to the selected audio clip. ### Claim 6 (depends on 1) The system in accordance with claim 1, wherein the graphical user interface further comprises a control panel for audio playback, wherein the control panel comprises controls for playing, stopping, pausing, fast forwarding, rewinding, and skipping audio. ### Claim 7 (depends on 1) The system in accordance with claim 1, wherein the graphical user interface further comprises a media bin panel comprising audio data for playing in the audio segment user interface element, wherein the audio data in the media bin panel comprises one or more audio clips, and audio segments. ### Claim 8 (depends on 7) The system in accordance with claim 7, wherein the graphical user interface further comprises a properties panel to present properties for media selected from the media bin panel, wherein the properties panel comprises volume controls. ### Claim 9 (depends on 1) The system in accordance with claim 1, wherein the system is configured to: detect when the animation of the removal and scaling has been completed; and upon detecting that the animation of the removal and scaling has been completed, present the representation of the timing data associated with the selected audio clip within the defined time scale in the timeline at a location that is underneath the selected audio clip. ### Claim 10 (depends on 1) The system in accordance with claim 1, wherein the time scaler is further configured to scale a representation of the timing data associated with a selected audio clip when an audio segment ceases playing in the audio segment user interface element. ### Claim 11 A computer-readable storage device comprising instructions stored thereon that, responsive to execution by a data processing apparatus, cause the data processing apparatus to perform operations comprising: obtaining audio data comprising a plurality of audio clips; presenting the audio data in a user interface comprising an audio play element configured to play audio from the audio data, a clip selection element configured to receive selections of the audio clips, and a timeline element configured to present both chronological and durational information about a first audio clip on a defined time scale; receiving a selection for a second audio clip from one of the audio clips through the clip selection element; adjusting, in response to the selection, the defined time scale in the timeline element based on durational information of the second audio clip; and presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element, wherein an animation is used in the timeline element for presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element. ### Claim 12 (depends on 11) The computer-readable storage device in accordance with claim 11, the operations further comprising: determining a duration of the first audio clip and a duration of the second audio clip; and comparing the duration of the first audio clip and the duration of the second audio clip, wherein if the duration of the first audio clip is less than the duration of the second audio clip, the animation illustrates a stretching of the durational information of the first audio clip to the durational information of the second audio clip to illustrate that the duration of the second audio clip is longer than the duration of the first audio clip, and wherein if the duration of the first audio clip is greater than the duration of the second audio clip, the animation illustrates a compression of the durational information of the first audio clip to the durational information of the second audio clip to illustrate that the duration of the second audio clip is shorter than the duration of the first audio clip. ### Claim 13 (depends on 11) The computer-readable storage device in accordance with claim 11, wherein the selection of one of the audio clips comprises: detecting when audio data in the user interface stops playing; and selecting a most recently-played audio clip for the adjusting of the defined time scale. ### Claim 14 (depends on 11) The computer-readable storage device in accordance with claim 11, wherein the selection of the second audio clip comprises a selection from an audio clip user interface element configured to present a chronological representation of audio clips in the audio data. ### Claim 15 A method for presenting audio data comprising: obtaining audio data comprising plurality of audio clips; presenting the audio data for a first audio clip in a user interface comprising an audio play element configured to play audio from the audio data, a clip selection element configured to receive selections of the plurality of audio clips, and a timeline element configured to present both chronological and durational information for the first audio clip or an audio segment on a defined time scale; receiving a selection for a second audio clip from one of the plurality of audio clips through the clip selection element; adjusting, in response to the selection, the defined time scale in the timeline element based on durational information of the second audio clip; and presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element, wherein an animation is used in the timeline element for presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the time line element. ### Claim 16 (depends on 15) The method in accordance with claim 15, further comprising: determining a duration of the first audio clip and a duration of the second audio clip; and comparing the duration of the first audio clip and the duration of the second audio clip, wherein if the duration of the first audio clip is less than the duration of the second audio clip, the animation illustrates a stretching of the durational information of the first audio clip to the durational information of the second audio clip to illustrate that the duration of the second audio clip is longer than the duration of the first audio clip, and wherein if the duration of the first audio clip is greater than the duration of the second audio clip, the animation illustrates a compression of the durational information of the first audio clip to the durational information of the second audio clip to illustrate that the duration of the second audio clip is shorter than the duration of the first audio clip. ### Claim 17 (depends on 15) The method in accordance with claim 15, wherein the selection of one of the plurality of audio clips comprises a selection from an audio clip user interface element configured to present a chronological representation of audio clips in the audio data. ### Claim 18 (depends on 15) The method in accordance with claim 15, wherein the selection of one of the plurality of audio clips comprises: detecting when audio data in the user interface stops playing; and selecting a most recently-played audio clip for the second audio clip. ### Claim 19 (depends on 18) The method in accordance with claim 18, further comprising: detecting an initiation to play the audio data; presenting the audio data in the audio play element; and presenting the durational information for the audio data in the timeline element. ### Claim 20 (depends on 15) The method in accordance with claim 15, further comprising presenting a chronological representation of the plurality of audio clips that are chronologically adjacent to the one of the audio clips selected. ### Claim 21 A computer-readable storage device comprising instructions stored thereon that, responsive to execution by a data processing apparatus, cause the data processing apparatus to perform operations comprising: presenting an audio segment or a first audio clip of the audio segment in an audio segment user interface element, wherein the audio segment comprises one of a plurality of audio clips, wherein the audio segment user interface element is configured to play the audio segment or one of the plurality of audio clips from the audio segment; presenting a first representation of a first time duration in a timeline corresponding to the audio segment or the first audio clip; receiving a selection of a second audio clip from the plurality of audio clips to present in the audio segment user interface element; replacing the first representation of the first time duration in the timeline with a second representation of a second time duration corresponding to the second audio clip, wherein the replacing comprises adjusting the first representation to the second time duration in a defined time scale in the timeline; presenting the second representation associated with the second audio clip in the time line by animating the adjusting of the first representation to the second time duration; and presenting the second audio clip in the audio segment user interface element. ### Claim 22 (depends on 21) The computer-readable storage device in accordance with claim 21, the operations further comprising: presenting a chronological representation of a plurality of audio clips that are chronologically adjacent to the audio clip. ### Claim 23 (depends on 22) The computer-readable storage device in accordance with claim 22, wherein the presenting the chronological representation of the plurality of audio clips comprises presenting the chronological representation of the plurality of audio clips that are chronologically adjacent to the audio clip when the audio clip is selected for presentation in the audio segment user interface element. ### Claim 24 (depends on 21) The computer-readable storage device in accordance with claim 21, wherein the animating of the adjusting of the first representation to the second time duration comprises operations for providing the animation by stretching or compressing the representations of the first or second time durations as a factor of whether the first time duration is longer or shorter than the second time duration. ### Claim 25 (depends on 24) The computer-readable storage device in accordance with claim 24, the operations further comprising: detecting when the audio segment or the first audio clip stops playing; and triggering the selection of the second audio clip to present in the audio segment user interface. ### Claim 26 (depends on 25) The computer-readable storage device in accordance with claim 25, the operations further comprising: prior to receiving the selection of the second audio clip, detecting an initiation to play the audio segment or the first audio clip; presenting the audio segment or the first audio clip in the audio segment user interface element; and presenting a representation of the first time duration of the audio segment in the timeline. ### Claim 27 A method comprising: obtaining audio data comprising a plurality of audio clips; presenting the audio data in a user interface comprising an audio play element configured to play audio from the audio data, a clip selection element configured to receive selections of the audio clips, and a timeline element configured to present both chronological and durational information about a first audio clip on a defined time scale; receiving a selection for a second audio clip from one of the audio clips through the clip selection element; adjusting, in response to the selection, the defined time scale in the timeline element based on durational information of the second audio clip; and presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element by animating the adjusting of the defined time scale in the timeline element. ### Claim 28 (depends on 27) The method in accordance with claim 27, wherein the animating of the adjusting of the defined time scale comprises animating by stretching or compressing representations of time durations of the first or second audio clips as a factor of whether the first audio clip has a longer duration or a shorter duration than the second audio clip. ### Claim 29 (depends on 27) The method in accordance with claim 27, wherein the selection of one of the audio clips comprises: detecting when audio data in the user interface stops playing; and selecting a most recently-played audio clip for the adjusting of the defined time scale. ### Claim 30 (depends on 27) The method in accordance with claim 27, wherein the selection of the second audio clip comprises a selection from an audio clip user interface element configured to present a chronological representation of audio clips in the audio data. ### Claim 31 A computer-readable storage device comprising instructions stored thereon that, responsive to execution by a data processing apparatus, cause the data processing apparatus to perform operations comprising: obtaining audio data comprising an audio segment, the audio segment comprising a plurality of audio clips; presenting the audio data in a user interface comprising an audio play element configured to play audio from the audio data, a clip selection element configured to receive selections of the audio clips, and a timeline element configured to present both chronological and durational information for a first audio clip or the audio segment on a defined time scale; receiving a selection for a second audio clip from one of the plurality of audio clips through the clip selection element; adjusting, in response to the selection, the defined time scale in the timeline element based on durational information of the second audio clip; and presenting the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element by animating the adjusting of the defined time scale in the timeline element. ### Claim 32 (depends on 31) The computer-readable storage device in accordance with claim 31, wherein the operations for the animating of the adjusting of the defined time scale comprises operations for animating by stretching or compressing representations of time durations of the first or second audio clips as a factor of whether the first audio clip has a longer duration or a shorter duration than the second audio clip. ### Claim 33 (depends on 31) The computer-readable storage device in accordance with claim 31, wherein the selection of one of the plurality of audio clips comprises a selection from an audio clip user interface element configured to present a chronological representation of audio clips in the audio data. ### Claim 34 (depends on 31) The computer-readable storage device in accordance with claim 31, wherein the selection for a second audio clip comprises: detecting when audio data in the user interface stops playing; and selecting a most recently-played audio clip for the second audio clip. ### Claim 35 (depends on 34) The computer-readable storage device in accordance with claim 34, the operations further comprising: detecting an initiation to play the audio data; presenting the audio data in the audio play element; and presenting the durational information for the audio data in the timeline element. ### Claim 36 (depends on 31) The computer-readable storage device in accordance with claim 31, the operations further comprising presenting a chronological representation of the plurality of audio clips that are chronologically adjacent to the one of the audio clips selected. ### Claim 37 A method comprising: presenting an audio segment or a first audio clip of the audio segment in an audio segment user interface element, wherein the audio segment comprises one of a plurality of audio clips, wherein the audio segment user interface element is configured to play the audio segment or one of the plurality of audio clips from the audio segment; presenting a first representation of a first time duration in a timeline corresponding to the audio segment or the first audio clip; receiving a selection of a second audio clip from the plurality of audio clips to present in the audio segment user interface element; replacing the first representation of the first time duration in the timeline with a second representation of a second time duration corresponding to the second audio clip, wherein the replacing comprises adjusting the first representation to the second time duration in a defined time scale in the timeline; presenting the second representation associated with the second audio clip in the timeline by animating the adjusting of the first representation to the second time duration; and presenting the second audio clip in the audio segment user interface element. ### Claim 38 (depends on 37) The method in accordance with claim 37, further comprising: presenting a chronological representation of a plurality of audio clips that are chronologically adjacent to the audio clip. ### Claim 39 (depends on 38) The method in accordance with claim 38, wherein the presenting the chronological representation of the plurality of audio clips comprises presenting the chronological representation of the plurality of audio clips that are chronologically adjacent to the audio clip when the audio clip is selected for presentation in the audio segment user interface element. ### Claim 40 (depends on 37) The method in accordance with claim 37, wherein the animating of the adjusting of the first representation to the second time duration comprises operations for providing the animation by stretching or compressing the representations of the first or second time durations as a factor of whether the first time duration is longer or shorter than the second time duration. ### Claim 41 (depends on 40) The method in accordance with claim 40, further comprising: detecting when the audio segment or the first audio clip stops playing; and triggering the selection of the second audio clip to present in the audio segment user interface. ### Claim 42 (depends on 41) The method in accordance with claim 41, further comprising: prior to receiving the selection of the second audio clip, detecting an initiation to play the audio segment or the first audio clip; presenting the audio segment or the first audio clip in the audio segment user interface element; and presenting a representation of the first time duration of the audio segment in the timeline. ### Claim 43 A system comprising: a processor to process audio; a memory to store the audio; a graphical user interface to present audio data, wherein the audio data comprises an audio segment comprising a plurality of audio clips, wherein the graphical user interface comprises an audio play element configured to play audio from the audio data, a clip selection element configured to receive selections of the audio clips, and a timeline element configured to present both chronological and durational information for a first audio clip or the audio segment on a defined time scale; wherein the clip selection element is configured to receive a selection for a second audio clip from one of the plurality of audio clips, wherein the timeline element is configured to adjust, in response to the selection, the defined time scale based on durational information of the second audio clip, and wherein the graphical user interface is configured to present the adjusted defined time scale corresponding to the durational information of the second audio clip in the timeline element by animating the adjusting of the defined time scale. ### Claim 44 (depends on 43) The system in accordance with claim 43, wherein the graphical user interface is configured to present animation in the timeline element to indicate the adjusting of the defined time scale by stretching or compressing representations of time durations of the first or second audio clips as a factor of whether the first audio clip has a longer duration or a shorter duration than the second audio clip. ### Claim 45 (depends on 43) The system in accordance with claim 43, wherein the audio clip user interface element is configured to present a chronological representation of audio clips in the audio data. ### Claim 46 (depends on 43) The system in accordance with claim 43, wherein the system is configured to detect when audio data in the user interface stops playing and select a most recently-played audio clip for the second audio clip. ### Claim 47 (depends on 46) The system in accordance with claim 46, wherein the system is configured to detect an initiation to play the audio data, present the audio data in the audio play element, and present the durational information for the audio data in the timeline element. ### Claim 48 (depends on 43) The system in accordance with claim 43, wherein the system is configured to present a chronological representation of the plurality of audio clips that are chronologically adjacent to the one of the audio clips selected. ### Claim 49 A system comprising: a processor to process audio; a memory to store the audio; a graphical user interface comprising an audio segment user interface element, wherein the graphical user interface is configured to: present an audio segment or a first audio clip of the audio segment in the audio segment user interface element, wherein the audio segment comprises one of a plurality of audio clips, wherein the audio segment user interface element is configured to play the audio segment or one of the plurality of audio clips from the audio segment; present a first representation of a first time duration in a timeline corresponding to the audio segment or the first audio clip; receive a selection of a second audio clip from the plurality of audio clips to present in the audio segment user interface element; replace the first representation of the first time duration in the timeline with a second representation of a second time duration corresponding to the second audio clip, wherein the replacing comprises adjusting the first representation to the second time duration in a defined time scale in the timeline; present the second representation associated with the second audio clip in the timeline by animating the adjusting of the first representation to the second time duration; and present the second audio clip in the audio segment user interface element. ### Claim 50 (depends on 49) The system in accordance with claim 49, wherein the system is configured to present a chronological representation of a plurality of audio clips that are chronologically adjacent to the audio clip. ### Claim 51 (depends on 50) The system in accordance with claim 50, wherein the system is configured to present the chronological representation of the plurality of audio clips that are chronologically adjacent to the audio clip when the audio clip is selected for presentation in the audio segment user interface element. ### Claim 52 (depends on 49) The system in accordance with claim 49, wherein the system is configured to animate the adjusting of the first representation to the second time duration by stretching or compressing the representations of the first or second time durations as a factor of whether the first time duration is longer or shorter than the second time duration. ### Claim 53 (depends on 52) The system in accordance with claim 52, wherein the system is configured to detect when the audio segment or the first audio clip stops playing and trigger the selection of the second audio clip to present in the audio segment user interface. ### Claim 54 (depends on 53) The system in accordance with claim 53, wherein the system is configured to, prior to receiving the selection of the second audio clip, detect an initiation to play the audio segment or the first audio clip, present the audio segment or the first audio clip in the audio segment user interface element, and present a representation of the first time duration of the audio segment in the timeline.