# US 9,003,287 B2 · Interaction between 3D animation and corresponding script > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,003,287 B2 - Document ID: US9003287B2 - Status: Granted - Kind: B2 - Application number: 13/299,518 - Filed: 2011-11-18 - Published: 2013-05-23 - Granted: 2015-04-07 - Earliest claimed: 2011-11-18 - Assignees: Lucasfilm Entertainment Company Ltd. - Applicants: Joshua Goldenberg; Louise Rasmussen; Adam Schnitzer; Domenico Porcino; George Lucas; Brett A. Allen - Inventors: Joshua Goldenberg; Louise Rasmussen; Adam Schnitzer; Domenico Porcino; George Lucas; Brett A. Allen - Web page: https://patentgrep.com/patent/US9003287B2 ## CPC - G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} - G06T 13/20: Three-dimensional [3D] animation - G11B 27/036: Insert-editing - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T 2213/04: Animation description language - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Interaction between a 3D animation and a corresponding script includes: displaying a user interface that includes at least a 3D animation area and a script area, the 3D animation area including (i) a 3D view area for creating and playing a 3D animation and (ii) a timeline area for visualizing actions by one or more 3D animation characters, the script area comprising one or more objects representing lines from a script having one or more script characters; receiving a first user input corresponding to a user selecting at least one of the objects from the script area for assignment to a location in the timeline area; generating a timeline object at the location in response to the first user input, the timeline object corresponding to the selected object; and associating audio data with the generated timeline object, the audio data corresponding to a line represented by the selected object. ## Claims ### Claim 1 A computer-implemented method for interaction between a 3D animation and a corresponding script, the method comprising: displaying a user interface that includes at least a 3D animation area and a script area, the 3D animation area including (i) a 3D view area for creating and playing a 3D animation and (ii) a timeline area for visualizing actions by one or more 3D animation characters, the script area comprising one or more objects representing lines from a script having one or more script characters; receiving a first user input corresponding to a user selecting at least one of the objects from the script area for assignment to a location in the timeline area and placing the selected object in the 3D viewing area: identifying the location in the timeline area as corresponding to a current state of the 3D view area and placing the selected object at the location in the timeline area based on the identification; generating a timeline object at the location in response to the first user input, the timeline object corresponding to the selected object; and associating audio data with the generated timeline object, the audio data corresponding to a line represented by the selected object. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein the user selects more than one of the objects in the script area, the selected objects having an order specified by the script, the method further comprising: generating timeline objects corresponding to the respective selected objects; and positioning the timeline objects in the timeline area according to the order. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, wherein the user hovers the selected object over the timeline area before the assignment, and wherein the location in the timeline area is determined based on where in the timeline area the user places the selected object. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, further comprising updating, in response to the assignment of the selected object to the location in the timeline area, at least the script area to visually distinguish the selected object from any of the objects that have not been assigned to the timeline area. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, wherein the timeline object shows (i) dialogue text corresponding to the line represented by the selected object, and (ii) an audio waveform corresponding to the audio data. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, further comprising making a recording of the 3D animation, and updating at least the script area to include camera and take identifiers for the recording. ### Claim 7 (depends on 6) The computer-implemented method of claim 6, further comprising updating, in response to the recording, the script area with a linear mark indicating at least one of the lines as being included in the recording. ### Claim 8 (depends on 6) The computer-implemented method of claim 6, further comprising receiving a second user input upon the user selecting the camera identifier or the take identifier, and playing the recording in response to the second user input. ### Claim 9 (depends on 1) The computer-implemented method of claim 1, further comprising: generating an audio file by recording a reading of the line represented by the selected object; and associating the audio file with the object before the first user input is received, wherein the audio data is obtained from the audio file for association with the generated timeline object. ### Claim 10 (depends on 9) The computer-implemented method of claim 9, wherein audio files have been generated for multiple ones of the lines, the method further comprising collating and exporting the audio files. ### Claim 11 (depends on 1) The computer-implemented method of claim 1, further comprising: receiving a second user input after generating the timeline object, the second user input selecting one of the timeline object and the object from the script area; and highlighting, based on the second user input, the other of the timeline object and the object. ### Claim 12 A computer implemented method for interaction between a 3D animation and a corresponding script, the method comprising: displaying a user interface that includes at least a 3D animation area and a script area, the 3D animation area including (i) a 3D view area for creating and playing a 3D animation and (ii) a timeline area for visualizing actions by one or more 3D animation characters, the script area comprising one or more objects representing lines from a script having one or more script characters; receiving a first user input corresponding to a user selecting at least one of the objects from the script area for assignment to a location in the timeline area, wherein the line or lines represented by the selected object belong to a specific script character; associating the specific script character with one of the 3D animation characters; color coding, based on the association, the specific script character and the 3D animation character using a common color; generating a timeline object at the location in response to the first user input, the timeline object corresponding to the selected object; and associating audio data with the generated timeline object, the audio data corresponding to a line represented by the selected object. ### Claim 13 (depends on 12) The computer-implemented method of claim 12, further comprising comparing a name of the 3D animation character with the specific script character, wherein the association is based on the comparison. ### Claim 14 (depends on 12) The computer-implemented method of claim 12, further comprising receiving a second user input that indicates the specific script character and a name of the 3D animation character, wherein the association is based on the second user input. ### Claim 15 (depends on 12) The computer-implemented method of claim 12, wherein the color coding is present at least: (i) in a script character list; and (ii) in a marking adjacent the selected object in the script area. ### Claim 16 A non-transitory computer-readable storage medium comprising instructions that when executed by a processor perform a method for interaction between a 3D animation and a corresponding script, the method comprising: displaying a user interface that includes at least a 3D animation area and a script area, the 3D animation area including (i) a 3D view area for creating and playing a 3D animation and (ii) a timeline area for visualizing actions by one or more 3D animation characters, the script area comprising one or more objects representing lines from a script having one or more script characters; receiving a first user input corresponding to a user selecting at least one of the objects from the script area for assignment to a location in the timeline area and placing the selected object in the 3D viewing area; identifying the location in the timeline area as corresponding to a current state of the 3D view area and placing the selected object at the location in the timeline area based on the identification; generating a timeline object at the location in response to the first user input, the timeline object corresponding to the selected object; and associating audio data with the generated timeline object, the audio data corresponding to a line represented by the selected object. ### Claim 17 (depends on 16) The non-transitory computer-readable storage medium set forth in claim 16 wherein when the user selects more than one of the objects in the script area, the selected objects having an order specified by the script, the method performed further comprises: generating timeline objects corresponding to the respective selected objects; and positioning the timeline objects in the timeline area according to the order. ### Claim 18 A non-transitory computer-readable storage medium comprising instructions that when executed by a processor perform a method for interaction between a 3D animation and a corresponding script, the method comprising: displaying a user interface that includes at least a 3D animation area and a script area, the 3D animation area including (i) a 3D view area for creating and playing a 3D animation and (ii) a timeline area for visualizing actions by one or more 3D animation characters, the script area comprising one or more objects representing lines from a script having one or more script characters; receiving a first user input corresponding to a user selecting at least one of the objects from the script area for assignment to a location in the timeline area, wherein the line or lines represented by the selected object belong to a specific script character; associating the specific script character with one of the 3D animation characters; color coding, based on the association, the specific script character and the 3D animation character using a common color; generating a timeline object at the location in response to the first user input, the timeline object corresponding to the selected object; and associating audio data with the generated timeline object, the audio data corresponding to a line represented by the selected object. ### Claim 19 (depends on 18) The non-transitory computer-readable storage medium set forth in claim 18 wherein the method performed further comprises comparing a name of the 3D animation character with the specific script character, wherein the association is based on the comparison. ### Claim 20 A system comprising: a display; a computer-readable storage device having a computer program stored thereon; one or more processing devices operable to execute the computer program, interact with the display and perform operations comprising: displaying a user interface that includes at least a 3D animation area and a script area, the 3D animation area including (i) a 3D view area for creating and playing a 3D animation and (ii) a timeline area for visualizing actions by one or more 3D animation characters, the script area comprising one or more objects representing lines from a script having one or more script characters; receiving a first user input corresponding to a user selecting at least one of the objects from the script area for assignment to a location in the timeline area and placing the selected object in the 3D viewing area; identifying the location in the timeline area as corresponding to a current state of the 3D view area and placing the selected object at the location in the timeline area based on the identification; generating a timeline object at the location in response to the first user input, the timeline object corresponding to the selected object; and associating audio data with the generated timeline object, the audio data corresponding to a line represented by the selected object. ### Claim 21 (depends on 20) The system set forth in claim 20 wherein when the user selects more than one of the objects in the script area, the selected objects having an order specified by the script, the operations performed further comprise: generating timeline objects corresponding to the respective selected objects; and positioning the timeline objects in the timeline area according to the order. ### Claim 22 A system comprising: a display; a computer-readable storage device having a computer program stored thereon; one or more processing devices operable to execute the computer program, interact with the display and perform operations comprising: displaying a user interface that includes at least a 3D animation area and a script area, the 3D animation area including (i) a 3D view area for creating and playing a 3D animation and (ii) a timeline area for visualizing actions by one or more 3D animation characters, the script area comprising one or more objects representing lines from a script having one or more script characters; receiving a first user input corresponding to a user selecting at least one of the objects from the script area for assignment to a location in the timeline area, wherein the line or lines represented by the selected object belong to a specific script character; associating the specific script character with one of the 3D animation characters; color coding, based on the association, the specific script character and the 3D animation character using a common color; generating a timeline object at the location in response to the first user input, the timeline object corresponding to the selected object; and associating audio data with the generated timeline object, the audio data corresponding to a line represented by the selected object. ### Claim 23 (depends on 22) The system set forth in claim 22 wherein the operations performed further comprise comparing a name of the 3D animation character with the specific script character, wherein the association is based on the comparison.