# US 10,372,801 B2 · Narrative-based media organizing system for transforming and merging graphical representations of digital media within a work area > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,372,801 B2 - Document ID: US10372801B2 - Status: Granted - Kind: B2 - Application number: 15/283,909 - Filed: 2016-10-03 - Published: 2017-01-26 - Granted: 2019-08-06 - Earliest claimed: 2010-02-03 - Assignees: Google Inc. - Applicants: Google Inc. - Inventors: Nils Kokemohr - Web page: https://patentgrep.com/patent/US10372801B2 ## CPC - G06F 16/41: Indexing; Data structures therefor; Storage structures - G06F 40/169: Annotation, e.g. comment data or footnotes - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 16/40: of multimedia data, e.g. slideshows comprising image and additional audio data (retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70) - G06F 16/4393: {Multimedia presentations, e.g. slide shows, multimedia albums} - G06F 16/48: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually - G06F 16/93: Document management systems - G06F 40/106: Display of layout of documents; Previewing - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A computer system for a narrational media organizer for transforming digital media into a personal, memorable story with minimal user input having a processor and storage with instructions for creating a narrational media organizer (NMO) environment, where a user can annotate one or more than one digital media file or graphical representations of the digital media files using a user interface; and an NMO data structure for storing the digital media and annotations of the NMO environment. ## Claims ### Claim 1 A computer-implemented method comprising: providing to a user digital media files as graphical representations of each of the digital media files in an arrangement along a timeline in a work area; receiving textual annotations from the user corresponding to a first graphical representation of a first digital media file of the digital media files; providing an animation of the first graphical representation, wherein the animation includes rotation of the first graphical representation from a front side to a backside, wherein the backside includes the textual annotations; receiving, via an input device associated with the user, a tap on a minimizing icon associated with the first graphical representation; in response to receiving the tap, replacing the first graphical representation with a smaller icon that is smaller than the first graphical representation; and in response to replacing the first graphical representation with the smaller icon, exporting the digital media files except for the first digital media file, wherein the digital media files except for the first digital media file are exported as one or more of a slideshow, a webpage, a video, a portable document format, a photo book, a printed photo collection, or an email. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, further comprising: providing an option to toggle between a full text mode that includes the textual annotations and one or more interactive buttons and a viewing mode where the textual annotations are abbreviated as icons and the viewing mode excluding the one or more interactive buttons. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, further comprising: receiving a tap and hold gesture from the user, wherein the tap and hold gesture corresponds to a command to move the first graphical representation to a different position in the work area; receiving a drag gesture from the user to move the first graphical representation to the different position in the work area; and providing the first graphical representation in the different position in the work area. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, further comprising: excluding the first digital media file with the smaller icon from searches of the digital media files. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, wherein the textual annotations corresponding to the first graphical representation are displayed in a font proportional with a size of the smaller icon. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, further comprising: modifying the arrangement of the graphical representations along the timeline in the work area such that at least a second graphical representation and a third graphical representation are caused to move closer along the timeline. ### Claim 7 (depends on 1) The computer-implemented method of claim 1, further comprising: reducing a resolution of the first digital media file that corresponds to the first graphical representation. ### Claim 8 A system comprising: one or more processors; and a memory that stores instructions executed by the one or more processors, the instructions comprising: providing to a user digital media files as graphical representations of each of the digital media files in an arrangement along a timeline in a work area; receiving textual annotations from the user corresponding to a first graphical representation of a first digital media file of the digital media files; providing an animation of the first graphical representation, wherein the animation includes rotation of the first graphical representation from a front side to a backside, wherein the backside includes the textual annotations; receiving, via an input device associated with the user, a tap on a minimizing icon associated with the first graphical representation; in response to receiving the tap, replacing the first graphical representation with a smaller icon that is smaller than the first graphical representation; and in response to replacing the first graphical representation with the smaller icon, exporting the digital media files except for the first digital media file, wherein the digital media files are exported as one or more of a slideshow, a webpage, a video, a portable document format, a photo book, a printed photo collection, or an email. ### Claim 9 (depends on 8) The system of claim 8, wherein the instructions further comprise: providing an option to toggle between a full text mode that includes the textual annotations and one or more interactive buttons and a viewing mode where the textual annotations are abbreviated as icons and the viewing mode excluding the one or more interactive buttons. ### Claim 10 (depends on 8) The system of claim 8, wherein the instructions further comprise: receiving a tap and hold gesture from the user, wherein the tap and hold gesture corresponds to a command to move the first graphical representation to a different position in the work area; receiving a drag gesture from the user to move the first graphical representation to the different position in the work area; and providing the first graphical representation in the different position in the work area. ### Claim 11 (depends on 8) The system of claim 8, wherein the instructions further comprise: excluding the first digital media file with the smaller icon from searches of the digital media files. ### Claim 12 (depends on 11) The system of claim 11, wherein the instructions further comprise: modifying the arrangement of the graphical representations along the timeline in the work area such that at least a second graphical representation and a third graphical representation are caused to move closer along the timeline. ### Claim 13 (depends on 8) The system of claim 8, wherein the textual annotations corresponding to the first graphical representation are displayed in a font proportional with a size of the smaller icon. ### Claim 14 (depends on 8) The system of claim 8, wherein the instructions further comprise: reducing a resolution of the first digital media file that corresponds to the first graphical representation. ### Claim 15 A non-transitory computer readable medium with instructions that, when executed by one or more computers, cause the one or more computers to perform operations, the operations comprising: providing to a user digital media files as graphical representations of each of the digital media files in an arrangement along a timeline in a work area; receiving textual annotations from the user corresponding to a first graphical representation of a first digital media file of the digital media files; providing an animation of the first graphical representation, wherein the animation includes rotation of the first graphical representation from a front side to a backside, wherein the backside includes the textual annotations; receiving, via an input device associated with the user, a tap on a minimizing icon associated with the first graphical representation; in response to receiving the tap, replacing the first graphical representation with a smaller icon that is smaller than the first graphical representation; and in response to replacing the first graphical representation with the smaller icon, exporting the digital media files except for the first digital media file, wherein the digital media files except for the first digital media file are exported as one or more of a slideshow, a webpage, a video, a portable document format, a photo book, a printed photo collection, or an email. ### Claim 16 (depends on 15) The computer-readable medium of claim 15, wherein the operations further comprise: providing an option to toggle between a full text mode that includes the textual annotations and one or more interactive buttons and a viewing mode where the textual annotations are abbreviated as icons and the viewing mode excluding the one or more interactive buttons. ### Claim 17 (depends on 15) The computer-readable medium of claim 15, wherein the operations further comprise: receiving a tap and hold gesture from the user, wherein the tap and hold gesture corresponds to a command to move the first graphical representation to a different position in the work area; receiving a drag gesture from the user to move the first graphical representation to the different position in the work area; and providing the first graphical representation in the different position in the work area. ### Claim 18 (depends on 15) The computer-readable medium of claim 15, wherein the operations further comprise: excluding the first digital media file with the smaller icon from searches of the digital media files. ### Claim 19 (depends on 15) The computer-readable medium of claim 15, wherein the textual annotations corresponding to the first graphical representation are displayed in a font proportional with a size of the smaller icon. ### Claim 20 (depends on 15) The computer-readable medium of claim 15, wherein the operations further comprise: modifying the arrangement of the graphical representations along the timeline in the work area such that at least a second graphical representation and a third graphical representation are caused to move closer along the timeline.