# US 12,002,135 B2 · Adding time-based captions to captured video within a messaging system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,002,135 B2 - Document ID: US12002135B2 - Status: Granted - Kind: B2 - Application number: 17/556,603 - Filed: 2021-12-20 - Published: 2022-06-30 - Granted: 2024-06-04 - Earliest claimed: 2020-12-30 - Assignees: Snap Inc. - Applicants: Snap Inc. - Inventors: Kaveh Anvaripour; Christine Barron; Nathan Kenneth Boyd; Christie Marie Heikkinen; Ranidu Lankage; Daniel Moreno; Shannon Ward; Tabari Williams - Web page: https://patentgrep.com/patent/US12002135B2 ## CPC - G06F 16/7867: {using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings} - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus - G06F 16/24573: {using data annotations, e.g. user-defined metadata} - G06T 11/60: Creating or editing images; Combining images with text - H04L 51/046: Interoperability with other network applications or services - H04L 51/10: Multimedia information - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for adding time-based captions to captured video. The program and method provide for displaying, by a messaging application, a preview user interface for previewing and editing captured video in order to generate a media content item, the preview user interface including an interface element which is selectable to switch to a captions user interface for adding a caption to the media content item; switching, in response to first user input selecting the interface element, to the captions user interface which is configured to receive user input for caption content and a duration to display the caption content; receiving, via the captions user interface, second user input for the caption content and the duration; and generating the media content item based on the caption content and the duration to display the caption content. ## Claims ### Claim 1 A method, comprising: displaying, by a messaging application running on a device, a preview user interface for previewing and editing captured video in order to generate a media content item, the preview user interface including an interface element which is selectable to switch to a captions user interface for adding a caption to the media content item; switching, in response to first user input selecting the interface element, from the preview user interface to the captions user interface, the captions user interface being configured to receive user input for caption content and including a user-selectable button for setting a duration to display the caption content; receiving, via the captions user interface, second user input for the caption content and third user input selecting the user-selectable button for setting the duration to display the caption content; and generating the media content item based on the caption content and the duration to display the caption content, wherein in response to receiving the third user input, the captions user interface is updated to include a preview bar including a front handle and a back handle for setting the duration to display the caption content, wherein the captured video comprises a plurality of video clips, each video clip corresponding to a separately-captured series of video frames that runs for an uninterrupted period of time, and wherein the captions user interface is configured to provide haptic feedback during a drag gesture of the front handle or the back handle to indicate a transition between adjacent video clips of the plurality of video clips. ### Claim 2 (depends on 1) The method of claim 1, further comprising: providing, prior to the displaying, a capture user interface for capturing the video, wherein the preview user interface is displayed upon completion of capturing the video via the capture user interface. ### Claim 3 (depends on 1) The method of claim 1, further comprising: receiving, via the captions user interface, third user input for second caption content and for a second duration to display the second caption content; and displaying, within the captions user interface, the caption content based on the duration together with the second caption content based on the second duration, wherein display of the caption content is at a reduced opacity relative to display of the second caption content. ### Claim 4 (depends on 1) The method of claim 1, wherein the captions user interface includes a keyboard element by which the second user input for the caption content is provided. ### Claim 5 (depends on 4) The method of claim 4, wherein in response to receiving the third user input, the captions user interface replaces display of the keyboard element with the preview bar. ### Claim 6 (depends on 1) The method of claim 1, wherein the captions user interface includes a color slider element which is user selectable to set a color for the caption content. ### Claim 7 (depends on 1) The method of claim 1, wherein the captions user interface includes an alignment element which is user selectable to set an alignment for the caption content. ### Claim 8 (depends on 1) The method of claim 1, wherein the caption content includes at least one of text or a sticker. ### Claim 9 (depends on 1) The method of claim 1, wherein the preview user interface further includes an add video button which is user-selectable to add one more video clips to the plurality of video clips. ### Claim 10 (depends on 1) The method of claim 1, further comprising: providing a first camera mode and a second camera mode for capturing the video, wherein in the first camera mode, the captured video comprises a single video clip with a captured series of video frames that runs for an uninterrupted period of time, and wherein in the second camera mode, the captured video comprises the plurality of video clips, each video clip corresponding to a separately-captured series of video frames that runs for an uninterrupted period of time. ### Claim 11 (depends on 1) The method of claim 1, wherein the preview user interface includes a video preview element with a first set of thumbnails representing the captured video, the video preview element omitting the front handle and the back handle, and wherein the preview bar includes a second set of thumbnails representing the captured video, the preview bar being separate from the video preview element. ### Claim 12 A system comprising: a processor; and a memory storing instructions that, when executed by the processor, configure the processor to perform operations comprising: displaying, by a messaging application running on a device, a preview user interface for previewing and editing captured video in order to generate a media content item, the preview user interface including an interface element which is selectable to switch to a captions user interface for adding a caption to the media content item; switching, in response to first user input selecting the interface element, from the preview user interface to the captions user interface, the captions user interface being configured to receive user input for caption content and including a user-selectable button for setting a duration to display the caption content; receiving, via the captions user interface, second user input for the caption content and third user input selecting the user-selectable button for setting the duration to display the caption content; and generating the media content item based on the caption content and the duration to display the caption content, wherein in response to receiving the third user input, the captions user interface is updated to include a preview bar including a front handle and a back handle for setting the duration to display the caption content, wherein the captured video comprises a plurality of video clips, each video clip corresponding to a separately-captured series of video frames that runs for an uninterrupted period of time, and wherein the captions user interface is configured to provide haptic feedback during a drag gesture of the front handle or the back handle to indicate a transition between adjacent video clips of the plurality of video clips. ### Claim 13 (depends on 12) The system of claim 12, the operations further comprising: providing, prior to the displaying, a capture user interface for capturing the video, wherein the preview user interface is displayed upon completion of capturing the video via the capture user interface. ### Claim 14 (depends on 12) The system of claim 12, the operations further comprising: receiving, via the captions user interface, third user input for second caption content and for a second duration to display the second caption content; and displaying, within the captions user interface, the caption content based on the duration together with the second caption content based on the second duration, wherein display of the caption content is at a reduced opacity relative to display of the second caption content. ### Claim 15 (depends on 12) The system of claim 12, wherein the captions user interface includes a keyboard element by which the second user input for the caption content is provided. ### Claim 16 (depends on 15) The system of claim 15, wherein in response to receiving the third user input, the captions user interface replaces display of the keyboard element with the preview bar. ### Claim 17 (depends on 12) The system of claim 12, wherein the captions user interface includes a color slider element which is user selectable to set a color for the caption content. ### Claim 18 (depends on 12) The system of claim 12, wherein the captions user interface includes an alignment element which is user selectable to set an alignment for the caption content. ### Claim 19 (depends on 12) The system of claim 12, wherein the caption content includes at least one of text or a sticker. ### Claim 20 A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising: displaying, by a messaging application running on a device, a preview user interface for previewing and editing captured video in order to generate a media content item, the preview user interface including an interface element which is selectable to switch to a captions user interface for adding a caption to the media content item; switching, in response to first user input selecting the interface element, from the preview user interface to the captions user interface, the captions user interface being configured to receive user input for caption content and including a user-selectable button for setting a duration to display the caption content; receiving, via the captions user interface, second user input for the caption content and third user input selecting the user-selectable button for setting the duration to display the caption content; and generating the media content item based on the caption content and the duration to display the caption content, wherein in response to receiving the third user input, the captions user interface is updated to include a preview bar including a front handle and a back handle for setting the duration to display the caption content, wherein the captured video comprises a plurality of video clips, each video clip corresponding to a separately-captured series of video frames that runs for an uninterrupted period of time, and wherein the captions user interface is configured to provide haptic feedback during a drag gesture of the front handle or the back handle to indicate a transition between adjacent video clips of the plurality of video clips.