# US 12,216,982 B2 · Generating and utilizing digital media clips based on contextual metadata from digital environments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,216,982 B2
- Document ID: US12216982B2
- Status: Granted
- Kind: B2
- Application number: 17/657,571
- Filed: 2022-03-31
- Published: 2023-10-05
- Granted: 2025-02-04
- Earliest claimed: 2022-03-31
- Assignees: Dropbox, Inc.
- Applicants: Dropbox, Inc.
- Inventors: Arunsunai Anbukarasi Anbalagapandian; Devin Mancuso; Rituparna Vincent; Viksit Gaur
- Web page: https://patentgrep.com/patent/US12216982B2

## CPC

- G06F 16/951: Indexing; Web crawling techniques
- G06F 40/106: Display of layout of documents; Previewing
- G06F 16/14: Details of searching files based on file metadata
- G06F 16/9577: {Optimising the visualization of content, e.g. distillation of HTML documents}
- G06F 16/958: Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
- G06F 40/166: Editing, e.g. inserting or deleting
- G06F 40/197: Version control (for software G06F8/71)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The present disclosure relates to systems, methods, and non-transitory computer-readable media that dynamically capture, organize, and utilize digital media clips. For example, in one or more implementations, the disclosed systems can capture and generate digital media clips of content items that include both content metadata of the content items as well as contextual metadata of contextual signals surrounding the content item. Additionally, in some implementations, the disclosed systems analyze contextual metadata to search, retrieve, discover, and organize new and existing digital media clips. Further, in various implementations, the disclosed systems facilitate generating digital media clip libraries as well as the creation of digital media collections, where different types of digital media clips can be combined in a cohesive interactive graphical user interface.

## Claims

### Claim 1

A computer-implemented method comprising:
extracting a content item comprising digital content data and content metadata based on a detected user interaction with the content item;
capturing contextual signals from one or more active digital environments on a client device at a time of extracting the content item;
generating contextual metadata for the content item based on the contextual signals from the one or more active digital environments;
generating a digital media clip file by associating the content item comprising the digital content data and the content metadata with the contextual metadata generated from the contextual signals from the one or more active digital environments;
identifying a first collection of digital media clip files from a plurality of collections of digital media clip files by determining a correspondence value between the digital media clip file and the first collection of digital media clip files, the correspondence value being determined based on an analysis of:
the content metadata and the contextual metadata of the digital media clip file; and
collection content metadata and collection contextual metadata associated with the first collection of digital media clip files; and
associating the digital media clip file with the first collection of digital media clip files based on the correspondence value.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising generating the contextual metadata for the content item based on a file format of the content item.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, further comprising generating the contextual metadata for the content item to comprise a capture source and a capture time of the content item.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein:
the content metadata comprises a name, size, file, type, attributes, tags, creation date, and permissions of the content item.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising displaying the digital media clip file and the first collection of digital media clip files within an interactive graphical user interface.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, further comprising analyzing an operating system digital environment to identify operating system signals to add to the contextual metadata.

### Claim 7 (depends on 5)

The computer-implemented method of claim 5, further comprising analyzing a web-based environment to identify adjacent content within a proximity of the content item to add to the contextual metadata.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining that the content metadata comprises a URL from a webpage; and
based on determining that the content metadata comprises a URL, generating the contextual metadata for the content item by saving a version of the webpage that captures elements, styles, and a layout as displayed at a time of extracting the content item from the webpage.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein determining the correspondence value between the digital media clip file and the first collection of digital media clip files further comprise:
utilizing a machine-learning model to generate:
a clip embedding for the digital media clip file based on the content metadata and the contextual metadata, and
a collection embedding for the first collection of digital media clip files based on the collection content metadata and the collection contextual metadata; and
analyzing the clip embedding for the digital media clip file and the collection embedding for the first collection of digital media clip files to determine the correspondence value.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, further comprising:
providing, for display on the client device, a suggestion to add the digital media clip file to the first collection of digital media clip files based on the correspondence value; and
wherein associating the digital media clip file with the first collection of digital media clip files is based on receiving a user interaction with respect to the suggestion to add the digital media clip file to the first collection of digital media clip files.

### Claim 11 (depends on 1)

The computer-implemented method of claim 1, further comprising displaying the content item along with one or more contextual metadata elements within an interactive graphical user interface.

### Claim 12

A non-transitory computer-readable storage medium comprising instructions that, when executed by at least one processor, cause a computer device to:
based on detecting user interaction with a content item, extract the content item comprising digital content data and content metadata;
capture contextual signals from one or more active digital environments on a client device at a time of extracting the content item;
generate contextual metadata for the content item based on the contextual signals from the one or more active digital environments;
generate content item metadata for the content item within a content item attribute database by associating the content item comprising the digital content data and the content item metadata with the contextual metadata generated from the contextual signals from the one or more active digital environments;
generate a digital media clip file by associating the content item comprising the digital content data and the content metadata with the contextual metadata generated from the contextual signals from the one or more active digital environments;
identify a first collection of digital media clip files from a plurality of collections of digital media clip files by determining a correspondence value between the digital media clip file and the first collection of digital media clip files, the correspondence value being determined based on an analysis of:
the content metadata and the contextual metadata of the digital media clip file; and
collection content metadata and collection contextual metadata associated with the first collection of digital media clip files;
associate the digital media clip file with the first collection of digital media clip files based on the correspondence value; and
display the content item along with the content item metadata accessed from the content item attribute database within an interactive graphical user interface.

### Claim 13 (depends on 12)

The non-transitory computer-readable storage medium of claim 12, further comprising instructions that, when executed by the at least one processor, cause the computer device to identify additional digital media clip files within a second collection of digital media clip files within a user account of a content management system based on searching the content item attribute database.

### Claim 14 (depends on 12)

The non-transitory computer-readable storage medium of claim 12, wherein the interactive graphical user interface comprises a selectable option to extract the content item from a web-based environment or an operating system environment.

### Claim 15 (depends on 12)

The non-transitory computer-readable storage medium of claim 12, further comprising instructions that, when executed by the at least one processor, cause the computer device to:
determine that the content metadata comprises a URL of a website;
based on determining that the content metadata comprises a URL, capture additional content items, a layout, and a style currently displayed on the website; and
generate a version of the website that displays the content item with the additional content items such that the version of the website preserves the layout and the style of the website when the content item is captured.

### Claim 16

A system comprising:
at least one processor; and
a non-transitory computer memory comprising instructions that, when executed by the at least one processor, cause the system to:
detect selection of a content item comprising digital content data;
based on detecting the selection of the content item:
extract content metadata for the content item; and
capture contextual signals from one or more active digital environments on a client device at a time of extracting the content item;
generate contextual metadata for the content item based on the contextual signals from the one or more active digital environments; and
generate a digital media clip file by associating the content item comprising the digital content data and the content metadata with the contextual metadata generated from the contextual signals from the one or more active digital environments;
identify a first collection of digital media clip files from a plurality of collections of digital media clip files by determining a correspondence value between the digital media clip file and the first collection of digital media clip files, the correspondence value being determined based on an analysis of:
the content metadata and the contextual metadata of the digital media clip file; and
collection content metadata and collection contextual metadata associated with the first collection of digital media clip files;
associate the digital media clip file with the first collection of digital media clip files based on the correspondence value; and
display the content item along with one or more contextual metadata elements within the first collection of digital media clip files.

### Claim 17 (depends on 16)

The system of claim 16, further comprising instructions that, when executed by the at least one processor, cause the system to generate a second collection of digital media clip files comprising the digital media clip file and one or more additional digital media clip files based on the one or more additional digital media clip files sharing one or more contextual metadata attributes with the contextual metadata of the content item.

### Claim 18 (depends on 16)

The system of claim 16, further comprising instructions that, when executed by the at least one processor, cause the system to display the digital media clip file and the first collection of digital media clip files within an interactive graphical user interface.

### Claim 19 (depends on 18)

The system of claim 18, further comprising instructions that, when executed by the at least one processor, cause the system to generate the contextual metadata based on the contextual signals from the one or more active digital environments comprising an operating system environment, an application environment, or a web-based environment.

### Claim 20 (depends on 16)

The system of claim 16, further comprising instructions that, when executed by the at least one processor, cause the system to identify the content item based on matching a user-provided term with the contextual metadata from the digital media clip file.
