# US 2026/0087805 A1 · Fine-grained video understanding via external memory using neural sampling

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0087805 A1
- Document ID: US20260087805A1
- Status: Published application
- Kind: A1
- Application number: 19/057,427
- Filed: 2025-02-19
- Published: 2026-03-26
- Earliest claimed: 2024-09-25
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Saket Gurukar
- Web page: https://patentgrep.com/patent/US20260087805A1

## CPC

- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06N 3/08: Learning methods
- G06N 3/096: Transfer learning
- G06V 10/82: using neural networks
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A method includes receiving a query at a query module and producing a query module output. The method also includes receiving a video at an external memory module. The method also includes generating a pool of video tokens from the video. The method also includes performing neural sampling to sample the pool of video tokens using a neural sampler in the memory sampling module. The method also includes storing the sampled video tokens in the external memory module. The method also includes providing a response to the query based on the sampled video tokens stored in the external memory module.

## Claims

### Claim 1

A method comprising:
receiving a query at a query module and producing a query module output;
receiving a video at an external memory module;
generating a pool of video tokens from the video;
performing neural sampling to sample the pool of video tokens using a neural sampler in the memory sampling module;
storing the sampled video tokens in the external memory module; and
providing a response to the query based on the sampled video tokens stored in the external memory module.

### Claim 2 (depends on 1)

The method of claim 1, wherein the neural sampler is a differentiable neural sampler configured to discriminately sample the video tokens.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
applying a continual learning loss using a continual learning module to the neural sampler based on the query and a predetermined number of previous queries.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
providing the predetermined number of previous queries from the continual learning module to the query module as input.

### Claim 5 (depends on 3)

The method of claim 3, wherein storing the sampled video tokens in the external memory module comprises storing a position encoding for each of the sampled video tokens.

### Claim 6 (depends on 3)

The method of claim 3, further comprising:
generating a video understanding model based on applying the continual learning loss to the neural sampler and storing the sampled video tokens in the external memory module.

### Claim 7 (depends on 6)

The method of claim 6, wherein the video understanding model is stored on a display device.

### Claim 8

An electronic device, comprising:
at least one processing device configured to:
receive a query at a query module and produce a query module output;
receive a video at an external memory module;
generate a pool of video tokens from the video;
perform neural sampling to sample the pool of video tokens using a neural sampler in the memory sampling module;
store the sampled video tokens in the external memory module; and
provide a response to the query based on the sampled video tokens stored in the external memory module.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein the neural sampler is a differentiable neural sampler configured to discriminately sample the video tokens.

### Claim 10 (depends on 8)

The electronic device of claim 8, wherein the processor is further configured to cause the electronic device to apply a continual learning loss using a continual learning module to the neural sampler based on the query and a predetermined number of previous queries.

### Claim 11 (depends on 10)

The electronic device of claim 10, wherein the processor is configured to cause the electronic device to provide the predetermined number of previous queries from the continual learning module to the query module as input.

### Claim 12 (depends on 10)

The electronic device of claim 10, wherein, to store the sampled video tokens in the external memory module, the at least one processing device is further configured to cause the electronic device to store a position encoding for each of the sampled video tokens.

### Claim 13 (depends on 10)

The electronic device of claim 10, wherein the processor is further configured to cause the electronic device to generate a video understanding model based on applying the continual learning loss to the neural sampler and storing the sampled video tokens in the external memory module.

### Claim 14 (depends on 13)

The electronic device of claim 13, wherein the video understanding model is stored on a display device of the electronic device.

### Claim 15

A non-transitory machine readable medium comprising instructions that when executed by at least one processor of an electronic device, causes the electronic device to:
receive a query at a query module and producing a query module output;
receive a video at an external memory module;
generate a pool of video tokens from the video;
perform neural sampling to sample the pool of video tokens using a neural sampler in the memory sampling module;
store the sampled video tokens in the external memory module; and
provide a response to the query based on the sampled video tokens stored in the external memory module.

### Claim 16 (depends on 15)

The non-transitory machine readable medium of claim 15, wherein the neural sampler is a differentiable neural sampler configured to discriminately sample the video tokens.

### Claim 17 (depends on 15)

The non-transitory machine readable medium of claim 15, wherein the instructions further comprise instructions that, when executed by the at least one processor, cause the electronic device to apply a continual learning loss using a continual learning module to the neural sampler based on the query and a predetermined number of previous queries.

### Claim 18 (depends on 17)

The non-transitory machine readable medium of claim 17, wherein the instructions further comprise instructions that, when executed by the at least one processor, causes the electronic device to provide the predetermined number of previous queries from the continual learning module to the query module as input.

### Claim 19 (depends on 17)

The non-transitory machine readable medium of claim 17, wherein the instructions that, when executed by the at least one processor, causes the electronic device to store the sampled video tokens in the external memory module, comprise instructions, that when executed by the at least one processor, cause the electronic device to store a position encoding for each of the sampled video tokens.

### Claim 20 (depends on 17)

The non-transitory machine readable medium of claim 17, wherein the instructions further comprise instructions that, when executed by the at least one processor, cause the electronic device to generate a video understanding model based on applying the continual learning loss to the neural sampler and storing the sampled video tokens in the external memory module.
