# US 2026/0099989 A1 · Integration of video data into image-based dental treatment planning and client device presentation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0099989 A1
- Document ID: US20260099989A1
- Status: Published application
- Kind: A1
- Application number: 19/179,909
- Filed: 2025-04-15
- Published: 2026-04-09
- Earliest claimed: 2024-04-16
- Assignees: Align Technology, Inc.
- Applicants: Align Technology, Inc.
- Inventors: Michael Seeber; Doruk Cetin; Jakub Lucki; Philipp Kopp; Niko Benjamin Huber; Ritika Chakraborty; Sinan Ibrahim Bayraktar; Nicolas Wicki
- Web page: https://patentgrep.com/patent/US20260099989A1

## CPC

- G06T 15/10: Geometric effects
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- A61C 7/002: {Orthodontic computer assisted systems}
- A61C 13/34: Making or working of models, e.g. preliminary castings, trial dentures; Dowel pins [4]
- G06T 7/0012: {Biomedical image inspection}
- G06T 7/50: Depth or shape recovery
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20081: Training; Learning
- G06T 2207/30036: Dental; Teeth
- G06T 2207/30168: Image quality inspection
- G06T 2207/30201: Face
- G06T 2210/41: Medical
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- A61C: DENTISTRY; APPARATUS OR METHODS FOR ORAL OR DENTAL HYGIENE (non-driven toothbrushes A46B; {tongue scrapers A61B17/24;} preparations for dentistry A61K6/00; preparations for cleaning the teeth or mouth A61K8/00, A61Q11/00)

## Abstract

A method includes obtaining video data of a dental patient. The method further includes obtaining an indication of selection criteria in association with the video data. The selection criteria includes conditions related to a target dental treatment of the dental patient. The method further includes performing an analysis procedure on the video data. Performing the analysis procedure includes determining a first score for each frame of the video data based on the selection criteria. Performing the analysis procedure further includes determining that a frame satisfies a first threshold condition based on the first score. The method further includes providing the first frame as output of the analysis procedure.

## Claims

### Claim at position 1

1-50. (canceled)

### Claim 51

A computer-implemented method comprising:
receiving an image or sequence of images comprising a face of an individual that is representative of a current condition of a dental site of the individual;
estimating tooth shape of the dental site from the image or sequence of images to generate a 3D model representative of the dental site;
generating a predicted 3D model corresponding to an altered representation of the dental site; and
modifying the image or sequence of images by rendering the dental site to appear as the altered representation based on the predicted 3D model.

### Claim 52 (depends on 51)

The method of claim 51, further comprising:
receiving an initial 3D model representative of the individual's teeth, the 3D model corresponding to the upper jaw, the lower jaw, or both.

### Claim 53 (depends on 52)

The method of claim 52, further comprising:
encoding the initial 3D model into a latent space vector via a trained machine learning model.

### Claim 54 (depends on 53)

The method of claim 53, wherein the trained machine learning model is a variational autoencoder.

### Claim 55 (depends on 53)

The method of claim 53, wherein the trained machine learning model is trained to predict post-treatment modification of the initial 3D model and generate the predicted 3D model from the predicted post-treatment modification.

### Claim 56 (depends on 52)

The method of claim 52, further comprising:
segmenting the image or sequence of images to identify teeth within the image or sequence of images to generate segmentation data, wherein the segmentation data is representative of shape and position of each identified tooth.

### Claim 57 (depends on 56)

The method of claim 56, further comprising:
fitting the 3D model to the image or sequence of images based on the segmentation data by applying a non-rigid fitting algorithm.

### Claim 58 (depends on 57)

The method of claim 57, wherein the non-rigid fitting algorithm comprises contour-based optimization to fit the teeth of the 3D model to the teeth identified in the segmentation data.

### Claim at position 10

59-80. (canceled)

### Claim 81

A computer-implemented method comprising:
receiving a video comprising a face of an individual that is representative of a current condition of a dental site of the individual;
generating a 3D model representative of the head of the individual based on the video; and
estimating tooth shape of the dental site from the video, wherein the 3D model comprises a representation of the dental site based on the tooth shape estimation.

### Claim 82 (depends on 81)

The method of claim 81, further comprising:
generating a predicted 3D model corresponding to an altered representation of the dental site by modifying the 3D model to alter the representation of the dental site.

### Claim 83 (depends on 82)

The method of claim 82, further comprising:
encoding the 3D model into a latent space vector via a trained machine learning model, wherein the trained machine learning model is a variational autoencoder.

### Claim 84 (depends on 83)

The method of claim 83, wherein the trained machine learning model is trained to predict post-treatment modification of the 3D model and generate the predicted 3D model from the predicted post-treatment modification.

### Claim 85 (depends on 81)

The method of claim 81, further comprising:
segmenting one or more of a plurality of frames of the video to detect teeth of the individual's dental site, wherein estimating tooth shape comprises applying a non-rigid fitting algorithm comprising contour-based optimization to fit the teeth of the 3D model to the teeth identified in the segmentation.

### Claim 86 (depends on 82)

The method of claim 82, further comprising:
generating a video comprising renderings of the predicted 3D model.

### Claim 87 (depends on 81)

The method of claim 81, further comprising:
generating a video comprising renderings of the 3D model.

### Claim 88 (depends on 84)

The method of claim 84, further comprising:
receiving a driver sequence comprising a plurality of animation frames, each frame comprising a representation that defines the position, orientation, shape, and expression of a face;
animating the 3D model or the predicted 3D model based on the driver sequence; and
generating a video for display based on the animated 3D model.

### Claim 89

(canceled)

### Claim 90

(canceled)

### Claim 91

A method comprising:
obtaining, by a processing device, video data of a dental patient comprising a plurality of frames;
obtaining an indication of first selection criteria in association with the video data, wherein the first selection criteria comprise one or more conditions related to a target dental treatment of the dental patient;
performing an analysis procedure on the video data, wherein performing the analysis procedure comprises:
determining a respective first score for each of the plurality of frames based on the first selection criteria, and
determining that a first frame of the plurality of frames satisfies a first threshold condition based on the first score; and
selecting the first frame responsive to determining that the first frame satisfies the first threshold condition.

### Claim 92 (depends on 91)

The method of claim 91, wherein the analysis procedure further comprises:
determining that a second frame of the plurality of frames satisfies a first criterion of the first selection criteria;
determining that a third frame of the plurality of frames satisfies a second criterion of the first selection criteria; and
generating the first frame based on a portion of the second frame associated with the first criterion and a portion of the third frame associated with the second criterion.

### Claim 93 (depends on 91)

The method of claim 91, wherein the analysis procedure further comprises:
determining that a second frame of the plurality of frames satisfies a first criterion of the first selection criteria;
determining that the second frame does not satisfy a second criterion of the first selection criteria;
providing the second frame to a trained machine learning model; and
obtaining the first frame from the trained machine learning model, wherein the first frame is based on the second frame, satisfies the first criterion, and satisfies the second criterion.

### Claim 94 (depends on 91)

The method of claim 91, wherein the analysis procedure further comprises:
generating, based on the video data, a three-dimensional model of the dental patient; and
rendering the first frame based on the three-dimensional model.

### Claim 95 (depends on 91)

The method of claim 91, wherein the indication of the first selection criteria comprises a reference image, wherein a score of the reference image in association with the first selection criteria satisfies the first threshold condition.

### Claim 96 (depends on 91)

The method of claim 91, further comprising:
obtaining an indication of second selection criteria;
wherein the analysis procedure further comprises:
determining a respective second score for each of the plurality of frames based on the second selection criteria; and
determining that a second frame satisfies a second threshold condition based on the second score; and
selecting the second frame responsive to determining that the second frame satisfies the second threshold condition.

### Claim 97 (depends on 91)

The method of claim 91, wherein the first selection criteria comprise values associated with one or more of:
head orientation;
visible tooth identities;
visible tooth area;
bite position;
emotional expression; or
gaze direction.

### Claim 98 (depends on 91)

The method of claim 91, wherein the video data comprises a first portion obtained at a first time and a second portion obtained at a second time, the second portion comprising the first frame, and wherein the analysis procedure further comprises:
determining that scores associated with each of the frames of the first portion do not satisfy the first threshold; and
providing an alert to a user indicating one or more criteria of the first selection criteria to be included in the second portion.

### Claim at position 29

99-118. (canceled)

### Claim 119 (depends on 51)

A system comprising:
a memory; and
a processing device operatively coupled to the memory, wherein the processing device is configured to perform the method of claim 51.

### Claim 120 (depends on 51)

A non-transitory machine-readable medium having instructions encoded thereon that, when executed by a processing device, cause the processing device to perform the method of claim 51.

### Claim 121 (depends on 81)

A system comprising:
a memory; and
a processing device operatively coupled to the memory, wherein the processing device is configured to perform the method of claim 81.

### Claim 122 (depends on 81)

A non-transitory machine-readable medium having instructions encoded thereon that, when executed by a processing device, cause the processing device to perform the method of claim 81.

### Claim 123 (depends on 91)

A system comprising:
a memory; and
a processing device operatively coupled to the memory, wherein the processing device is configured to perform the method of claim 91.

### Claim 124 (depends on 91)

A non-transitory machine-readable medium having instructions encoded thereon that, when executed by a processing device, cause the processing device to perform the method of claim 91.
