# US 2021/0241510 A1 · Generating textured polygon strip hair from strand-based hair for a virtual character

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241510 A1
- Document ID: US20210241510A1
- Status: Published application
- Kind: A1
- Application number: 17/051,750
- Filed: 2019-05-17
- Published: 2021-08-05
- Earliest claimed: 2018-05-21
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Takashi Kuribayashi
- Web page: https://patentgrep.com/patent/US20210241510A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 7/75: {involving models}
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 15/04: Texture mapping
- G06T 15/205: {Image-based rendering}
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- G06T 2207/30196: Human being; Person
- G06T 2213/08: Animation software package
- G06T 2215/16: Using real world measurements to influence rendering
- G06V 40/16: Human faces, e.g. facial parts, sketches or expressions
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Computer generated (CG) hair for a virtual character can include strand-based (instanced) hair in which many thousands of digital strands represent real human hair strands. Strand-based hair can appear highly realistic, but rendering strand-based hair in real-time presents challenges. Techniques for generating textured polygon strip (poly strip) hair for a virtual character can use as an input previously-generated strand-based hair for the virtual character. Poly strips can be generated for a sampled set of strands in the strand-based hair. Additional poly strips may be generated near hairlines or part lines. Hair textures from a hair texture library can be matched to the poly strips. The matched textures can be scaled and packed into a region of texture space (e.g., a square region), which provides improved computer access, efficiency, and speed. A rendering engine can use the poly strips and the packed hair textures to render the character's hair in real-time.

## Claims

### Claim 1

A system comprising:
non-transitory computer storage configured to store:
strand-based hair data for rendering hair of a virtual avatar, the strand-based hair data comprising strands indicative of shapes of strands of hair and a hair mask region indicative of a region on a head of an avatar where hair is to be generated; and
a library of hair textures, each of the hair textures comprising an image of a hair style, each of the hair textures associated with hair texture properties; and
a hardware processor in communication with the non-transitory computer storage, the hardware process programmed to:
sample the strand-based hair data to obtain a first set of strands in the hair mask region;
determine, from the strand-based hair data, a hairline or a part line;
sample the strand-based hair data to obtain a second set of strands in a region near the hairline or in a region near the part line;
generate a set of polygon strips (poly strips), wherein each poly strip is based on a strand in the first set of strands or the second set of strands, each poly strip comprising at least one polygon, and each poly strip associated with poly strip properties;
match hair textures from the library of hair textures with the set of poly strips to obtain a set of matched hair textures, wherein a matched hair texture is usable to provide texture to at least one poly strip from the set of poly strips, and wherein the matching is based on a matching criterion between a poly strip property and a hair texture property;
pack the set of matched hair textures into a texture space data structure representing a region of texture space; and
output the texture space data structure and the set of poly strips.

### Claim 2

(canceled)

### Claim 3 (depends on 1)

The system of claim 1, wherein the hair texture properties comprise one or more of: a length, a width, a clumpiness, a curliness, a density, or a noise.

### Claim 4 (depends on 1)

The system of claim 1, wherein the poly strip properties comprise one or more of: a length, a width, a clumpiness, a curliness, a density, or a noise.

### Claim 5 (depends on 1)

The system of claim 1, wherein to sample the strand-based hair data, the hardware processor is programmed to perform uniform sampling at a sampling fraction of a total number of strands in the strand-based hair data.

### Claim 6 (depends on 5)

The system of claim 5, wherein the sampling fraction is in a range of 0.01% to 1%.

### Claim 7 (depends on 1)

The system of claim 1, wherein to determine a hairline or a part line, the hardware processor is programmed to perform contour detection.

### Claim 8

(canceled)

### Claim 9 (depends on 1)

The system of claim 1, wherein a central region of each poly strip follows a curvature of the strand on which the poly strip is based.

### Claim 10 (depends on 1)

The system of claim 1, wherein a base point of each poly strip is located at a base point of the strand on which the poly strip is based.

### Claim 11 (depends on 1)

The system of claim 1, where the hardware processor is further programmed to determine an orientation of each poly strip in the set of poly strips.

### Claim 12 (depends on 11)

The system of claim 11, wherein to determine the orientation of the poly strip, the hardware processor is programmed to:
calculate a hair vector representative of an initial direction of the strand on which the poly strip is based;
calculate a reference vector representative of a normal direction to the hair mask region at the base of the strand; and
determine the orientation based on a vector cross product of the hair vector with the reference vector.

### Claim 13 (depends on 1)

The system of claim 1, wherein the hardware processor is further programmed to accept user input to modify an orientation, attribute, or property associated with a poly strip.

### Claim 14

(canceled)

### Claim 15 (depends on 1)

The system of claim 1, wherein to match hair textures, the hardware processor is programmed to apply weightings to hair texture properties and poly strip properties.

### Claim 16

(canceled)

### Claim 17 (depends on 1)

The system of claim 1, where to pack the set of matched hair textures, the hardware processor is programmed to scale each of the matched hair textures based on a scaling factor.

### Claim 18 (depends on 17)

The system of claim 17, wherein the scaling factor comprises an area of the hair texture or a length of the hair texture.

### Claim 19 (depends on 1)

The system of claim 1, wherein to pack the set of matched hair textures, the hardware processor is programmed to apply a two-dimensional (2D) bin packing algorithm.

### Claim 20 (depends on 19)

The system of claim 19, wherein the hardware processor is programmed to:
determine that a matched hair texture is too large to fit into the region of texture space;
expand the region of texture space from an initial size to an expanded size sufficient to fit the matched hair texture;
pack the matched hair texture into the region of texture space having the expanded size; and
rescale the region of texture space from the expanded size to the initial size.

### Claim 21

(canceled)

### Claim 22 (depends on 1)

The system of claim 1, wherein to pack the set of matched hair textures, the hardware processor is programmed to determine a transform for at least one hair textures in the set of matched hair textures.

### Claim 23 (depends on 22)

The system of claim 22, wherein the hardware processor is further programmed to apply the transform to the poly strips that match the at least one hair texture.

### Claim 24

(canceled)

### Claim 25 (depends on 1)

The system of claim 1, wherein to output the texture space data structure and the set of poly strips, the hardware processor is programmed to communicate the texture space data structure and the set of poly strips to a wearable display device.

### Claim 26 (depends on 25)

The system of claim 25, further comprising the wearable display device, and wherein the wearable display device is programmed to render the hair of the virtual avatar based at least partly on the texture space data structure and the set of poly strips.

### Claim at position 27

27-32. (canceled)
