# US 2017/0148491 A1 · Method for creating a 3d model of an object and corresponding model calculation device and model calculation devicd

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0148491 A1
- Document ID: US20170148491A1
- Status: Published application
- Kind: A1
- Application number: 15/116,961
- Filed: 2014-02-06
- Published: 2017-05-25
- Earliest claimed: 2014-02-06
- Assignees: Testo AG
- Applicants: Testo AG
- Inventors: Jan-Friso Evers-Senne; Martin Stratmann; Hellen Altendorf
- Web page: https://patentgrep.com/patent/US20170148491A1

## CPC

- G11B 27/36: Monitoring, i.e. supervising the progress of recording or reproducing {(for digital recording G11B20/00 and s.gr.; for monitoring, testing or measuring of TV recorders of the type covered by H04N5/76 and subgroups, see H04N17/06)}
- G06T 7/55: from multiple images
- G06T 7/564: from contours
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G11B 20/00007: {Time or data compression or expansion (audio compression based on psychoacoustics G10L19/00; data processing for reproducing audio data at different playback speeds G10L21/04; video compression H04N19/00; data compression per se H03M7/30)}
- H04N 5/77: between a recording apparatus and a television camera
- G06T 2200/08: involving all processing steps from image acquisition to 3D model generation
- G06T 2200/16: involving adaptation to the client's capabilities
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10016: Video; Image sequence
- G11B 2020/00072: {the compressed signal including a video signal}
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In a model calculating apparatus (1) according to the invention it is provided, for the purpose of creating a detailed 3D model (20), by a recording device (3), to generate a first video data stream (4) and to generate a reduced video data stream (13) from frames (26) of the first video data stream (4) and to process further these reduced video data stream for the purpose of creating an approximated 3D model (30).

## Claims

### Claim 1

A method for creating a detailed 3D model (20) of an object, comprising using a recording device (3), recording a first video data stream (4) comprising frames (26) from the object and transmitting the first video data stream to an external computing unit (10), and creating the detailed 3D model (30) from the frames (26) of the first video data stream (4) in the external computing unit (10), generating a reduced video data stream (13) from the frames (26) of the first video data stream (4) in a local computing unit (12) connected to the recording device (3), and creating an approximated 3D model (30) of the object from the reduced video data stream (13).

### Claim 2 (depends on 1)

The method as claimed in claim 1, wherein the approximated 3D model (30) is at least one of created or updated during the continued recording of the first video data stream (4), and the approximated 3D model (30) is displayed during the continued recording of the first video data stream (4).

### Claim 3 (depends on 1)

The method as claimed in claim 1, wherein the reduced video data stream (13) is generated by at least one of a reduction of an image resolution of the frames (26) of the first video data stream (4) or by selection of a subset of the frames (26) of the first video data stream (4).

### Claim 4 (depends on 1)

The method as claimed in claim 1, further comprising assembling the reduced video data stream (13) from at least one of reduced or selected frames (28), checking the at least one of reduced or selected frames (28) for usability for creating the approximated 3D model (30) and removing the at least one of the reduced or selected frames from the reduced video data stream (13) in case of a lack of usability.

### Claim 5 (depends on 1)

The method as claimed in claim 1, further comprising calculating at least one point cloud, at least one edge, a surface model, or a combination thereof for creating the approximated 3D model (30) from the reduced video data stream (13).

### Claim 6 (depends on 1)

The method as claimed in claim 1, further comprising calculating at least one of a recording pose, movement or change of pose of the recording device (3) during the recording of the first video data stream (4) from the reduced video data stream (13), and transmitting the calculated recording pose, movement or change of pose of the recording device (3) with the first video data stream (4) to the external computing unit (10).

### Claim 7 (depends on 1)

The method as claimed in claim 1, wherein at least one object-independent secondary condition that reduces a complexity of the object is used for creating the approximated 3D model (30).

### Claim 8 (depends on 1)

The method as claimed in claim 1, further comprising creating the detailed 3D model (20) in an optimization routine for an energy functional, and transmitting the detailed 3D model (20) created by the external computing unit (10) to the local computing unit (12).

### Claim 9

A model calculating device (2), comprising a recording device (3) designed for recording a first video data stream (4) comprising frames (26) from an object, a data interface (8) designed for producing a data connection (29) to an external computing unit (10) and for transmitting the first video data stream (4) via the data connection (29), and a local computing unit (12), the local computing unit (12) is designed for generating a reduced video data stream (13) from the frames (26) of the first video data stream (4) and for creating an approximated 3D model (30) of the object from the reduced video data stream (13).

### Claim 10 (depends on 9)

The model calculating device (2) as claimed in claim 9, wherein the local computing unit (12) is designed for calculating at least one of a recording pose, movement or change of pose of the recording device (3) during the recording of the first video data stream (4) from the reduced video data stream (13).

### Claim 11 (depends on 9)

The model calculating device (2) as claimed in claim 9, further comprising a display unit (19) designed for displaying the created approximated 3D model (30) or the calculated detailed 3D model (20), or both.

### Claim 12 (depends on 9)

The model calculating device (2) as claimed in claim 9, wherein the local computing unit (12) is designed for reducing at least one of an image resolution or an image content by extracting prominent structures of the frames (26) of the first video data stream (4) or selecting a subset of the frames (26) of the first video data stream (4), or both.

### Claim 13 (depends on 9)

The model calculating device (2) as claimed in claim 9, wherein the local computing unit (12) is designed for creating at least one point cloud, at least one edge, a surface model, or a combination thereof from the reduced video data stream (13), or the local computing unit (12) is designed for calculating at least one envelope curve or at least one envelope surface from the reduced video data stream (13).

### Claim 14

(canceled)

### Claim 15 (depends on 9)

A model calculating apparatus (1) comprising a model calculating device (2) as claimed in claim 9, an external computing unit (10) connectable to the model calculating device (2) for data transmission, and the external computing unit (10) is designed for creating a detailed 3D model (20) from the first video data stream (4) transmitted via the data connection (29).

### Claim 16 (depends on 1)

The method as claimed in claim 1, wherein the reduced video data stream (13) is generated by an extraction of prominent structures from the frames (26) of the first video data stream (4).

### Claim 17 (depends on 1)

The method as claimed in claim 1, further comprising carrying out at least one of a plausibility or completeness check for the approximated 3D model (30).

### Claim 18 (depends on 1)

The method as claimed in claim 1, further comprising calculating at least one envelope curve, at least one envelope surface, or a combination thereof from the reduced video data stream (13) for creating the approximated 3D model (30).

### Claim 19 (depends on 9)

The model calculating device as claimed in claim 9, wherein the local computing unit (12) is designed for a correctly timed combination of at least one of a calculated recording pose, movement, or change of pose of the recording device (3) with the first video data stream (4).
