# US 2021/0341902 A1 · Method for computer assistance in the management of a production line

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0341902 A1
- Document ID: US20210341902A1
- Status: Published application
- Kind: A1
- Application number: 17/273,051
- Filed: 2019-09-06
- Published: 2021-11-04
- Earliest claimed: 2018-09-06
- Assignees: Sidel Participations
- Applicants: Sidel Participations
- Inventors: Anthony BARRE
- Web page: https://patentgrep.com/patent/US20210341902A1

## CPC

- G05B 19/409: characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters (G05B19/408, G05B19/4093 take precedence)
- G05B 19/4063: Monitoring general control system (G05B19/4062 takes precedence)
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G05B 2219/23148: Helmet display, mounted on head of operator
- G05B 2219/24012: Use camera of handheld device, head mounted display
- G05B 2219/32014: Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The present invention relates to a method for computer assistance in the management of a production line. In the method a portable terminal executes and displays a human-machine interface (HMI), and the terminal visualizes through display means at least one module of said production line. The method performs a geographical localization of said terminal within a three-dimensional reference frame centered on said production line and determining the position of said terminal with respect to said module. The method also displays via said display means in superimposition a virtual model limited to said module as a function of said determined position of said terminal.

## Claims

### Claim 1

A method for computer assistance in the management of a production line (1), in which, furthermore:
a portable terminal (3) executes and displays a human-machine interface (HMI) (4);
said terminal (3) shows, by way of display means, at least one module (2) of said production line (1);
wherein it comprises at least the following steps:
geographically locating said terminal (3) within a three-dimensional frame of reference (5) centered on said production line (1) and determining the position of said terminal (3) with respect to said module (2);
displaying, via said display means and in superposition, a virtual model (7) limited to said module (2) according to said determined position of said terminal (3).

### Claim 2 (depends on 1)

The assistance method as claimed in claim 1, wherein the position of said terminal (3) is determined by means of at least one three-dimensional position sensor (8) connected to said terminal (3).

### Claim 3 (depends on 2)

The assistance method as claimed in claim 2, wherein the orientation of said terminal (3) is determined by way of at least a first and a second three-dimensional position sensor (8) which are spaced apart from each other and are connected to said terminal (3).

### Claim 4 (depends on 1)

The assistance method as claimed in claim 1, wherein said display means comprise a screen and a video stream of said module (2) is captured and is displayed by way of said screen.

### Claim 5 (depends on 1)

The assistance method as claimed in claim 1, wherein said display means comprise a translucent surface and said limited virtual model (7) is holographically displayed on said translucent surface.

### Claim 6 (depends on 1)

The assistance method as claimed in claim 1, wherein said frame of reference (5) is centered by positioning at least two transmitting/receiving bases (6) so as to be spaced apart from each other and located on said production line (1).

### Claim 7 (depends on 2)

The assistance method as claimed in claim 2, wherein said display means comprise a screen and a video stream of said module (2) is captured and is displayed by way of said screen.

### Claim 8 (depends on 3)

The assistance method as claimed in claim 3, wherein said display means comprise a screen and a video stream of said module (2) is captured and is displayed by way of said screen.

### Claim 9 (depends on 2)

The assistance method as claimed in claim 2, wherein said display means comprise a translucent surface and said limited virtual model (7) is holographically displayed on said translucent surface.

### Claim 10 (depends on 3)

The assistance method as claimed in claim 3, wherein said display means comprise a translucent surface and said limited virtual model (7) is holographically displayed on said translucent surface.

### Claim 11 (depends on 2)

The assistance method as claimed in claim 2, wherein said frame of reference (5) is centered by positioning at least two transmitting/receiving bases (6) so as to be spaced apart from each other and located on said production line (1).

### Claim 12 (depends on 3)

The assistance method as claimed in claim 3, wherein said frame of reference (5) is centered by positioning at least two transmitting/receiving bases (6) so as to be spaced apart from each other and located on said production line (1).

### Claim 13 (depends on 4)

The assistance method as claimed in claim 4, wherein said frame of reference (5) is centered by positioning at least two transmitting/receiving bases (6) so as to be spaced apart from each other and located on said production line (1).

### Claim 14 (depends on 5)

The assistance method as claimed in claim 5, wherein said frame of reference (5) is centered by positioning at least two transmitting/receiving bases (6) so as to be spaced apart from each other and located on said production line (1).
