# US 2021/0276751 A1 · Method and device for orienting an umbilicated fruit, in particular for packaging same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0276751 A1
- Document ID: US20210276751A1
- Status: Published application
- Kind: A1
- Application number: 16/095,847
- Filed: 2017-04-24
- Published: 2021-09-09
- Earliest claimed: 2016-04-28
- Assignees: Maf Agrobotic
- Applicants: Maf Agrobotic
- Inventors: Philippe BLANC
- Web page: https://patentgrep.com/patent/US20210276751A1

## CPC

- B65B 35/58: Turning articles by positively-acting means, e.g. to present labelled portions in uppermost position
- B65B 25/04: Packaging fruit or vegetables
- B65B 57/14: and operating to control, or stop, the feed of articles or material to be packaged
- G01N 21/01: Arrangements or apparatus for facilitating the optical investigation
- G01N 21/8901: {Optical details; Scanning details (per se G02B)}
- G01N 33/025: {Fruits or vegetables}
- G01N 21/251: {Colorimeters; Construction thereof}
- G01N 2021/0187: {Mechanical sequence of operations}
- G01N 2021/1765: {Method using an image detector and processing of image signal}
- G01N 2021/177: {Detector of the video camera type}
- G01N 2021/845: {Objects on a conveyor}
- G01N 2021/8466: {Investigation of vegetal material, e.g. leaves, plants, fruits}
- B65B: MACHINES, APPARATUS OR DEVICES FOR, OR METHODS OF, PACKAGING ARTICLES OR MATERIALS; UNPACKING (bundling and pressing devices for cigars A24C1/44; devices for tensioning and securing binders adapted to be supported by the article or articles to be bound B25B25/00; applying closure members to bottles, jars or similar containers B67B1/00-B67B6/00; concurrent cleaning, filling and closing of bottles B67C7/00; emptying bottles, jars, cans, casks, barrels or similar containers B67C9/00)
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)

## Abstract

The invention relates to a method and device for orienting an umbilicated fruit, in which, during a first orientation phase (22), the presence of at least a portion of an umbilicus is detected in at least one initial image (II), then the fruit is driven (24) in spinning rotation about a first axis of rotation at an angular amplitude of between 5° and 45°, and then the presence of at least a portion of an umbilicus is detected in at least one subsequent image (IU). If at least a portion of an umbilicus is detected in at least one initial image (II) and no longer detected in each subsequent image (IU), the first orientation phase is stopped and the method is continued,

## Claims

### Claim at position 1

1/ Method for orienting an umbilicated fruit, comprising the steps of:
during a first orientation phase the fruit is supported and set into spinning rotation about a first axis of rotation;
during a second subsequent orientation phase the fruit is supported and set into spinning rotation about a second axis of rotation orthogonal to the first axis of rotation;
an optical analysis of an upper surface of the fruit is carried out at least during at least part of the first orientation phase using at least one camera, disposed above the fruit, capturing images of said upper surface of the fruit, said images being transmitted to an image processing unit adapted to analyse said images and to produce optical analysis results depending on the orientation of the fruit;
the rotation of the fruit about each of the two axes of rotation is controlled as a function at least of said optical analysis results of the fruit; characterised in that:
the first orientation phase comprises the following steps:
an initial optical analysis step, during which:
at least one image, named initial image, of the fruit is captured on an optical image capturing axis not parallel to the first axis of rotation;
each initial image is analysed by optical analysis, with the presence of at least one portion of an umbilicus being detected in each initial image;
then a rotation step, during which the fruit is set into spinning rotation about the first axis of rotation at an angular amplitude between 5° and 45°;
then a subsequent optical analysis step, during which:
at least one image, named subsequent image, of the fruit is captured on the same optical image capturing axis as the initial image;
each subsequent image is analysed by optical analysis, with the presence of at least one portion of an umbilicus being detected in each subsequent image;
the processing unit executes a step of conditional decision-making, according to which, if a first condition is met by the optical analysis results of each initial image and of each subsequent image, the first orientation phase is stopped and the method is continued, said first condition being met if at least one portion of an umbilicus is detected in at least one initial image and is no longer detected in each subsequent image.

### Claim at position 2 (depends on 1)

2/ Method according to claim 1, characterised in that wherein, if said first condition is not met, the steps of rotation and of subsequent optical analysis of the first orientation phase are repeated, then the step of conditional decision-making is repeated by the processing unit by considering the subsequent image, captured before repeating the steps of rotation and of subsequent optical analysis, as an initial image.

### Claim at position 3 (depends on 2)

3/ Method according to claim 2, characterised in that wherein, according to the step of conditional decision-making:
if at least one portion of an umbilicus is detected in at least one initial image and in at least one subsequent image, the steps of rotation and of subsequent optical analysis of the first orientation phase are repeated;
if at least one portion of an umbilicus is not detected either in each initial image or in each subsequent image, the steps of rotation and of subsequent optical analysis of the first orientation phase are repeated, as long as the total angular amplitude of the rotation of the fruit resulting from the various steps of rotation carried out during the first orientation phase is below a predetermined angular amplitude, named maximum rotation amplitude, between 180° and 360°, particularly of the order of 270°;
if at least one portion of an umbilicus is not detected either in each initial image or in each subsequent image, the steps of rotation and of subsequent optical analysis of the first orientation phase are repeated, and if the total angular amplitude of the rotation of the fruit resulting from the various steps of rotation previously carried out during the first orientation phase is greater than or equal to said maximum rotation amplitude, the first orientation phase is stopped and the method is continued;
if at least one portion of an umbilicus is not detected in each initial image but is detected in at least one subsequent image, the steps of rotation and of subsequent optical analysis of the first orientation phase are repeated, then the step of conditional decision-making is repeated by the processing unit by considering the subsequent image, captured before repeating the steps of rotation and of subsequent optical analysis, as an initial image.

### Claim at position 4 (depends on 1)

4/ Method according to claim 1, wherein said optical image capturing axis is at least substantially orthogonal to the first axis of rotation.

### Claim at position 5 (depends on 1)

5/ Method according to claim 1, wherein the first axis of rotation is contained in a horizontal plane and the second axis of rotation is vertical.

### Claim at position 6 (depends on 1)

6/ Method according to claim 1, wherein said step of initial optical analysis comprises the detection of a centre of the fruit in at least one initial image, and, if at least one portion of an umbilicus is detected in at least one initial image, during the subsequent rotation step the fruit is set into rotation in a direction that is determined by the respective detected positions of the centre of the fruit and of the umbilicus, and is selected to minimise the angular movement amplitude of the umbilicus towards a plane, named first orientation plane, containing the first axis of rotation and not parallel to the optical image capturing axis.

### Claim at position 7 (depends on 1)

7/ Method according to claim 1, wherein, during each optical analysis step, at least one image, named infrared image, is captured using at least one infrared camera, and the presence of at least one portion of an umbilicus is detected in each infrared image in the form of a spot having a grey scale that is higher than a predetermined grey scale and is smaller than that of the fruit but is larger than a predetermined dimension.

### Claim at position 8 (depends on 1)

8/ Method according to claim 1, wherein the second axis of rotation is perpendicular to a plane, named first orientation plane, containing the first axis of rotation and not parallel to the optical image capturing axis.

### Claim at position 9 (depends on 1)

9/ Method according to claim 1, wherein, at the end of the first orientation phase, the processing unit:
identifies the last captured image, in which at least one portion of an umbilicus is detected by optical analysis, determines the position of a centre of the fruit in this last image, and computes the value of an angle, named azimuth (γ), formed between the first axis of rotation and an axis, named umbilical axis, passing through the umbilicus and the centre of the detected fruit;
then commands a rotation of the fruit about the second axis of rotation during the second orientation phase at an angular amplitude that is determined by the computed azimuth value, so as to orient the umbilical axis at a predetermined orientation relative to the first axis of rotation.

### Claim at position 10 (depends on 1)

10/ Method according to claim 1, wherein said method comprises, after the second orientation phase, a subsequent orientation phase, during which:
the fruit is supported and set into rotation over an angular rotation amplitude of at least 360° about the first axis of rotation;
an optical analysis of an upper surface of the fruit is carried out to detect a portion of said upper surface, named most colourful portion, having a maximum amount of colour;
the rotation of the fruit is interrupted so as to place said most colourful portion on top.

### Claim at position 11 (depends on 1)

11/ Method according to claim 1, for orienting a stalked fruit, wherein said method comprises, after the second orientation phase, a step of morphological optical analysis adapted to allow the position of a stalk of the fruit to be detected.

### Claim at position 12 (depends on 11)

12/ Method according to claim 11, wherein said method comprises, after the step of morphological optical analysis, a subsequent step of rotation, during which the fruit is set into rotation about the second axis of rotation at a determined angular amplitude for placing the stalk in a predetermined angular position relative to the first axis of rotation.

### Claim at position 13 (depends on 1)

13/ Device for orienting an umbilicated fruit, comprising:
a first fruit support adapted to support a fruit and to set it into spinning rotation about a first axis of rotation;
a second fruit support adapted to support a fruit and to set it into spinning rotation about a second axis of rotation orthogonal to the first axis of rotation;
a device for optically analysing an upper surface of the fruit, comprising at least one camera disposed above the fruit in order to be able to capture images of said upper surface of the fruit;
a programmable processing unit adapted to:
analyse the images and to produce optical analysis results dependent on the orientation of the fruit;
control the rotation of the fruit about each of the two axes of rotation as a function at least of said optical analysis results of the fruit;
said programmable processing unit is programmed to implement an orientation method according to claim 1.

### Claim at position 14 (depends on 1)

14/ Method for packaging umbilicated fruit in cellular packages, wherein each fruit is placed in a packaging cell at a predetermined orientation, wherein said method comprises a method for orienting each fruit according to claim 1.

### Claim at position 15 (depends on 13)

15/ Device for packaging umbilicated fruit, comprising devices for orienting fruit and at least one fruit handling robot that is adapted to place each fruit in a cell of a cellular package at a predetermined orientation, wherein said device comprises at least one orientation device according to claim 13.

### Claim at position 16 (depends on 1)

16/ Computer program comprising computer program code instructions, wherein said computer program comprises programming means that can be read by a programmable processing unit and that are adapted to, once executed by said programmable processing unit, execute an orientation method according to claim 1 with said programmable processing unit and with a device for orienting each fruit that is adapted to support and set each fruit into spinning rotation about said first axis of rotation and about said second axis of rotation.

### Claim at position 17 (depends on 14)

17/ Computer program comprising computer program code instructions, wherein said computer program comprises programming means that can be read by a programmable processing unit and that are adapted to, once executed by said programmable processing unit, execute a packaging method according to claim 14 with said programmable processing unit and with a device for orienting each fruit that is adapted to support and set each fruit into spinning rotation about said first axis of rotation and about said second axis of rotation.