# US 11,113,808 B2 · System and method for assessing quality of produce

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,113,808 B2
- Document ID: US11113808B2
- Status: Granted
- Kind: B2
- Application number: 16/745,195
- Filed: 2020-01-16
- Published: 2020-08-06
- Granted: 2021-09-07
- Earliest claimed: 2019-02-04
- Assignees: Walmart Apollo, LLC
- Applicants: Walmart Apollo, LLC
- Inventors: Mangesh N. Kulkarni Wadhonkar; Parul Aggarwal; Anika Setia; Akshay Jindal; Rahul Kumar; Amit Jhunjhunwala; Artur A. Grochala
- Web page: https://patentgrep.com/patent/US11113808B2

## CPC

- G06Q 10/06395: {Quality analysis or management}
- G01N 33/025: {Fruits or vegetables}
- G06F 18/2431: Multiple classes
- G06T 7/001: {using an image reference approach}
- G06V 30/19173: {Classification techniques}
- G06V 30/194: References adjustable by an adaptive method, e.g. learning
- G06V 30/2247: {Characters composed of bars, e.g. CMC-7}
- G10L 25/51: for comparison or discrimination
- G06T 2207/30128: Food products
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

In some embodiments, apparatuses and methods are provided herein useful to assess quality of produce at a facility. In some embodiments, there is provided a system for assessing quality of produce at a facility including a produce assessment station configured to provide a staging area to determine a quality classification of a target produce. By one approach, the produce assessment station includes a fixed surface; a rotatable base, a first arm comprising a microphone; a second arm comprising a tapping device; and a local control circuit. In one configuration, the local control circuit configured to rotate the rotatable base at a particular angle and at a particular time interval and receive audio data from the microphone. By one approach, the system includes a plurality of sensors and a portable device configured to provide a signal to the local control circuit to initiate the quality classification of the target produce.

## Claims

### Claim 1

A system for assessing quality of produce at a facility comprising:
a produce assessment station configured to provide a staging area to determine a quality classification of a target produce and comprising:
a fixed surface;
a rotatable base disposed on the fixed surface and configured to:
rotate on an axis; and
secure the target produce when on the rotatable base;
a first arm coupled to the fixed surface and comprising a microphone;
a second arm comprising a tapping device; and
a local control circuit configured to control and couple to the rotatable base, the
first arm, and the second arm, the local control circuit configured to:
periodically rotate the rotatable base at a particular angle and at a particular time interval in multiple rotations until the target produce has been rotated in substantially a full circle, wherein the particular angle and the particular time interval are programmed to the local control circuit to automatically rotate the rotatable base periodically; and
receive audio data from the microphone, wherein the audio data corresponds to sound created by the tapping device contacting the target produce at each periodic rotation;
a plurality of sensors coupled to the local control circuit, wherein each of the plurality of sensors is configured to:
capture one or more images of the target produce at different side view of the target produce while on the rotatable base; and
provide the one or more images to the local control circuit; and
a portable device wirelessly coupled to the local control circuit, the portable device configured to provide a signal to the local control circuit to initiate the quality classification of the target produce.

### Claim 2 (depends on 1)

The system of claim 1, further comprising:
a database storing a plurality of classifications associated with a reference produce and a plurality of set of attributes associated with the plurality of classifications, wherein each classification of the plurality of classifications is associated with a particular set of attributes of the plurality of set of attributes, wherein the particular set of attributes is associated with a particular classification of the reference produce; and wherein the attributes comprise a digital representation of a particular sound created by the reference produce being tapped by the tapping device, geographical data, color of a ground spot, weight, and density associated with the reference produce having the particular classification; and
a remote control circuit coupled to the portable device, the remote control circuit configured to:
process the audio data and the one or more images received from the portable device;
determine a set of target attributes associated with the target produce based on the processed audio data and one or more images;
determine a corresponding classification of the plurality of classifications stored in the database based on the set of target attributes; and
provide the corresponding classification to the portable device.

### Claim 3 (depends on 2)

The system of claim 2, wherein the corresponding classification of the target produce is used by a user of the portable device to group the target produce with other produce having the same corresponding classification at a facility associated with a retail store, wherein one or more resulting groups of produce are accepted or rejected by the user, and wherein classifications of the one or more resulting groups of produce is based on a quality assessment associated with the facility.

### Claim 4 (depends on 2)

The system of claim 2, wherein the target produce comprises a watermelon, wherein the plurality of classifications may be based on at least one of a degree of ripeness, scorability, and internal defects, wherein the internal defects comprise a hollow heart, an internal bruise, and a second growth, and wherein the scorability is associated with a magnitude of the internal defects.

### Claim 5 (depends on 2)

The system of claim 2, wherein the geographical data comprise geographic location, harvest date, weather, originating farm, and transport temperature from the originating farm to a facility.

### Claim 6 (depends on 5)

The system of claim 5, wherein the geographical data is associated with a Quick Response (QR) code associated the target produce.

### Claim 7 (depends on 1)

The system of claim 1, wherein the local control circuit is further configured to continually rotate the rotatable base until the target produce has been rotated in a full circle.

### Claim 8 (depends on 1)

The system of claim 1, further comprising:
a first base movably mounted on the fixed surface, wherein the first arm is coupled to the fixed surface via the first base; and
a second base movably mounted on the fixed surface, wherein the second arm is coupled to the fixed surface via the second base.

### Claim 9 (depends on 8)

The system of claim 8, wherein the second base comprises a first base sensor configured to provide a first distance data between the second base and the target produce, wherein the local control circuit is further configured to:
determine a first distance between the second base and the target produce based on the first distance data from the first base sensor; and
in response to the determination of the first distance, move the second base relative to the target produce by a second distance that substantially maintains a first predetermined distance between the second base and the target produce.

### Claim 10 (depends on 8)

The system of claim 8, wherein the first base comprise a second base sensor configured to provide a second distance data between the first base and the target produce, wherein the local control circuit is further configured to:
determine a third distance between the first base and the target produce based on the second distance data from the second base sensor; and
in response to the determination of the third distance, move the first base relative to the target produce by a fourth distance that substantially maintains a second predetermined distance between the first base and the target produce.

### Claim 11 (depends on 1)

The system of claim 1, wherein the local control circuit at the particular angle and at the particular time interval is further configured to:
initiate the tapping device to tap the target produce; and
initiate at least one of the plurality of sensors to capture the one or more images of the target produce.

### Claim 12

A method for assessing quality of produce at a facility comprising:
rotating periodically, by a local control circuit of a produce assessment station, a rotatable base at a particular angle and at a particular time interval in multiple rotations until a target produce has been rotated in substantially a full circle, wherein the particular angle and the particular time interval are programmed to the local control circuit to automatically rotate the rotatable base periodically, and wherein the produce assessment station is configured to provide a staging area to determine a quality classification of the target produce and comprises:
a fixed surface;
the rotatable base disposed on the fixed surface and configured to: rotate on an axis;
and secure the target produce on the rotatable base;
a first arm coupled to the fixed surface and comprising a microphone;
a second arm coupled to the fixed surface and comprising a tapping device; and
the local control circuit configured to control and couple to the rotatable base, the first arm, and the second arm;
initiating, by the local control circuit, the tapping device to tap the target produce;
initiating, by the local control circuit, at least one of a plurality of sensors associated with the produce assessment station to capture one or more images of the target produce; and
receiving, by the local control circuit, audio data from the microphone, wherein the audio data corresponds to sound created by the tapping device contacting the target produce at each periodic rotation.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
capturing, by the plurality of sensors, the one or more images of the target produce at different side view of the target produce while on the rotatable base;
providing, by the plurality of sensors, the one or more images to the local control circuit; and
providing, by a portable device wirelessly coupled to the local control circuit, a signal to the local control circuit to initiate the quality classification of the target produce.

### Claim 14 (depends on 12)

The method of claim 12, further comprising:
processing, by a remote control circuit coupled to a portable device, the audio data and the one or more images received from the portable device;
accessing, by the remote control circuit, a database storing a plurality of classifications associated with a reference produce and a plurality of a set of attributes associated with the plurality of classifications, wherein each classification of the plurality of classifications is associated with a particular set of attributes of the plurality of a set of attributes, wherein the particular set of attributes is associated with a particular classification of the reference produce; and wherein the attributes comprise a digital representation of a particular sound created by the reference produce being tapped by the tapping device, geographical data, color of a ground spot, weight, and density associated with the reference produce having the particular classification;
determining, by the remote control circuit, a set of target attributes associated with the target produce based on the processed audio data and one or more images;
determining, by the remote control circuit, a corresponding classification of the plurality of classifications stored in the database based on the set of target attributes; and
providing, by the remote control circuit, the corresponding classification to the portable device.

### Claim 15 (depends on 14)

The method of claim 14, wherein the corresponding classification of the target produce is used by a user of the portable device to group the target produce with other produce having the same corresponding classification at a facility associated with a retail store, wherein one or more resulting groups of produce are accepted or rejected by the user, and wherein classifications of the one or more resulting groups of produce is based on a quality assessment associated with the facility.

### Claim 16 (depends on 14)

The method of claim 14, wherein the target produce comprises a watermelon, wherein the plurality of classifications may be based on at least one of a degree of ripeness, scorability, and internal defects, wherein the internal defects comprise hollow heart, internal bruise, and second growth, and wherein the scorability is associated with a magnitude of the internal defects.

### Claim 17 (depends on 14)

The method of claim 14, wherein the geographical data comprise geographic location, harvest date, weather, originating farm, and transport temperature from the originating farm to a facility.

### Claim 18 (depends on 17)

The method of claim 17, wherein the geographical data is associated with a Quick Response (QR) code associated the target produce.

### Claim 19 (depends on 12)

The method of claim 12, further comprising continually rotating, by the local control circuit, the rotatable base until the target produce has been rotated in a full circle.

### Claim 20 (depends on 12)

The method of claim 12, further comprising:
determining, by the local control circuit, a first distance between a second base and the target produce based on a first distance data from a first base sensor of the second base, wherein the first base sensor is configured to provide the first distance data between the second base and the target produce, wherein the produce assessment station further comprises the second base movably mounted on the fixed surface, and wherein the second arm is coupled to the fixed surface via the second base; and
in response to the determining of the first distance, moving, by the local control circuit, the second base relative to the target produce by a second distance that substantially maintains a first predetermined distance between the second base and the target produce.

### Claim 21 (depends on 12)

The method of claim 12, further comprising:
determining, by the local control circuit, a third distance between a first base and the target produce based on a second distance data from a second base sensor of the first base, wherein the second base sensor is configured to provide the second distance data between the first base and the target produce, wherein the produce assessment station further comprises the first base movably mounted on the fixed surface, and wherein the second arm is coupled to the fixed surface via the second base; and
in response to the determining of the third distance, moving, by the local control circuit, the first base relative to the target produce by a fourth distance that substantially maintains a second predetermined distance between the first base and the target produce.

### Claim 22 (depends on 13)

The method of claim 13, wherein each sensor of the plurality of sensors captures a side view different from side views captured by other sensors of the plurality of sensors.

### Claim 23 (depends on 22)

The method of claim 22, wherein the one or more images are captured at each periodic rotation.