# US 2021/0241045 A1 · Object information collection, classification and analytics via a smart grabber tool

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241045 A1
- Document ID: US20210241045A1
- Status: Published application
- Kind: A1
- Application number: 17/234,550
- Filed: 2021-04-19
- Published: 2021-08-05
- Earliest claimed: 2018-08-20
- Assignees: Rubbish Co.
- Applicants: Rubbish Co.
- Inventors: Felipe MELIVILU; Emin ISRAFIL; Elena GUBERMAN
- Web page: https://patentgrep.com/patent/US20210241045A1

## CPC

- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G06F 18/24: Classification techniques
- G06V 10/17: {using hand-held instruments}
- G06V 30/142: using hand-held instruments; Constructional details of the instruments
- H04N 23/60: Control of cameras or camera modules
- G06F 18/2178: {based on feedback of a supervisor}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A system for object and information collection comprises a handheld tool to grab the object. The handheld tool comprises a trigger, a grabber mechanism, and a switch, wherein a user actuates the trigger to pick up an object with the grabber mechanism, and the switch causes transmission of a capture signal to initiate a classification event. A classification application executing on a processor is responsive to receiving the capture signal to capture information associated with the object and assign an object classification to the object based at least in part on the captured information.

## Claims

### Claim 1

A system for object and information collection, comprising:
a handheld tool to grab the object, the handheld tool comprising:
a trigger, and a grabber mechanism;
a switch, wherein a user actuates the trigger to pick up the object with the grabber mechanism, and the switch causes transmission of a capture signal; and
a classification application executing on a processor responsive to receiving the capture signal to capture information associated with the object and assign an object classification to the object based at least in part on the captured information.

### Claim 2 (depends on 1)

The system of claim 1, wherein the information associated with the object includes metadata or data from one or more sensors including: an altimeter, a pressure sensor, a barometer, a thermometer, a microphone, and an air pollution sensor.

### Claim 3 (depends on 1)

The system of claim 1, wherein the information associated with the object includes a photo captured by a camera, wherein once the classification application receives the capture signal, the classification application causes the camera to automatically capture the photo and the metadata.

### Claim 4 (depends on 3)

The system of claim 3, wherein the camera is integrated with a logic system and the classification application is executed by the logic system.

### Claim 5 (depends on 3)

The system of claim 3, wherein the camera is integrated within a mobile device that is mounted on the handheld tool, and wherein the classification application is executed on the mobile device.

### Claim 6 (depends on 1)

The system of claim 1, wherein the classification application automatically determines and assigns the object classification to the object based on the captured information associated with the object.

### Claim 7 (depends on 1)

The system of claim 1, wherein the classification application assigns the object classification to the object based on manual input of a user.

### Claim 8 (depends on 7)

The system of claim 7, wherein the manual input of the user is made through at least one of a button on a logic system, a selection made on a user interface of the classification application, and voice input.

### Claim 9 (depends on 1)

The system of claim 1, wherein the switch is coupled to the trigger, wherein once a user squeezes the trigger to pick up the object, the switch sends a trigger signal to the logic system to transmit the capture signal.

### Claim 10 (depends on 1)

The system of claim 1, wherein the information and the assigned classification are stored in the memory and transmitted over a network to an analytics cloud service to perform data aggregation and analysis.

### Claim 11

A non-transitory computer-readable medium containing program instructions for object and information collection, which when executed by a processor, the program instructions cause the processor to:
receive a capture signal from a handheld tool, wherein the handheld tool comprises a trigger, a grabber mechanism, and a switch, wherein a user actuates the trigger to pick up the object with the grabber mechanism, and the switch causes transmission of a capture signal to initiate a classification event; and
responsive to the capture signal, capture information associated with the object and assign an object classification to the object based at least in part the captured information.

### Claim 12 (depends on 11)

The executable software product of claim 11, wherein the program instructions are executed on a logic system.

### Claim 13 (depends on 11)

The executable software product of claim 11, wherein the program instructions are executed on a mobile device.

### Claim 14 (depends on 11)

The executable software product of claim 11, wherein the program instructions automatically determine and assign the object classification to the object based on the captured information associated with the object.

### Claim 15 (depends on 11)

The executable software product of claim 11, wherein the program instructions assign the object classification to the object based on manual input of a user.

### Claim 16 (depends on 15)

The executable software product of claim 15, wherein the manual input of the user is made through at least one of a button, a selection made on a user interface displayed by the program instructions, and voice input.

### Claim 17 (depends on 11)

The executable software product of claim 11, wherein the program instructions store the information and the assigned classification in a memory and subsequently transmit the information and the assigned classification over a network to an analytics cloud service via to perform data aggregation and analysis.

### Claim 18

A method for object and information collection, comprising:
receiving a capture signal from a handheld tool, wherein the handheld tool comprises a trigger, a grabber mechanism, and a switch, wherein a user actuates the trigger to pick up an object with the grabber mechanism, and the switch causes transmission of a capture signal; and
responsive to the capture signal, capturing information associated with the object and assigning an object classification to the object based at least in part on the captured information.

### Claim 19 (depends on 18)

The method of claim 18, further comprising:
transmitting at least one of a portion of the information and the assigned object classification over network to an analytics cloud service; and
using, by the analytics cloud service, public data and data submitted by users to track pickup activity and show relative cleanliness of streets, buildings and neighborhoods.

### Claim 20 (depends on 18)

The method of claim 18, further comprising: using, by the analytics cloud service, pickup activity for any combination of:
i) track efficacy of cleanup efforts by comparing how pieces of litter were collected in the same area over time;
ii) automatically create a cleanliness map of streets;
iii) make recommendations for where public fixtures should be located;
iv) make measurement recommendations for more effective street cleaning practices;
v) measure impact of installed or planned public fixtures;
vi) measure litter impact of at least one of public holidays, events, and construction in a community;
vii) find and predict how changes in litter have an effect on at least one of traffic, social media ratings, real estate prices, business income and safety; and
viii) measure efficacy of ashcans/trash cans.

### Claim 21 (depends on 18)

The method of claim 18, further comprising: providing, by the analytics cloud service, a dashboard that allows users to perform at least one of:
i) view their activity such as time spent or amount of litter picked up;
ii) react to user reports and dispatch resources to problem areas;
iii) view pickup events in an area over a specified time;
iv) view local heat maps and trends; and
v) allocate funds to local users to cleanup or engage in another community improvement activities.