# US 2024/0177222 A1 · Item level data determination device, method, and non-transitory computer-readable media

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0177222 A1
- Document ID: US20240177222A1
- Status: Published application
- Kind: A1
- Application number: 18/435,437
- Filed: 2024-02-07
- Published: 2024-05-30
- Earliest claimed: 2021-03-08
- Assignees: Capital One Services, LLC
- Applicants: Capital One Services, LLC
- Inventors: Brice Elder; Aditya Pai; Sarah Olsen
- Web page: https://patentgrep.com/patent/US20240177222A1

## CPC

- G06Q 30/0635: {replenishment orders; recurring orders}
- G06Q 30/012: Providing warranty services
- G06Q 30/0639: {Locating goods or services, e.g. based on physical position of the goods or services within a shopping facility}
- G06Q 30/0643: {graphically representing goods, e.g. 3D product representation}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

Systems, methods, apparatuses, and computer-readable media are provided for determining individual item-level details associated with a transaction. A plurality of purchase transactions associated with different merchants may be displayed via a user interface. Responsive to a user selection of a first transaction, of the plurality of transactions, a camera may capture an image of at least a portion of a user receipt associated with the first transaction. The image of the user receipt may be analyzed using one or more optical character recognition (OCR) algorithms to convert the image of the user receipt into textual data. One or more character strings associated with line item-level details may be extracted from the textual data associated with the first transaction. Additional information associated with the line item details may be determined and the line item details and the additional information may be displayed via a user interface.

## Claims

### Claim 1

A mobile computing device comprising:
a display device;
a camera;
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the mobile computing device to:
cause, responsive to a user selection of a transaction from a plurality of purchase transactions and based on a detection that a user receipt is focused within one or more receipt guides, the camera to automatically capture an image that comprises at least a portion of the user receipt, wherein the user receipt is associated with the selected transaction;
process the image using one or more computer vision techniques to determine one or more line items associated with the transaction; and
output, via a user interface of the mobile computing device, the one or more line items associated with the transaction.

### Claim 2 (depends on 1)

The mobile computing device of claim 1, wherein the instructions, when executed by the one or more processors, further cause the mobile computing device to:
prior to causing the camera to automatically capture the image, receive, via the user interface, the user selection of the transaction from the plurality of purchase transactions.

### Claim 3 (depends on 1)

The mobile computing device of claim 1, wherein the instructions, when executed by the one or more processors, further cause the mobile computing device to:
converting the image of the user receipt to textual data.

### Claim 4 (depends on 3)

The mobile computing device of claim 3, wherein the instructions, when executed by the one or more processors, further cause the mobile computing device to:
parsing the textual data of the user receipt to identify one or more character strings that correspond to the one or more line items associated with the transaction.

### Claim 5 (depends on 3)

The mobile computing device of claim 3, wherein the instructions, when executed by the one or more processors, cause the mobile computing device to:
process the textual data using feature extraction algorithms to identify the one or more line items.

### Claim 6 (depends on 1)

The mobile computing device of claim 1, wherein the instructions, when executed by the one or more processors, cause the mobile computing device to:
determine, for each of the one or more line items, additional information that comprises at least information identifying a corporate entity associated with each of the one or more line items.

### Claim 7 (depends on 6)

The mobile computing device of claim 6, wherein the additional information comprises at least one of:
contact information associated with a brand associated with each of the one or more line items,
warranty information associated with each of the one or more line items, or return policy information associated with each of the one or more the line items.

### Claim 8 (depends on 1)

The mobile computing device of claim 1, wherein the instructions, when executed by the one or more processors, cause the mobile computing device to:
pre-process, using the one or more computer vision techniques, the image that comprises at least the portion of the user receipt; and
post-process, using one or more post-processing techniques, textual data of the user receipt to perform error correction.

### Claim 9 (depends on 1)

The mobile computing device of claim 1, wherein the instructions, when executed by the one or more processors, further cause the mobile computing device to:
query one or more databases to retrieve:
a receipt line item format associated with a merchant of the transaction, and
an item identifier format associated with the merchant of the transaction;
determine, based on the receipt line item format associated with the merchant, that a first line item of the one or more line items is associated with the merchant; and
determine additional information associated with the first line item by:
parsing, based on the item identifier format, the first line item to determine an item identifier associated with the first line item; and
querying, using the item identifier associated with the first line item, the one or more databases to retrieve the additional information.

### Claim 10 (depends on 9)

The mobile computing device of claim 9, wherein the item identifier format corresponds to a format associated with at least one of:
a universal product code (UPC),
a stock-keeping unit (SKU),
an international standard book number (ISBN),
a global trade item number (GTIN),
an international standard serial number (ISSN),
an international standard music number (ISMN), or
an international article number (IAN).

### Claim 11 (depends on 1)

The mobile computing device of claim 1, wherein the instructions, when executed by the one or more processors, further cause the mobile computing device to:
for each of the one or more line items associated with the transaction:
determine an item identifier associated with a corresponding line item;
retrieve, from one or more databases and using the item identifier, a brand identifier associated with the item identifier;
retrieve, from the one or more databases, a webpage associated with a brand identified by the brand identifier; and
determine, based on the webpage, additional information associated with the corresponding line item.

### Claim 12 (depends on 1)

The mobile computing device of claim 1, wherein the instructions, when executed by the one or more processors, further cause the mobile computing device to:
receive, via the user interface, a user selection of a first line item of the one or more line items;
determine a merchant associated with the transaction;
determine a webpage associated with the merchant; and
transmit, via the webpage associated with the merchant, form data to initiate at least one of:
a return process of an item associated with the selected first line item, or
a warranty claim process for the item associated with the selected first line item.

### Claim 13 (depends on 1)

The mobile computing device of claim 1, wherein the instructions, when executed by the one or more processors, further cause the mobile computing device to:
receive, via the user interface, a user selection of a first line item of the one or more line items;
determine a purchase price associated with the selected first line item;
determine, using one or more sensors of the mobile computing device, a location of the mobile computing device;
identify one or more merchants within a threshold proximity to the location of the mobile computing device, wherein the one or more merchants are associated with a price, of the selected first line item, that is lower than the purchase price associated with the selected first line item; and
output, to the display device and via the user interface, a map indicating one or more locations of the one or more merchants.

### Claim 14 (depends on 1)

The mobile computing device of claim 1, wherein the one or more computer vision techniques comprise Optical Character Recognition (OCR) algorithms.

### Claim 15

A method comprising:
causing, responsive to a user selection of a transaction from a plurality of purchase transactions and based on a detection that a user receipt is focused within one or more receipt guides, a camera associated with a mobile computing device to automatically capture an image that comprises at least a portion of the user receipt, wherein the user receipt is associated with the selected transaction;
processing the image using one or more computer vision techniques to determine one or more line items associated with the transaction; and
outputting, via a user interface of the mobile computing device, the one or more line items associated with the transaction.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
converting the image of the user receipt to textual data; and
parsing the textual data of the user receipt to identify one or more character strings that correspond to the one or more line items associated with the transaction.

### Claim 17 (depends on 15)

The method of claim 15, further comprising:
converting the image of the user receipt to textual data; and
processing the textual data, using feature extraction algorithms, to identify the one or more line items.

### Claim 18

One or more non-transitory, computer-readable media storing instructions that, when executed by one or more processors of a computing device, cause the computing device to:
cause, responsive to a user selection of a transaction from a plurality of purchase transactions and based on a detection that a user receipt is focused within one or more receipt guides, a camera associated with a mobile computing device to automatically capture an image that comprises at least a portion of the user receipt, wherein the user receipt is associated with the selected transaction;
process the image using one or more computer vision techniques to determine one or more line items associated with the transaction; and
output, via a user interface of the mobile computing device, the one or more line items associated with the transaction.

### Claim 19 (depends on 18)

The one or more non-transitory, computer-readable media of claim 18, wherein the instructions, when executed by the one or more processors, cause the computing device to:
receive, via the user interface, a user selection of a first line item of the one or more line items;
determine a merchant associated with the transaction;
determine a webpage associated with the merchant; and
transmit, via the webpage associated with the merchant, form data to initiate at least one of:
a return process of an item associated with the selected first line item, or
a warranty claim process for the item associated with the selected first line item.

### Claim 20 (depends on 18)

The one or more non-transitory, computer-readable media of claim 18, wherein the instructions, when executed by the one or more processors, cause the computing device to:
receive, via the user interface, a user selection of a first line item of the one or more line items;
determine a purchase price associated with the selected first line item;
determine, using one or more sensors of the mobile computing device, a location of the mobile computing device;
identify one or more merchants within a threshold proximity to the location of the mobile computing device, wherein the one or more merchants are associated with a price, of the selected first line item, that is lower than the purchase price associated with the selected first line item; and
output, via the user interface, a map indicating one or more locations of the one or more merchants.
