# US 2017/0255651 A1 · System and method for information processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0255651 A1
- Document ID: US20170255651A1
- Status: Published application
- Kind: A1
- Application number: 15/062,923
- Filed: 2016-03-07
- Published: 2017-09-07
- Earliest claimed: 2016-03-07
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: PETER SHINTANI
- Web page: https://patentgrep.com/patent/US20170255651A1

## CPC

- G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders
- G06Q 10/08776: {by management of storage life of perishable or hazardous products}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

Various aspects of a system and method for information processing are disclosed herein. The method includes capturing a set of images associated with an item by a first electric device. The set of images comprises one or more images of the item and/or an associated location where the item is stored. A user input that corresponds to the captured set of images associated with the item is received. A first set of information is extracted from the captured set of images and the received user input. The extracted first set of information is communicated to the server. A second set of information associated with the item is retrieved by the server from the extracted first set of information in response to a query received from a second electronic device.

## Claims

### Claim 1

A system for information processing, said system composing:
one or more circuits in a first electronic device, said one or more circuits being configured to:
capture a set of images associated with an item, wherein said set of images comprises one or more images of said item and/or an associated location where said item is stored;
received a user input that corresponds to said captured set of images associated with said item;
extract a first set of information associated with said item from said captured set of images associated with said item based on said captured set of images and said received user input; and
communicate said extracted first set of information associated with said item to a sender, wherein a second set of information associated with said item is retrieved by said server from said extracted first set of information in response to a query received from a second electronic device.

### Claim 2 (depends on 1)

The system according to claim 1, wherein said one or more circuits are further configured to generate tagging information for said captured set of images associated with said item, wherein said generated tagging information comprises one or more of: a date and a time of said capturing of said set of images, geospatial metadata associated with said item and an enclosure where said item is stored, and/or encoded information associated with said capturing of said set of images.

### Claim 3 (depends on 1)

The system according to claim 1, wherein said received user input corresponds to information related to said item in addition to said extracted first set of information.

### Claim 4 (depends on 1)

The system according to claim 1, wherein said first electronic device and said second electronic device correspond to one of: smart phone, a tablet computing device, a barcode reader, and/or a quick response (QR) reader.

### Claim 5 (depends on 1)

The system according to claim 1, wherein said set of images captured by said first electronic device composes one or more images of said item and/or an associated location where said item is stored.

### Claim 6 (depends on 1)

The system according to claim 1, wherein said extracted first set of information corresponds to one or more of: name of said item, a type of said item, an expiry date of said item, a maximum retail price of said item, one or more ingredients of said item, a manufacturing date of said item, a name of a manufacturing company of said item, one or more statutory warnings, instructions for safe usage of said item, a universal product code (UPC), a material safety data sheet (MSDS), and/or other related information of said item retrieved from a plurality of data sources.

### Claim 7

A system for information processing, said system comprising:
one or more circuits in a server, said one or more circuits being configured to:
receive a first set of information associated with an item from a first electronic device, wherein said first set of information is extracted from a set of images associated with said item captured by said first electronic device and a user input;
determine a second set of information from said received first set of information associated with said item;
receive a query associated with said item from a second electronic device;
retrieve said first set of information and/or said determined second set of information, based on said received query; and
transmit said retrieved first set of information and/or said retrieved second set of information to said second electronic device.

### Claim 8 (depends on 7)

The system according to claim 7, wherein said received first set of information corresponds to one or more of: name of said item, a type of said item, an expiry date of said item, a maximum retail price of said item, one or more ingredients of said item, a manufacturing date of said item, a name of manufacturing company of said item, one or more statutory warnings, instructions for safe usage of said item, a universal product code (UPC), a material safety data sheet (MSDS), and/or other related information of said item retrieved from a plurality of data sources.

### Claim 9 (depends on 7)

The system according to claim 7, wherein said received first set of information comprises tagging information for said set of images associated with said item, wherein said tagging information comprises one or more of: a date and a time of said capturing of said set of images, geospatial metadata associated with said item and a location where said item is stored, and/or other needed information associated with said capturing of said set of images.

### Claim 10 (depends on 7)

The system according to claim 7, wherein said determined second set of information corresponds to one or more of: time left for expiry of said item, a shelf life of said item, a due date for recycling, quality information of ingredients of said item, and/or a current optimum price value of said item.

### Claim 11 (depends on 7)

The system according to claim 7, wherein said set of images captured by said first electronic device comprises ore or more images of said item and/or an associated location where said item is stored.

### Claim 12

A system for information processing, said method comprising:
one or more circuits in a second electronic device, said one or more circuits being configured to:
receive a query associated with an item, wherein said query comprises text and/or image-based content associated with said item;
transmit said received query to said server to retrieve a first set of information and/or a second set of information, wherein said first set of information is received from said first electronic device and said second set of information is determined by said server from said received first set of information; and
receive said retrieved first set of information and/or said retrieved second set of information from said server.

### Claim 13

A system for information processing, said system comprising:
one or more circuits in a server, said one or more circuits being configured to:
receive a first set of information associated with an item from a first electronic device, wherein said first set of information corresponds to sensor data received from said first electronic device, and/or a user input;
determine a second set of information from said received first set of information associated with said item;
generate a database based on said first set of information and said determined second set of information;
receive a query associated with said item from a second electronic device;
retrieve said first set of information and/or said determined second set of information from said generated database, based on said received query; and
transmit said retrieved first set of information and/or said retrieved second set of information to said second electronic device.

### Claim 14 (depends on 13)

The system according to claim 13, wherein said sensor data received from said first electronic device corresponds to one or more of: a location data of said first electronic device obtained from an indoor positioning system, a geospatial sensor, and/or other sensors associated with said first electronic device, an orientation data of said first electronic device, and/or a set of images associated with said item captured by said first electronic device.

### Claim 15 (depends on 13)

The system according to claim 13, wherein said one or more circuits are further configured to group said item with one or more of a plurality of other items, based on received other first set of information associated with each of said plurality of other items and said first set of information associated with said item.

### Claim 16

A method for information processing, said method comprising:
receiving, at a server, a first set of information associated with an item from a first electronic device, wherein said first set of information is extracted from a set of images associated with said item captured by said first electronic device and a user input;
determining, by said server, a second set of information from said received first set of information associated with said item;
receiving, at said server, a query associated with said item from a second electronic device;
retrieving, by said server, said first set of information and/or said determined second set of information, based on said received query; and
transmitting, by said server, said retrieved first set of information and/or said retrieved second set of information to said second electronic device.

### Claim 17 (depends on 16)

The method according to claim 16, wherein said received user input corresponds to information related to said item in addition to said extracted first set of information.

### Claim 18 (depends on 16)

The method according to claim 16, wherein said first electronic device and said second electronic device correspond to one of: a smart phone, a tablet computing device, a barcode reader, and/or a quick response (QR) reader.

### Claim 19 (depends on 16)

The method according to claim 16, wherein said set of images captured by said first electronic device comprises one or more images of said item and/or an associated location where said item is stored.

### Claim 20 (depends on 16)

The method according to claim 16, wherein said received list set of information corresponds to one or more of: name of said item, a type of said item, an expiry date of said item, a maximum retail price of said item, one or more ingredients of said item, a manufacturing date of said item, a name of manufacturing company of said item, one or more statutory warnings, instructors for safe usage of said item, a universal product code (UPC), a material safety data sheet (MSDS), and/or other related information of said item retrieved from a plurality of data sources.

### Claim 21 (depends on 16)

The method according to claim 16, wherein said received first set of information comprises tagging information for said set of images associated with said item.

### Claim 22 (depends on 21)

The method according co claim 21, wherein said tagging information comprises one or more of: a date and a time of said capturing of said set of images, geospatial metadata associated with said item and an enclosure where said item is stored, and/or other encoded information associated with said capturing of said set of images.

### Claim 23 (depends on 16)

The method according to claim 16, wherein said determined second set of information corresponds to one or more of: time left for expiry of said item, a shelf life of said item, a due date for recycling, quality information of ingredients of said item, and/or a current optimum price value of said item.
