# US 2010/0142758 A1 · Method for Providing Photographed Image-Related Information to User, and Mobile System Therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0142758 A1
- Document ID: US20100142758A1
- Status: Published application
- Kind: A1
- Application number: 12/529,825
- Filed: 2008-03-04
- Published: 2010-06-10
- Earliest claimed: 2007-03-05
- Assignees: Superfish Ltd.
- Inventors: Adi Pinhas; Michael Chertok
- Web page: https://patentgrep.com/patent/US20100142758A1

## CPC

- H04N 1/00244: {with a server, e.g. an internet server (fax-servers or the like for store and forward H04N1/324)}
- H04N 1/32128: {attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image (for information embedded in the image H04N1/32144)}
- H04N 2201/0055: By radio
- H04N 2201/0084: Digital still camera
- H04N 2201/3243: of type information, e.g. handwritten or text document
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

System for providing a mobile user, object related information related to an object visible thereto, the system including a camera directable toward the object, a local interest points and semi global geometry (LIPSGG) extraction processor, and a remote LIPSGG identifier, the camera acquiring an image of at least a portion of the object, the LIPSGG extraction processor being coupled with the camera, the LIPSGG extraction processor extracting an LIPSGG model of the object from the image, remote LIPSGG identifier being coupled with the LIPSGG extraction processor via a network, the remote LIPSGG identifier receiving the LIPSGG model from the LIPSGG extraction processor, via the network, the remote LIPSGG identifier identifying the object according to the LIPSGG model, the remote LIPSGG identifier retrieving the object related information, the remote LIPSGG identifier providing the object related information to the mobile user operating the camera.

## Claims

### Claim 1

System for providing a mobile user, object related information related to an object visible thereto, the system comprising:
a camera, directable toward said object, said camera acquiring at least one image of at least a portion of said object;
a local interest points and semi-global geometry (LIPSGG) extraction processor coupled with said camera, said LIPSGG extraction processor extracting an LIPSGG model of said object from said at least one image; and
a remote LIPSGG identifier, coupled with said LIPSGG extraction processor via a network, said remote LIPSGG identifier receiving said LIPSGG model from said LIPSGG extraction processor, via said network, said remote LIPSGG identifier identifying said object, according to said LIPSGG model, said remote LIPSGG identifier retrieving said object related information, said remote LIPSGG identifier providing said object related information to said mobile user operating said camera.

### Claim 2 (depends on 1)

The system according to claim 1, wherein said camera acquires said at least one image on a medium selected from the list consisting of:
light-sensitive material;
charge-coupled device; and
complementary metal oxide semiconductor.

### Claim 3 (depends on 1)

The system according to claim 1, wherein said network is selected from the list consisting of:
wired network; and
wireless network.

### Claim 4 (depends on 1)

The system according to claim 1, wherein said network includes links selected from the list consisting of:
wired internet;
Wi-Fi;
WiMax;
Zigbee;
Bluetooth;
Cellular;
free air optic;
satellite; and
wireless Internet.

### Claim 5 (depends on 1)

The system according to claim 1, wherein said remote LIPSGG identifier comprises a database, and
wherein said database includes data respective of a plurality of LIPSGG models of each of a plurality of objects, and respective of said object related information.

### Claim 6 (depends on 5)

The system according to claim 5, wherein said remote LIPSGG identifier further comprises an image processor, and
wherein said image processor identifies said object, according to said LIPSGG model and said LIPSGG models.

### Claim 7 (depends on 1)

The system according to claim 1, wherein said LIPSGG model includes data respective of a plurality of feature vectors and semi-global geometry, of said object, and
wherein each of said feature vectors determines variations in a plurality of pixel values at a region surrounding a local interest point, and said semi-global geometry determines a plurality of relative distances and a plurality of relative angles between said local interest points of said object.

### Claim 8 (depends on 1)

The system according to claim 1, further comprising:
a mobile processor, coupled with said LIPSGG extraction processor; and
a user interface, coupled with said mobile processor,
wherein said mobile processor directs said user interface to present said object related information, to said mobile user.

### Claim 9 (depends on 1)

The system according to claim 1, further comprising a Global Positioning System (GPS) receiver, coupled with said LIPSGG extraction processor,
wherein said GPS receiver determines a set of GPS coordinates of said object, and
wherein said remote LIPSGG identifier identifies said object according to said LIPSGG model and according to said set of GPS coordinates of said object.

### Claim 10

System for providing a mobile user, object related information related to an object visible thereto, the system comprising:
a camera, directable toward said object, said camera acquiring at least one image of at least a portion of said object;
a local interest points and semi-global geometry (LIPSGG) extraction processor, coupled with said camera, for extracting an LIPSGG model of said object from said at least one image; and
a mobile communication interface coupled with said LIPSGG extraction processor,
wherein said mobile communication interface transmits said LIPSGG model to a remote LIPSGG identifier via a network, and
wherein said mobile communication interface receives said object related information from said remote LIPSGG identifier.

### Claim 11

System for providing a mobile user, object related information related to an object visible thereto, the system comprising:
a remote local interest points and semi-global geometry (LIPSGG) identifier, said remote LIPSGG identifier including:
a remote LIPSGG identifier communication interface for receiving at least one image of at least a portion of said object; and
an LIPSGG extraction processor for extracting an LIPSGG model from said at least one image;
wherein said remote LIPSGG identifier identifies said object, according to said LIPSGG model, and retrieves said object related information, and
wherein said remote LIPSGG identifier communication interface transmits said object related information to said mobile user via a network.

### Claim 12

Method for providing a mobile user, object related information related to an object visible thereto, the method comprising the procedures of:
extracting an LIPSGG model, of said object, from at least one image, of at least a portion of said object;
transmitting LIPSGG model data, respective of said LIPSGG model, to an LIPSGG identifier, via a network;
identifying said object, according to said LIPSGG model data;
retrieving said object related information, respective of said object, from a database; and
transmitting said object related information, to said mobile user, via said network.

### Claim 13 (depends on 12)

The method according to claim 12, further comprising the preliminary procedure of acquiring said at least one image.

### Claim 14 (depends on 12)

The method according to claim 12, further comprising the procedure of storing said LIPSGG model data in said database, after performing said procedure of identifying.

### Claim 15 (depends on 12)

The method according to claim 12, further comprising the procedure of reconstructing a three-dimensional LIPSGG model data in said database, after performing said procedure of two-dimensional LIPSGG models.

### Claim 16 (depends on 12)

The method according to claim 12, further comprising the procedures of:
acquiring a set of GPS coordinates, respective of the location of said object;
transmitting data respective of said set of GPS coordinates to said LIPSGG identifier, via said network; and
identifying said object, according to said set of GPS coordinates.

### Claim 17

System for providing a user, object related information related to an object visible thereto, the system comprising:
an image source including at least one image of at least a portion of said object;
a local interest points and semi-global geometry (LIPSGG) extraction processor coupled with said image source, said LIPSGG
extraction processor extracting an LIPSGG model of said object from said at least one image; and
a remote LIPSGG identifier, coupled with said LIPSGG extraction processor via a network, said remote LIPSGG identifier receiving said LIPSGG model from said LIPSGG extraction processor, via said network, said remote LIPSGG identifier identifying said object, according to said LIPSGG model, said remote LIPSGG identifier retrieving said object related information, said remote LIPSGG identifier providing said object related information to said user employing said image source.

### Claim 18 (depends on 17)

The system according to claim 17, wherein said network is selected from the list consisting of:
wired network; and
wireless network.

### Claim 19 (depends on 17)

The system according to claim 17, wherein said network includes links selected from the list consisting of:
wired internet;
Wi-Fi;
WiMax;
Zigbee;
Bluetooth;
Cellular;
free air optic;
satellite; and
wireless Internet.

### Claim 20 (depends on 17)

The system according to claim 17, wherein said remote LIPSGG identifier comprises a database, and
wherein said database includes data respective of a plurality of LIPSGG models of each of a plurality of objects, and respective of said object related information.

### Claim 21 (depends on 20)

The system according to claim 20, wherein said remote LIPSGG identifier further comprises an image processor, and
wherein said image processor identifies said object, according to said LIPSGG model and said LIPSGG models.

### Claim 22 (depends on 17)

The system according to claim 17, wherein said LIPSGG model includes data respective of a plurality of feature vectors and semi-global geometry, of said object, and
wherein each of said feature vectors determines variations in a plurality of pixel values at a region surrounding a local interest point, and said semi-global geometry determines a plurality of relative distances and a plurality of relative angles between said local interest points of said object.

### Claim 23 (depends on 17)

The system according to claim 17, further comprising:
a mobile processor, coupled with said LIPSGG extraction processor; and
a user interface, coupled with said mobile processor,
wherein said mobile processor directs said user interface to present said object related information, to said mobile user.

### Claim 24 (depends on 17)

The system according to claim 17, further comprising a Global Positioning System (GPS) receiver, coupled with said LIPSGG extraction processor,
wherein said GPS receiver determines a set of GPS coordinates of said object, and
wherein said remote LIPSGG identifier identifies said object according to said LIPSGG model and according to said set of GPS coordinates of said object.

### Claim 25

System for providing a mobile user, object related information related to an object visible thereto, the system comprising:
an image source including at least one image of at least a portion of said object;
a local interest points and semi-global geometry (LIPSGG) extraction processor, coupled with said image source, for extracting an LIPSGG model of said object from said at least one image; and
a mobile communication interface coupled with said LIPSGG extraction processor,
wherein said mobile communication interface transmits said LIPSGG model to a remote LIPSGG identifier via a network, and wherein said mobile communication interface receives said object related information from said remote LIPSGG identifier.
