# US 2004/0083138 A1 · Methods and systems for object identification and interaction

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2004/0083138 A1
- Document ID: US20040083138A1
- Status: Published application
- Kind: A1
- Application number: 10/409,876
- Filed: 2003-04-09
- Published: 2004-04-29
- Earliest claimed: 2002-10-25
- Assignees: Silverbrook Research Pty Ltd
- Inventors: Kia Silverbrook; Paul Lapstun; Simon Robert Walmsley
- Web page: https://patentgrep.com/patent/US20040083138A1

## CPC

- G06K 19/06075: {the marking containing means for error correction}
- G06K 7/14: using light without selection of wavelength, e.g. sensing reflected white light {(G06K7/10831 - G06K7/1097 take precedence)}
- G06K 7/1421: {Circular bar codes}
- G06K 7/1456: {determining the orientation of the optical code with respect to the reader and correcting therefore}
- G06K 7/1473: {error correction}
- G06K 19/06009: {with optically detectable marking (G06K19/063, G06K19/08 take precedence)}
- G06K 19/06168: {the marking being a concentric barcode}
- G06K 2019/06243: {concentric-code}
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS

## Abstract

A method of facilitating an interaction between a user and a product item, the product item having an identity and the method including a number of steps. The first step involves providing the user with an interface surface associated with the product item and containing information relating to the product item. The interface surface includes coded data indicative of the identity of the product item and of a number of reference points of the interface surface. The next step involves receiving, in a computer system, indicating data from a sensing device regarding the identity of the product item and a position of the sensing device relative to the interface surface. The sensing device, when placed in an operative position relative to the interface surface, sensing the coded data in the vicinity of the sensing device and generating the indicating data using the sensed coded data. The next step involves facilitating, in the computer system and with reference to the indicating data, the interaction between the user and the product item.

## Claims

### Claim 1

A method of facilitating an interaction between a user and a product item, the product item having an identity and the method including the steps of:
providing the user with an interface surface associated with the product item and containing information relating to the product item, the interface surface having disposed thereon coded data indicative of the identity of the product item and of a plurality of reference points of the interface surface;
receiving, in a computer system, indicating data from a sensing device regarding the identity of the product item and a position of the sensing device relative to the interface surface, the sensing device, when placed in an operative position relative to the interface surface, sensing at least some of the coded data in the vicinity of the sensing device and generating the indicating data using at least some of the sensed coded data; and
facilitating, in the computer system and with reference to the indicating data, the interaction between the user and the product item.

### Claim 2 (depends on 1)

The method of claim 1 in which the interaction is associated with at least one zone of the interface surface and in which the method includes identifying, in the computer system and from the zone relative to which the sensing device is located, the interaction.

### Claim 3 (depends on 2)

The method of claim 2 which includes:
receiving, in the computer system, data regarding movement of the sensing device relative to the interface surface, the sensing device sensing its movement relative to the interface surface using at least some of the coded data; and
identifying, in the computer system and from the movement being at least partially within the at least one zone, the interaction.

### Claim 4

A method of facilitating an interaction between a user and a product item, the product item having an identity and the method including the steps of:
providing the user with an interface surface associated with the product item, the interface surface containing information relating to the product item and having disposed thereon coded data indicative of the identity of the product item and a parameter of the interaction;
receiving, in a computer system and from a sensing device, indicating data regarding the identity of both the product item and the parameter of the interaction, and movement data regarding movement of the sensing device relative to the interface surface, the sensing device, when moved relative to the interface surface, sensing at least some of the coded data and generating the indicating data and the movement data using at least some of the sensed coded data; and
interpreting, in the computer system, the indicating data and the movement data as it relates to the interaction.

### Claim 5

A method of facilitating an interaction between a user and a product item, the product item having an identity and the method including the steps of:
providing the user with an interface surface associated with the product item, the interface surface containing information relating to the product item and having disposed thereon coded data indicative of the identity of the product item;
receiving, in a computer system, user data from a sensing device regarding an identity of the user and indicating data regarding the identity of the product item, the sensing device containing the user data and, when placed in an operative position relative to the interface surface, sensing at least some of the coded data in the vicinity of the sensing device and generating the indicating data using at least some of the sensed coded data; and
facilitating, in the computer system and with reference to the user data and the indicating data, the interaction between the user and the product item.

### Claim 6 (depends on 5)

The method of claim 5 in which the coded data is also indicative of a parameter of the interaction, and the method includes receiving, in the computer system, indicating data from the sensing device regarding the parameter of the interaction, the sensing device generating the indicating data using at least some of the sensed coded data.

### Claim 7 (depends on 6)

The method of claim 6 which includes receiving, in the computer system, data from the sensing device regarding movement of the sensing device relative to the interface surface, the sensing device generating data regarding its own movement relative to the interface surface.

### Claim 8 (depends on 1, 4, 5)

The method of any one of claims 1, 4 or 5 in which the interaction is selected from the group comprising:
(a) providing product information about the product item to the user;
(b) recording a purchase transaction relating to the product item;
(c) recording a potential purchase transaction relating to the product item;
(d) providing comparison information to the user, the comparison information comparing the product information about the product item with product information about another product item;
(e) playing a game associated with the product item; and
(f) conducting a competition in relation to the product item.

### Claim 9 (depends on 8)

A method according to claim 8 wherein the product information comprises information relating to any one of the product item's:
(a) cost;
(b) contents;
(c) weight;
(d) place of origin;
(e) manufacturer;
(f) date of manufacture;
(g) date of packaging;
(h) use-by date;
(i) current owner; and
(j) dimensions.

### Claim 10 (depends on 1, 4, 5)

A method according to any one of claims 1, 4 or 5 wherein the interface surface is selected from the group comprising:
(a) a label;
(b) a package; and
(c) a surface of the product item itself.

### Claim 11 (depends on 1, 4, 5)

A method according to any one of claims 1, 4 or 5 wherein the coded data is substantially invisible to the average unaided human.

### Claim 12 (depends on 1, 4, 5)

A method according to any one of claims 1, 4 or 5 wherein the coded data is disposed over a substantial portion of the interface surface.

### Claim 13 (depends on 12)

A method according to claim 12 wherein the coded data is disposed over more than 20% of the interface surface.

### Claim 14 (depends on 12)

A method according to claim 12 wherein the coded data is disposed over more than 90% of the interface surface.

### Claim 15 (depends on 1, 4, 5)

The method of any one of claims 1, 4 or 5 wherein the method further comprises identifying, in the computer system, that the user has entered handwritten text data by means of the sensing device and effecting, in the computer system, an operation associated with the handwritten text data.

### Claim 16 (depends on 15)

The method of claim 15 which includes converting, in the computer system, the handwritten text data to computer text.

### Claim 17 (depends on 1, 4, 5)

The method of any one of claims 1, 4 or 5 wherein the method further comprises identifying, in the computer system, that the user has entered a handwritten signature by means of the sensing device and effecting, in the computer system, an operation associated with the handwritten signature.

### Claim 18 (depends on 17)

The method of claim 17 which includes verifying, in the computer system, that the signature is that of the user.

### Claim 19 (depends on 17)

The method of claim 17 in which the operation associated with the handwritten signature is associated with payment authorization.

### Claim 20 (depends on 1, 4, 5)

The method of any one of claims 1, 4 or 5 wherein the method further comprises identifying, in the computer system, that the user has entered a hand-drawn picture by means of the sensing device and effecting, in the computer system, an operation associated with the hand-drawn picture.

### Claim 21 (depends on 1, 4, 5)

The method of any one of claims 1, 4 or 5 in which:
a portion of the coded data is superimposed with a visual graphic, the visual graphic being at least partially indicative, to the user, of the interaction.

### Claim 22 (depends on 1, 4)

The method of claim 1 or claim 4 in which the sensing device contains an identifier which imparts a unique identity to the sensing device and identifies it as belonging to the user and in which the method includes monitoring, in the computer system, the identifier.

### Claim 23 (depends on 1, 4, 5)

The method of any one of claims 1, 4 or 5 which includes providing all required information relating to the interaction in the interface surface to eliminate the need for a separate display device.

### Claim 24

A system for facilitating an interaction between a user and a product item, the product item having an identity and the system including:
a interface surface associated with the product item and containing information relating to the product item, the interface surface having disposed thereon coded data indicative of the identity of the product item and of a plurality of reference points of the interface surface; and
a computer system adapted to facilite the interaction in response to receiving indicating data from a sensing device, the indicating data being indicative of the identity of the product item and of a position of the sensing device relative to the interface surface, the sensing device, when placed in an operative position relative to the interface surface, sensing at least some of the coded data in the vicinity of the sensing device and generating the indicating data using at least some of the sensed coded data.

### Claim 25 (depends on 24)

The system of claim 24 in which the interaction is associated with at least one zone of the interface surface.

### Claim 26 (depends on 24)

The system of claim 24 which includes the sensing device, the sensing device sensing its movement relative to the interface surface using at least some of the coded data.

### Claim 27

A system for facilitating an interaction between a user and a product item, the product item having an identity and the system including
an interface surface associated with the product item, the interface surface containing information relating to the product item and having disposed thereon coded data indicative of the identity of the product item and of a parameter of the interaction; and
a computer system for receiving, from a sensing device, indicating data regarding the identity of both the product item and the parameter of the interaction, and movement data regarding movement of the sensing device relative to the interface surface, and for interpreting the movement of the sensing device as it relates to the interaction, the sensing device, when moved relative to the interface surface, sensing at least some of the coded data and generating the indicating data and the movement data using at least some of the sensed coded data.

### Claim 28

A system for facilitating an interaction between a user and a product item, the product item having an identity and the system including:
a interface surface associated with the product item, the interface surface containing information relating to the product item and having disposed thereon coded data indicative of the identity of the product item; and
a computer system adapted to receive from a sensing device user data regarding an identity of the user and indicating data regarding the identity of the product item, and for facilitating, with reference to the user data and the indicating data, the interaction between the user and the product item, the sensing device containing the user data and, when placed in an operative position relative to the interface surface, sensing at least some of the coded data in the vicinity of the sensing device and generating the indicating data using at least some of the sensed coded data.

### Claim 29 (depends on 28)

The system of claim 28 in which the coded data is also indicative of a parameter of the interaction, the computer system receiving indicating data from the sensing device regarding the parameter of the interaction, and the sensing device generating the indicating data using at least some of the coded data.

### Claim 30 (depends on 28)

The system of claim 28 which includes the sensing device, the sensing device sensing its movement relative to the interface surface.

### Claim 31 (depends on 24, 27, 28)

The system of any one of claims 24, 27 or 28 in which the interaction is selected from the group comprising:
(a) providing product information about the product item to the user;
(b) recording a purchase transaction relating to the product item;
(c) recording a potential purchase transaction relating to the product item;
(d) providing comparison information to the user, the comparison information comparing the product information about the product item with product information about another product item;
(e) playing a game associated with the product item; and
(f) conducting a competition in relation to the product item.

### Claim 32 (depends on 31)

The system of claim 31 wherein the product information comprises information relating to any one of the product item's:
(a) cost;
(b) contents;
(c) weight;
(d) place of origin;
(e) manufacturer;
(f) date of manufacture;
(g) date of packaging;
(h) use-by date;
(i) current owner; and
(j) dimensions.

### Claim 33 (depends on 24, 27, 28)

The system of any one of claims 24, 27 or 28 wherein the interface surface is selected from the group comprising:
(a) a label;
(b) a package; and
(c) a surface of the product item itself.

### Claim 34 (depends on 24, 27, 28)

The system of any one of claims 24, 27 or 28 wherein the coded data is substantially invisible to the average unaided human.

### Claim 35 (depends on 24, 27, 28)

The system of any one of claims 24, 27 or 28 wherein the coded data is disposed over a substantial portion of the interface surface.

### Claim 36 (depends on 35)

The system of claim 35 wherein the coded data is disposed over more than 20% of the interface surface.

### Claim 37 (depends on 35)

The system of claim 35 wherein the coded data is disposed over more than 90% of the interface surface.

### Claim 38 (depends on 24, 27, 28)

The system of any one of claims 24, 27 and 28 in which the sensing device includes a marking nib.

### Claim 39 (depends on 24, 27, 28)

The system of any one of claims 24, 27 and 28 in which the sensing device contains an identifier which imparts a unique identity to the sensing device and identifies it as belonging to the user.

### Claim 40 (depends on 1, 4, 5)

The method of any one of claims 1, 4 or 5 wherein the coded data is disposed on the interface surface in accordance with a layout, the layout having at least order n rotational symmetry, where n is at least two, the layout encoding an orientation codeword comprising a sequence of an integer multiple m of n symbols, where m is one or more, each encoded symbol being distributed at n locations about a center of rotational symmetry of the layout such that decoding the symbols at each of the n orientations of the layout produces n representations of the orientation codeword, each representation comprising a different cyclic shift of the orientation codeword and being indicative of the degree of rotation of the layout, and wherein the orientation codeword is fault tolerant.

### Claim 41 (depends on 1, 4, 5)

The method of any one of claims 1, 4 or 5 wherein the coded data is disposed on the interface surface in accordance with a layout, the layout having at least order n rotational symmetry, where n is at least two, the layout including n identical sub-layouts rotated 1/n revolutions apart about a center of rotational symmetry of the layout, the coded data disposed in accordance with each sub-layout including rotation-indicating data that distinguishes the rotation of that sub-layout from the rotation of at least one other sub-layout within the layout.

### Claim 42 (depends on 1, 4, 5)

The method of any one of claims 1, 4 or 5 wherein the coded data is disposed on the interface surface in accordance with a layout having n-fold rotational symmetry, where n is at least two, the layout including n identical first sub-layouts rotated 1/n revolutions apart about a center of rotational symmetry of the layout, the coded data disposed in accordance with each first sub-layout including rotation-indicating data that distinguishes the rotation of that first sub-layout from the rotation of at least one other first sub-layout within the layout.

### Claim 43 (depends on 24, 27, 28)

The system of any one of claims 24, 27 or 28 wherein the coded data is disposed on the interface surface in accordance with a layout, the layout having at least order n rotational symmetry, where n is at least two, the layout encoding an orientation codeword comprising a sequence of an integer multiple m of n symbols, where m is one or more, each encoded symbol being distributed at n locations about a center of rotational symmetry of the layout such that decoding the symbols at each of the n orientations of the layout produces n representations of the orientation codeword, each representation comprising a different cyclic shift of the orientation codeword and being indicative of the degree of rotation of the layout, and wherein the orientation codeword is fault tolerant.

### Claim 44 (depends on 24, 27, 28)

The system of any one of claims 24, 27 or 28 wherein the coded data is disposed on the interface surface in accordance with a layout, the layout having at least order n rotational symmetry, where n is at least two, the layout including n identical sub-layouts rotated 1/n revolutions apart about a center of rotational symmetry of the layout, the coded data disposed in accordance with each sub-layout including rotation-indicating data that distinguishes the rotation of that sub-layout from the rotation of at least one other sub-layout within the layout.

### Claim 45 (depends on 24, 27, 28)

The system of any one of claims 24, 27 or 28 wherein the coded data is disposed on the interface surface in accordance with a layout having n-fold rotational symmetry, where n is at least two, the layout including n identical first sub-layouts rotated 1/n revolutions apart about a center of rotational symmetry of the layout, the coded data disposed in accordance with each first sub-layout including rotation-indicating data that distinguishes the rotation of that first sub-layout from the rotation of at least one other first sub-layout within the layout.

### Claim 46

An interactive product item adapted for interaction with a user via a sensing device and a computer system, and comprising:
a product item having an identity;
an interface surface associated with the product item and having disposed thereon information relating to the product item and coded data indicative of the identity of the product item.

### Claim 47 (depends on 46)

The interactive product item of claim 46 wherein the coded data is further indicative of a plurality of reference points of the interface surface.

### Claim 48 (depends on 46, 47)

The interactive product item of claim 46 or claim 47 wherein the coded data is further indicative of a parameter of an interaction.

### Claim 49 (depends on 46)

The interactive product item of claim 46 wherein the interface surface is selected from the group comprising:
(a) a label;
(b) a package; and
(c) a surface of the product item itself.

### Claim 50 (depends on 49)

The interactive product item of claim 49 wherein the coded data is disposed on the interface surface in accordance with a layout, the layout having at least order n rotational symmetry, where n is at least two, the layout encoding an orientation codeword comprising a sequence of an integer multiple m of n symbols, where m is one or more, each encoded symbol being distributed at n locations about a center of rotational symmetry of the layout such that decoding the symbols at each of the n orientations of the layout produces n representations of the orientation codeword, each representation comprising a different cyclic shift of the orientation codeword and being indicative of the degree of rotation of the layout, and wherein the orientation codeword is fault tolerant.

### Claim 51 (depends on 49)

The interactive product item of claim 49 wherein the coded data is disposed on the interface surface in accordance with a layout, the layout having at least order n rotational symmetry, where n is at least two, the layout including n identical sub-layouts rotated 1/n revolutions apart about a center of rotational symmetry of the layout, the coded data disposed in accordance with each sub-layout including rotation-indicating data that distinguishes the rotation of that sub-layout from the rotation of at least one other sub-layout within the layout.

### Claim 52 (depends on 49)

The interactive product item of claim 49 wherein the coded data is disposed on the interface surface in accordance with a layout having n-fold rotational symmetry, where n is at least two, the layout including n identical first sub-layouts rotated 1/n revolutions apart about a center of rotational symmetry of the layout, the coded data disposed in accordance with each first sub-layout including rotation-indicating data that distinguishes the rotation of that first sub-layout from the rotation of at least one other first sub-layout within the layout.
