# US 7,613,533 B2 · Interactive system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 7,613,533 B2
- Document ID: US7613533B2
- Status: Granted
- Kind: B2
- Application number: 11/866,324
- Filed: 2007-10-02
- Published: 2008-01-24
- Granted: 2009-11-03
- Earliest claimed: 1999-12-01
- Assignees: Silverbrook Research Pty Ltd
- Inventors: Paul Lapstun; Tobin Allen King; Simon Robert Walmsley; Kia Silverbrook
- Web page: https://patentgrep.com/patent/US7613533B2

## CPC

- B41J 3/445: {Printers integrated in other types of apparatus, e.g. printers integrated in cameras}
- G06F 1/1626: {with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]}
- G06F 1/1656: {Details related to functional adaptations of the enclosure, e.g. to provide protection against EMI, shock, water, or to host detachable peripherals like a mouse or removable expansions units like PCMCIA cards, or to provide access to internal components for maintenance or to removable storage supports like CDs or DVDs, or to mechanically mount accessories (mounting of accessories to a computer display G06F1/1607; display hoods G06F1/1603; cooling arrangements for portable computers G06F1/203)}
- G06F 1/1684: {Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675}
- G06F 1/1688: {the I/O peripheral being integrated loudspeakers}
- G06F 3/0321: {by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet (constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037)}
- G06F 3/03545: {Pens or stylus}
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06Q 40/00: Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q 40/08: Insurance
- H04M 1/27475: using interactive graphical means or pictorial representations
- H04M 1/2755: by optical scanning
- H04M 1/72409: by interfacing with external accessories (hands-free H04M1/60)
- H04M 1/72445: for supporting Internet browser applications
- H04M 3/42: Systems providing special services or facilities to subscribers (specially adapted for wireless communication networks H04W4/00)
- H04N 1/00204: {with a digital computer or a digital computer system, e.g. an internet server (programmed control between transmitter and receiver or between image input and image output device H04N1/32561)}
- H04N 1/00244: {with a server, e.g. an internet server (fax-servers or the like for store and forward H04N1/324)}
- H04N 1/00307: {with a mobile telephone apparatus (constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00)}
- H04N 1/00326: {with a data reading, recognizing or recording apparatus, e.g. with a bar-code apparatus (arrangements for the associated working of recording or reproducing apparatus with related apparatus G11B31/00)}
- H04N 1/00392: {Other manual input means, e.g. digitisers or writing tablets}
- H04N 1/00968: {by scanning marks on a sheet (mark-sheet input means H04N1/00355; sensing record carriers G06K7/00)}
- H04N 1/32122: {in a separate device, e.g. in a memory or on a display separate from image data}
- H04N 1/32778: {using a mark-sheet or machine-readable code request}
- H04N 5/445: for displaying additional information (H04N5/50 takes precedence)
- H04N 5/76: Television signal recording
- H04N 7/163: {by receiver means only}
- H04N 19/60: using transform coding
- H04N 19/61: in combination with predictive coding
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 21/422: Input-only peripherals {, i.e. input devices connected to specially adapted client devices}, e.g. global positioning system [GPS] {(input devices also receiving signals from specially adapted client devices H04N21/4104)}
- H04N 21/42203: {sound input device, e.g. microphone}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G06F 2200/1614: Image rotation following screen orientation, e.g. switching from landscape to portrait mode
- G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
- G06F 2203/0384: Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
- H04M 1/72412: using two-way short-range wireless interfaces
- H04M 1/72442: for playing music files
- H04M 7/0015: {First party call control architectures}
- H04M 2250/12: including a sensor for measuring a physical value, e.g. temperature or motion
- H04N 1/32133: {on the same paper sheet, e.g. a facsimile page header}
- H04N 5/765: Interface circuits between an apparatus for recording and another apparatus
- H04N 5/783: Adaptations for reproducing at a rate different from the recording rate
- H04N 5/907: using static stores, e.g. storage tubes or semiconductor memories (H04N5/91 takes precedence)
- H04N 21/478: Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N 2201/0082: Image hardcopy reproducer (H04N2201/0091 - H04N2201/0094 take precedence)
- H04N 2201/3226: of identification information or the like, e.g. ID code, index, title, part of an image, reduced-size image
- H04N 2201/3247: Data linking a set of images to one another, e.g. sequence, burst or continuous capture mode
- H04N 2201/3264: of sound signals
- H04N 2201/3269: of machine readable codes or marks, e.g. bar codes or glyphs
- H04N 2201/3274: Storage or retrieval of prestored additional information
- Y10S 707/99931: Database or file accessing
- Y10T 428/187: Continuous sectional layer
- B41J: TYPEWRITERS; SELECTIVE PRINTING MECHANISMS, i.e. MECHANISMS PRINTING OTHERWISE THAN FROM A FORME; CORRECTION OF TYPOGRAPHICAL ERRORS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- Y10S: TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10T: TECHNICAL SUBJECTS COVERED BY FORMER US CLASSIFICATION

## Abstract

A system including a sensing device is disclosed. In one embodiment, the system has (a) an article comprising: (i) a surface having a plurality of positions and a plurality of different print elements respectively at the plurality of positions, and (ii) a plurality of substantially invisible codes respectively at the plurality of positions and associated with the plurality of positions on the surface. The system also has (b) a sensing device comprising (i) an optical sensor for reading the codes (ii) a processor coupled to the optical sensor for determining a position of the sensing device using the read code (iii) a memory unit comprising data for different audio outputs corresponding to the different print elements, the memory unit coupled to the processor, and (iv) an audio output device coupled to the processor.

## Claims

### Claim 1

An interactive system comprising:
(a) an article comprising a surface having a position-coding pattern printed thereon, said position-coding pattern identifying a plurality of positions on the surface and a surface identity at each of said positions; and
(b) a handheld sensing device having a housing, said housing containing: (i) an optical sensor for reading codes from the position-coding pattern (ii) a processor coupled to the optical sensor for determining a position of the sensing device and the surface identity using the read code (iii) a memory unit comprising data for different audio outputs corresponding to different positions on the surface, the memory unit coupled to the processor, and (iv) an audio output device coupled to the processor,
wherein said handheld sensing device is configured to provide the different audio outputs to a user in response to optically sensing different positions of the position-coding pattern, and wherein the surface identity distinguishes the surface from a plurality of other surfaces.

### Claim 2 (depends on 1)

The interactive system of claim 1 wherein the article is a sheet of paper.

### Claim 3 (depends on 1)

The interactive system of claim 1 wherein the position-coding pattern comprises a plurality of dots that represent binary codes.

### Claim 4 (depends on 1)

The interactive system of claim 1 wherein the different audio outputs comprise different music outputs associated with the plurality of positions.

### Claim 5

A handheld sensing device for use with an article comprising a surface having a position-coding pattern printed thereon, said position-coding pattern identifying a plurality of positions on the surface and a surface identity at each of said positions,
the sensing device having a housing, said housing containing:
(a) an optical sensor for reading codes from the position-coding pattern;
(b) a processor coupled to the optical sensor for determining a position of the sensing device and the surface identity using the read code;
(c) a memory unit comprising data for different audio outputs corresponding to different positions on the surface, the memory unit coupled to the processor; and
(d) an audio output device coupled to the processor,
wherein said handheld sensing device is configured to provide the different audio outputs to a user in response to optically sensing different positions of the position-coding pattern, and wherein the surface identity distinguishes the surface from a plurality of other surfaces.

### Claim 6 (depends on 5)

The sensing device of claim 5 wherein the article is a sheet of paper.

### Claim 7 (depends on 5)

The sensing device of claim 5 further comprising a transceiver coupled to the processor.

### Claim 8 (depends on 6)

A method for reading a code, the method comprising:
(a) providing an article comprising a surface having a position-coding pattern printed thereon, said position-coding pattern identifying a plurality of positions on the surface and a surface identity at each of said positions;
(b) reading a first code using the sensing device according to claim 6 and determining the surface identity and a first position using the first read code;
(c) retrieving and playing a first audio output corresponding to the first position in response to optically sensing the first code;
(d) reading a second code using the sensing device and determining a second position using the second read code; and
(e) retrieving and playing a second audio output corresponding to the second position in response to optically sensing the second code,
wherein the second audio output is different than the first audio output, and wherein the surface identity distinguishes the surface from a plurality of other surfaces.

### Claim 9 (depends on 8)

The method of claim 8 wherein the sensing device comprises a speaker.