# US 2019/0171310 A1 · Human-computer interface device and system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0171310 A1
- Document ID: US20190171310A1
- Status: Published application
- Kind: A1
- Application number: 16/240,822
- Filed: 2019-01-07
- Published: 2019-06-06
- Earliest claimed: 2014-09-02
- Assignees: Spring Power Holdings Limited
- Applicants: Spring Power Holdings Limited
- Inventors: David Hanson
- Web page: https://patentgrep.com/patent/US20190171310A1

## CPC

- G06F 3/0393: {Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads}
- A63F 13/20: Input arrangements for video game devices
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/2145: the surface being also a display device, e.g. touch screens
- A63F 13/245: specially adapted to a particular type of game, e.g. steering wheels
- A63F 13/424: involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
- A63F 13/426: involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun
- G06F 3/03543: {Mice or pucks (G06F3/03541 takes precedence)}
- G06F 3/03545: {Pens or stylus}
- G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06T 13/00: Animation
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06F 2203/04805: Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
- G06F 2203/04809: Textured surface identifying touch areas, e.g. overlay structure for a virtual keyboard
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An interface device for a computerized system, the interface device including an engagement element configured for operable engagement with a region on a touchscreen of the computerized system to enable interfacing with the computerized system via the touchscreen, wherein the engagement element includes a viewing surface configured to allow a representation of content that is displayed at the region on the touchscreen with which the engagement element is operably engaged, to be visible through the viewing surface.

## Claims

### Claim 1

A human-computer interface system including: a touchscreen configured for operable communication with a computerized system; and an engagement element configured such that, under the control of a human, it is operably engageable with a region on the touchscreen to enable human interfacing with the computerized system via the touchscreen;wherein the engagement element includes a viewing surface configured to allow a representation of content that is displayed at the region on the touchscreen with which the engagement element is operably engaged, to be visible through the viewing surface.

### Claim 2 (depends on 1)

The human-computer interface system as claimed in claim 1 wherein the engagement element includes at least one of a mouse and a stylus.

### Claim 3 (depends on 1)

The human-computer interface system as claimed in claims 1 wherein the viewing surface is substantially transparent.

### Claim 4 (depends on 1)

The human-computer interface system as claimed in claim 1 wherein the viewing surface is shaped to represent at least one of a gamepiece and a character.

### Claim 5 (depends on 1)

The human-computer interface system as claimed in claim 1 wherein the viewing surface includes a lens.

### Claim 6 (depends on 1)

The human-computer interface system as claimed in claim 1 wherein the representation of content that is displayed at the region on the touchscreen includes at least one of a static image and a video stream.

### Claim 7 (depends on 1)

The human-computer interface system as claimed in claim 1 wherein the representation of content includes an animation.

### Claim 8 (depends on 1)

The human-computer interface system as claimed in claim 1 wherein the representation of content includes an anthromorphic character.

### Claim 9 (depends on 1)

The human-computer interface system as claimed in claim 1 wherein the viewing surface is configured such that the representation of content displayed on the region of the touchscreen that is visible through the viewing surface is represented in three-dimensional form.

### Claim 10 (depends on 1)

The human-computer interface system as claimed in claim 1 configured such that an operational characteristic of the engagement element is able to be sensed by the touchscreen and whereby the touchscreen is configured to control an output characteristic of the representation of content at the region on the touchscreen that is visible through the viewing surface in response to the sensed operational characteristic of the engagement element.

### Claim 11 (depends on 10)

The human-computer interface system as claimed in claim 10 wherein the operational characteristic of the engagement element includes at least one of a type of the engagement element, a two-dimensional position/orientation of the engagement element relative to the touchscreen, a three-dimensional position/orientation of the engagement element relative to the touchscreen, and, a pattern of movement or a gesture of the engagement element relative to the touchscreen.

### Claim 12 (depends on 10)

The human-computer interface system as claimed in claim 10 including a touch signalling array wherein the operational characteristic of the engagement element is able to be sensed by the touchscreen by reference to the touch signalling array.

### Claim 13 (depends on 1)

The human-computer interface system as claimed in claim 1 wherein the system is configured for use as at least one of an automated assistant for a human, an advertising medium, a therapy tool, an educational medium, a toy, an entertainment medium, and a gamin medium.

### Claim 14

A robot for use with a touchscreen of a computerized system, the robot including: a positioning mechanism configured for positioning the robot at regions of the touchscreen; an engagement element configured to operably engage with the touchscreen, an operational characteristic of the robot being configured for sensing by a sensor of the computerized system when the engagement element is operably engaged with the touchscreen; and a processing module; wherein in response to the sensed operational characteristic of the robot, the processing module is configure to perform at least one of: (c) controlling the robot to perform an action by reference to the sensed operational characteristic of the robot; and (d) displaying a predetermined content on the touchscreen by reference to the sensed operational characteristic of the robot.

### Claim 15 (depends on 14)

The robot as claimed in claim 14 wherein the operational characteristic includes at least one of a type of the robot, and, a position/orientation of the robot.

### Claim 16 (depends on 14)

The robot as claimed in claim 14 wherein the processing module includes at least one of a smartphone and the touchscreen.

### Claim 17 (depends on 14)

The robot as claimed in claim 14 wherein the robot includes a viewing surface via which a representation of content displayed at a region of the touchscreen with which the robot is operably engaged is visible through the viewing surface.

### Claim 18 (depends on 14)

The robot as claimed in claim 14 including a sensor for sensing the operational characteristic of the robot by reference to a capacitive touchpad disposed on the robot which is configured to operably engage with a touch sensor array of the touchscreen.

### Claim 19 (depends on 14)

The robot as claimed in claim 14 wherein the computer is configured to control an action of the robot and to display content on the touchscreen which simulates an interaction between the robot and the content displayed on the touchscreen.

### Claim 20 (depends on 14)

The robot as claimed in claim 14 wherein the computerized system is configured to sense a position/orientation of human user, and, in response to the sensed position/orientation of the human user, control the robot to move toward the human user and/or perform a greeting.
