# US 2018/0324397 A1 · Projecting obstructed content over touch screen obstructions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0324397 A1
- Document ID: US20180324397A1
- Status: Published application
- Kind: A1
- Application number: 15/982,391
- Filed: 2018-05-17
- Published: 2018-11-08
- Earliest claimed: 2017-05-08
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: James E. BOSTICK; John M. GANCI, JR.; Martin G. KEEN; Sarbajit K. RAKSHIT
- Web page: https://patentgrep.com/patent/US20180324397A1

## CPC

- H04N 9/3179: {Video signal processing therefor}
- G06F 3/042: by opto-electronic means
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- H04N 9/3173: {wherein the projection device is specially adapted for enhanced portability}
- H04N 9/3176: {wherein the projection device is incorporated in a camera (details of cameras adapted for combination with a projector not peculiar to the presence of an electronic spatial light modulator G03B17/54)}
- H04N 9/3194: {including sensor feedback}
- H04W 76/10: Connection setup
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Systems and methods for detecting and projecting obstructed content over touch screen obstructions are disclosed. In embodiments, a computer-implemented method, includes: displaying, by a computing device, content on a touch screen of the computing device; detecting, by the computing device, an obstruction of the content on one or more areas of the touch screen; determining, by the computing device, obstructed content in the one or more areas; determining, by the computing device, a display configuration for a portion of the obstructed content, wherein the display configuration defines a manner in which the portion of the obstructed content is to be projected by at least one wearable projector device; and sending, by the computing device, the display configuration to the at least one wearable projector device adapted to project the portion of the obstructed content over at least one object causing the obstruction of the content.

## Claims

### Claim 1

A computer-implemented method for projecting obstructed content over touch screen obstructions by a wearable projector device comprising:
receiving, by a wearable projector device, a display configuration from a remote computing device, wherein the display configuration defines a manner in which a portion of content on a touchscreen, obstructed from a user's view by an obstructing object, is to be projected by the wearable projector device; and
projecting, by the wearable projector device, the portion of the content obstructed over the obstructing object.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
detecting, by the wearable projector device, the portion of content on the touchscreen obstructed from the user's view to generate obstruction of content data; and
sending, by the wearable projector device, the obstruction of content data to the remote computing device.

### Claim 3 (depends on 2)

The method of claim 2, wherein the detecting the portion of content on the touchscreen obstructed from the user's view is performed by a camera of the wearable projector device.

### Claim 4 (depends on 1)

The method of claim 1, wherein the wearable projector device is selected from the group consisting of: a ring, a smartwatch, and smartglasses.

### Claim 5 (depends on 1)

The method of claim 1, further comprising wirelessly pairing the wearable projector device with the remote computing device.

### Claim 6 (depends on 1)

The method of claim 1, wherein the display configuration is based on the user's facial direction.

### Claim 7 (depends on 1)

The method of claim 1, wherein the display configuration comprises a reformatted version of the portion of content on the touchscreen obstructed from the user's view, wherein the reformatted version is different from an original version of the portion of content on the touchscreen obstructed from the user's view.

### Claim 8 (depends on 1)

The method of claim 1, wherein the projecting the portion of the content obstructed over the obstructing object is performed by a pico-projector of the wearable projector device.

### Claim 9

A computer program product for projecting obstructed content over touch screen obstructions, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a wearable projector device to cause the wearable projector device to:
receive a display configuration from a remote computing device, wherein the display configuration defines a manner in which a portion of content on a touchscreen, obstructed from a user's view by an obstructing object, is to be projected by the wearable projector device; and
project the portion of the content obstructed over the obstructing object.

### Claim 10 (depends on 9)

The computer program product of claim 9, wherein the program instructions further cause the wearable projector device to:
detect the portion of content on the touchscreen obstructed from the user's view to generate obstruction of content data; and
send the obstruction of content data to the remote computing device.

### Claim 11 (depends on 9)

The computer program product of claim 9, wherein the detecting the portion of content on the touchscreen obstructed from the user's view is performed by a camera of the wearable projector device.

### Claim 12 (depends on 10)

The computer program product of claim 10, wherein the wearable projector device is selected from the group consisting of: a ring, a smartwatch, and smartglasses.

### Claim 13 (depends on 9)

The computer program product of claim 9, wherein the program instructions further cause the wearable projector device to: wirelessly pair with the remote computing device.

### Claim 14 (depends on 9)

The computer program product of claim 9, wherein the display configuration is based on the user's facial direction.

### Claim 15 (depends on 9)

The computer program product of claim 9, wherein the display configuration comprises a reformatted version of the portion of content on the touchscreen obstructed from the user's view, wherein the reformatted version is different from an original version of the portion of content on the touchscreen obstructed from the user's view.

### Claim 16 (depends on 9)

The computer program product of claim 9, wherein the projecting the portion of the content obstructed over the obstructing object is performed by a pico-projector of the wearable projector device.

### Claim 17

A system for detecting and projecting obstructed content over touch screen obstructions, comprising:
a CPU, a computer readable memory and a computer readable storage medium associated with a computing device;
program instructions stored on the computer readable storage medium for execution by the CPU via the computer readable memory, the program instructions of the computing device including:
program instructions to display content on a touch screen of the computing device;
program instructions to detect an obstruction of the content on an area of the touch screen by an obstructing object, wherein the user's view of the content is obstructed;
program instructions to determine obstructed content in the area of the touch screen;
program instructions to determine a display configuration for a portion of the obstructed content, wherein the display configuration defines a manner in which the portion of the obstructed content is to be projected by a wearable projector device; and
program instructions to send the display configuration to the wearable projector device;
a wearable projector device including a communications module;
program instructions stored in the communications module of the wearable projector device for execution by the wearable projector device, the program instructions of the computing device including:
program instructions to receive the display configuration from the CPU; and
program instructions to project the portion of the obstructed content over the obstructing object.

### Claim 18 (depends on 17)

The system of claim 17, further comprising program instructions stored in the computer readable storage medium to determine a facial direction of the user relative to the touch screen, wherein the CPU utilizes the facial direction in determining the display configuration.

### Claim 19 (depends on 17)

The system of claim 17, further comprising program instructions stored in the computer readable storage medium of the CPU to:
pair the CPU with one or more remote cameras; and
detect, in real time, the obstruction of the content on the area of the touch screen utilizing data from the one or more remote cameras to detect the obstructed content.

### Claim 20 (depends on 17)

The system of claim 17, wherein the wearable projector device is selected from the group consisting of a ring, a watch and glasses.
