# US 2020/0401031 A1 · Information processing apparatus, information processing method, and recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0401031 A1
- Document ID: US20200401031A1
- Status: Published application
- Kind: A1
- Application number: 16/979,164
- Filed: 2018-12-20
- Published: 2020-12-24
- Earliest claimed: 2018-03-16
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: TAKUYA IKEDA; FUMIHIKO IIDA; KENTARO IDA; OSAMU SHIGETA
- Web page: https://patentgrep.com/patent/US20200401031A1

## CPC

- G03B 21/2053: {Intensity control of illuminating light (controlled by video signal processing H04N5/74 or H04N9/31)}
- H04N 9/3194: {including sensor feedback}
- G03B 21/145: {Housing details, e.g. position adjustments thereof}
- G03B 21/2046: {Positional adjustment of light sources}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)}
- G09G 5/00: Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T)
- G09G 5/02: characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)}
- G09G 5/08: Cursor circuits
- G09G 5/36: characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- H04N 9/3179: {Video signal processing therefor}
- H04N 9/3182: {Colour adjustment, e.g. white balance, shading or gamut (white balance per se H04N9/73; control of amplitude of colour signals H04N9/68; colour control circuits for displays in general G09G5/02, G09G3/2003, G09G3/3607)}
- H04N 21/4122: {additional display device, e.g. video projector (digital output for controlling a plurality of local displays G06F3/1423)}
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

[Problem] An information processing apparatus, an information processing method, and a recording medium with which a user can recognize a boundary of a drivable range by feedback for a projection specification position by the user to facilitate determination of and search for a projection position are provided. [Solution] The information processing apparatus includes a controller configured to perform processing of outputting feedback indicating an effect corresponding to a boundary of a drivable region of a drive-type projector in a projection environment space in accordance with a state of a projection specification position specified by a user for the drivable region, the state being determined based on the drivable region and the projection specification position.

## Claims

### Claim 1

An information processing apparatus comprising a controller configured to perform processing of outputting feedback indicating an effect corresponding to a boundary of a drivable region of a drive-type projector in a projection environment space in accordance with a state of a projection specification position specified by a user for the drivable region, the state being determined based on the drivable region and the projection specification position.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein
the state that is determined includes a distance between the projection specification position and the boundary, and
the controller controls intensity of the effect in accordance with the distance between the projection specification position and the boundary.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein the controller performs the feedback by reflecting the effect in accordance with the determined state to a projection image, sound output, drive control of the drive-type projector, or vibration control of an input device of the projection specification position.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3, wherein the controller intensifies the effect as the distance between the projection specification position and the boundary in the vicinity of the projection specification position is shorter in a state where the projection specification position is located inside the drivable region.

### Claim 5 (depends on 4)

The information processing apparatus according to claim 4, wherein the controller changes a shape or a color tone of a pointer image or a content image projected onto the projection specification position, as the effect.

### Claim 6 (depends on 5)

The information processing apparatus according to claim 5, wherein the controller decreases a size of the pointer image or the content image projected at the projection specification position or causes the pointer image or the content image to wane as the projection specification position becomes closer to the boundary, as the effect.

### Claim 7 (depends on 5)

The information processing apparatus according to claim 5, wherein the controller does not display a portion of a region of the pointer image or the content image that is located outside the boundary, as the effect.

### Claim 8 (depends on 5)

The information processing apparatus according to claim 5, wherein when the pointer image or the content image is close to the boundary and reaches the boundary, the controller performs display in which the pointer image or the content image hits the boundary and swings, display in which a color tone of the pointer image or the content image is changed, display in which the pointer image or the content image flashes, or display in which the pointer image or the content image rebounds, as the effect.

### Claim 9 (depends on 5)

The information processing apparatus according to claim 5, wherein the controller changes a color tone of a portion of a region of the pointer image or the content image that is located outside the boundary, as the effect.

### Claim 10 (depends on 5)

The information processing apparatus according to claim 5, wherein the controller changes a drawing position in a projection image such that the pointer image or the content image does not protrude outside the boundary, as the effect.

### Claim 11 (depends on 4)

The information processing apparatus according to claim 4, wherein the controller displays an undrivable region as a region outside the boundary, as the effect.

### Claim 12 (depends on 11)

The information processing apparatus according to claim 11, wherein the controller intensifies a color tone of the undrivable region as the projection specification position becomes closer to the boundary.

### Claim 13 (depends on 1)

The information processing apparatus according to claim 1, wherein the controller displays a bird's-eye view image of the projection environment space that indicates a trajectory of the projection specification position and the drivable region in a state where the projection specification position is moved to inside of the drivable region from outside.

### Claim 14 (depends on 2)

The information processing apparatus according to claim 2, wherein the controller displays an effect image that changes in accordance with a shortest distance between the boundary and the projection specification position at a position on the boundary in a state where the projection specification position is moved to inside of the drivable region from outside.

### Claim 15 (depends on 2)

The information processing apparatus according to claim 2, wherein the controller displays an effect image that extends in a direction of the projection specification position from a position on the boundary and changes in accordance with a distance to the projection specification position in a state where the projection specification position is moved to inside of the drivable region from outside.

### Claim 16 (depends on 1)

The information processing apparatus according to claim 1, wherein the controller displays a bird's-eye view image of the projection environment space that indicates a trajectory of the projection specification position and the drivable region in a state where the projection specification position is located outside the drivable region for constant time.

### Claim 17 (depends on 1)

The information processing apparatus according to claim 1, wherein the controller dynamically changes the drivable region in accordance with environment change of the projection environment space.

### Claim 18 (depends on 1)

The information processing apparatus according to claim 1, wherein the controller determines, to the boundary, a boundary of a region on which the drivable region and a recognizable region of a sensor detecting the projection specification position overlap each other.

### Claim 19

An information processing method comprising
outputting, by a processor, feedback indicating an effect corresponding to a boundary of a drivable region of a drive-type projector in a projection environment space in accordance with a state of a projection specification position specified by a user for the drivable region, the state being determined based on the drivable region and the projection specification position.

### Claim 20

A recording medium recording a computer program for causing a computer to function as a controller that performs processing of outputting feedback indicating an effect corresponding to a boundary of a drivable region of a drive-type projector in a projection environment space in accordance with a state of a projection specification position specified by a user for the drivable region, the state being determined based on the drivable region and the projection specification position.
