# US 2025/0124538 A1 · Electronic device for projecting image onto screen including plurality of surfaces, and control method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0124538 A1
- Document ID: US20250124538A1
- Status: Published application
- Kind: A1
- Application number: 18/999,609
- Filed: 2024-12-23
- Published: 2025-04-17
- Earliest claimed: 2022-06-23
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Youngchol LEE; Byungseok SOH; Bonseuk GOO; Youngtae KIM; Kisung LEE; Weonhee LEE; Yongseok JANG
- Web page: https://patentgrep.com/patent/US20250124538A1

## CPC

- G03B 17/54: with projector
- G03B 21/14: Details
- G03B 21/606: for relief projection
- G06T 3/08: Projecting images onto non-planar surfaces, e.g. geodetic screens
- G06T 7/11: Region-based segmentation
- H04N 9/31: Projection devices for colour picture display {, e.g. using electronic spatial light modulators [ESLM]}
- H04N 13/327: Calibration thereof
- H04N 13/363: using image projection screens (volumetric display H04N13/388)
- G06T 7/50: Depth or shape recovery
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An electronic device includes: a projector; a camera; one or more processors; and memory storing instructions that, when executed by the one or more processors, cause the electronic device to: control the projector to display a projected image on a screen, wherein the screen includes surfaces; control the camera to obtain a captured image including the surfaces and the projected image; identify, based on the captured image, shapes of the surfaces and areas of the projected image projected onto the surfaces; and correct the projected image, based on the shapes of the surfaces and the areas of the projected image, by transforming the projected image into one from among a three-dimensional image and a flat image.

## Claims

### Claim 1

An electronic device comprising:
a projector;
a camera;
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the electronic device to:
control the projector to display a projected image on a screen, wherein the screen comprises a plurality of surfaces;
control the camera to obtain a captured image comprising the plurality of surfaces and the projected image;
identify, based on the captured image, shapes of the plurality of surfaces and a plurality of areas of the projected image projected onto the plurality of surfaces; and
correct the projected image, based on the shapes of the plurality of surfaces and the plurality of areas of the projected image, by transforming the projected image into one from among a three-dimensional image and a flat image.

### Claim 2 (depends on 1)

The electronic device as claimed in claim 1, wherein the one or more processors are configured to execute the instructions to cause the electronic device to correct the projected image by transforming the projected image into the three-dimensional image based on:
the plurality of surfaces comprising a first surface and a second surface, and
a smallest area, from among a first area projected onto the first surface and a second area projected onto the second surface, having a horizontal top edge or a horizontal bottom edge.

### Claim 3 (depends on 2)

The electronic device as claimed in claim 2, wherein the one or more processors are configured to execute the instructions to cause the electronic device to:
segment the projected image into the first area and the second area;
correct the first area by transforming the first area into a right-angled rectangular shape;
correct the second area by transforming the second area into a parallelogram;
obtain a merged image by merging the first area and the second area; and
project the merged image.

### Claim 4 (depends on 1)

The electronic device as claimed in claim 1, wherein the one or more processors are configured to execute the instructions to cause the electronic device to correct the projected image by transforming the projected image into the three-dimensional image based on:
the plurality of surfaces comprising three surfaces, and
the plurality of areas of the projected image each having four or more edges.

### Claim 5 (depends on 4)

The electronic device as claimed in claim 4, wherein the one or more processors are configured to execute the instructions to cause the electronic device to:
segment the projected image into three areas;
correct the three areas, based on three corresponding surface shapes, by transforming the three areas into parallelograms;
obtain a merged image by merging the three areas; and
project the merged image.

### Claim 6 (depends on 1)

The electronic device as claimed in claim 1, wherein the one or more processors are configured to execute the instructions to cause the electronic device to correct the projected image by transforming the projected image into the flat image based on:
the plurality of surfaces comprising three surfaces, and
at least one of the plurality of areas of the projected image comprising three edges.

### Claim 7 (depends on 6)

The electronic device as claimed in claim 6, wherein the one or more processors are configured to execute the instructions to cause the electronic device to:
segment the projected image into three areas;
correct two side areas, from among the three areas, to have parallel bottom edges;
obtain a merged image by merging the three areas; and
project the merged image.

### Claim 8 (depends on 1)

The electronic device as claimed in claim 1, wherein the one or more processors are configured to execute the instructions to cause the electronic device to:
determine whether movement of the electronic device has occurred; and
identify, based on determining no movement has occurred:
the shapes of the plurality of surfaces, and
the plurality of areas of the projected image.

### Claim 9 (depends on 8)

The electronic device as claimed in claim 8, wherein the one or more processors are configured to execute the instructions to cause the electronic device to determine whether movement of the electronic device has occurred by detecting movement of the projected image in the captured image.

### Claim 10 (depends on 8)

The electronic device as claimed in claim 8, further comprising a sensor,
wherein the one or more processors are configured to execute the instructions to cause the electronic device to:
control the sensor to obtain detected information about movement of the electronic device; and
determine whether movement of the electronic device has occurred based on the detected information.

### Claim 11

A control method of an electronic device, comprising:
displaying a projected image on a screen including a plurality of surfaces;
obtaining a captured image comprising the plurality of surfaces and the projected image;
identifying, based on the captured image, shapes of the plurality of surfaces and a plurality of areas of the projected image; and
correcting the projected image, based on the shapes of the plurality of surfaces and the plurality of areas of the projected image, by transforming the projected image into one from among a three-dimensional image and a flat image.

### Claim 12 (depends on 11)

The control method as claimed in claim 11, wherein the correcting the projected image comprises transforming the projected image into the three-dimensional image based on:
the plurality of surfaces including a first surface and a second surface, and
a smallest area, from among a first area projected onto the first surface and a second area projected onto the second surface, having a horizontal top edge or a horizontal bottom edge.

### Claim 13 (depends on 12)

The control method as claimed in claim 12, wherein the correcting the projected image comprises:
segmenting the projected image into the first area and the second area;
correcting the first area by transforming the first area into a right-angled rectangular shape;
correcting the second area by transforming the second area into a parallelogram;
obtaining a merged image by merging the first area and the second area; and
projecting the merged image.

### Claim 14 (depends on 11)

The control method as claimed in claim 11, wherein the correcting the projected image comprises transforming the projected image into the three-dimensional image based on:
the plurality of surfaces including three surfaces, and
the plurality of areas of the projected image each having four or more edges.

### Claim 15 (depends on 14)

The control method as claimed in claim 14, wherein the correcting the projected image comprises:
segmenting the projected image into three areas;
correcting the three areas, based on three corresponding surface shapes, by transforming the three areas into parallelograms;
obtaining a merged image by merging the three areas; and
projecting the merged image.

### Claim 16 (depends on 11)

The control method as claimed in claim 11, wherein the correcting the projected image comprises transforming the projected image into the flat image based on:
the plurality of surfaces comprising three surfaces, and
at least one of the plurality of areas of the projected image comprising three edges.

### Claim 17 (depends on 16)

The control method as claimed in claim 16, wherein the correcting the projected image comprises:
segmenting the projected image into three areas;
correcting two side areas, from among the three areas, to have parallel bottom edges;
obtaining a merged image by merging the three areas; and
projecting the merged image.

### Claim 18 (depends on 11)

The control method as claimed in claim 11, wherein the identifying the shapes of the plurality of surfaces and the plurality of areas of the projected image comprises:
determining whether movement of the electronic device has occurred; and
identifying, based on determining no movement has occurred:
the shapes of the plurality of surfaces, and
the plurality of areas of the projected image.

### Claim 19 (depends on 18)

The control method as claimed in claim 18, wherein the determining whether the movement has occurred is based on detecting movement of the projected image in the captured image.

### Claim 20

A non-transitory computer-readable recording medium having instructions recorded thereon, that, when executed by one or more processors, cause the one or more processors to:
control a projector to display a projected image on a screen, wherein the screen comprises a plurality of surfaces;
control a camera to obtain a captured image comprising the plurality of surfaces and the projected image;
identify, based on the captured image, shapes of the plurality of surfaces and a plurality of areas of the projected image projected onto the plurality of surfaces; and
correct the projected image, based on the shapes of the plurality of surfaces and the plurality of areas of the projected image, by transforming the projected image into one from among a three-dimensional image and a flat image.
