# US 2017/0257614 A1 · Three-dimensional auto-focusing display method and system thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0257614 A1
- Document ID: US20170257614A1
- Status: Published application
- Kind: A1
- Application number: 15/143,570
- Filed: 2016-04-30
- Published: 2017-09-07
- Earliest claimed: 2016-03-04
- Assignees: Liquid3D Solutions Limited
- Applicants: Liquid3D Solutions Limited
- Inventors: JOHNNY PAUL ZHENG-HAO WANG
- Web page: https://patentgrep.com/patent/US20170257614A1

## CPC

- H04N 13/144: for flicker reduction
- H04N 13/122: Improving the three-dimensional [3D] impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues (H04N13/128 takes precedence)
- H04N 13/128: Adjusting depth or disparity
- H04N 13/204: using stereoscopic image cameras (stereoscopic photography G03B35/00)
- H04N 13/271: wherein the generated image signals comprise depth maps or disparity maps
- H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
- H04N 13/398: Synchronisation thereof; Control thereof
- H04N 2013/0074: {Stereoscopic image analysis}
- H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals}
- H04N 2213/002: Eyestrain reduction by processing stereoscopic signals or controlling stereoscopic devices
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A 3D auto-focusing display method comprises executing an eye-tracking step on a 3D image to obtain focal point coordinates (x1, y1) of viewers of the image, mapping the focal point coordinates (x1, y1) of viewers to a coordinate location of a display to obtain display coordinates (x2, y2) for defining the coordinate location of the display corresponding to a depth diagram of the 3D image, determining a region where the image is located by using the display coordinates (x2, y2) as an input parameter and by use of the depth diagram of the image, determining whether the image is 3D stereoscopic images according to the region and executing a depth map step to revise the 3D image based on the image and a plurality of depth data of the region to reflect the display coordinates (x2, y2) as a focused image, and outputting the revised focused image to the display.

## Claims

### Claim 1

A three-dimensional (3D) auto-focusing display method, comprising:
providing an image;
executing an eye-tracking step on the image to obtain focal point coordinates (x1, y1) of viewers of the image;
mapping the focal point coordinates (x1, y1) of viewers to a coordinate location of a display to obtain display coordinates (x2, y2) for defining the coordinate location of the display corresponding to a depth diagram of the image;
determining a region where the image is located by using the display coordinates (x2, y2) as an input parameter and by use of the depth diagram of the image;
determining whether the image is three-dimensional (3D) stereoscopic images according to the region where the image is located, and executing a depth map step to revise the 3D image based on the image and a plurality of depth data of the region to reflect the display coordinates (x2, y2) as a focused image; and
outputting the revised focused image to the display to display 3D stereoscopic images on the display.

### Claim 2 (depends on 1)

The three-dimensional (3D) auto-focusing display method as claimed in claim 1, wherein the image is one of a landscape, portrait or physical substance goods.

### Claim 3 (depends on 1)

The three-dimensional (3D) auto-focusing display method as claimed in claim 1, wherein the depth diagram of the image is a combination of a plurality of segments of different regions.

### Claim 4 (depends on 3)

The three-dimensional (3D) auto-focusing display method as claimed in claim 3, wherein each segment is defined as a set of pixels of the image, and the image has a same depth value or in a range of the same depth value.

### Claim 5

A three-dimensional (3D) auto-focusing display system, comprising:
a front viewer image capturing sensor module used for performing an eye-tracking function on an image to obtain focal point coordinates (x1, y1) of viewers of the image;
a rear viewer image capturing sensor module used for capturing the image;
an image processing module used for processing the image to obtain display coordinates (x2, y2) corresponding to the image and to display the image as a 3D stereoscopic image; and
a display module used for displaying the 3D stereoscopic image.

### Claim 6 (depends on 5)

The three-dimensional (3D) auto-focusing display system as claimed in claim 5, wherein the front viewer image capturing sensor module is a camera apparatus with sensors or a web camera apparatus with pupil detection function.

### Claim 7 (depends on 5)

The three-dimensional (3D) auto-focusing display system as claimed in claim 5, wherein the rear viewer image capturing sensor module is one of a time-of-flight camera apparatus, a stereoscopic camera apparatus, and a web camera apparatus with image depth generating function.

### Claim 8 (depends on 5)

The three-dimensional (3D) auto-focusing display system as claimed in claim 5, wherein the image processing module further uses a two-dimensional (2D) image and information of a depth diagram corresponding to the 2D image to form the 3D stereoscopic images.

### Claim 9 (depends on 5)

The three-dimensional (3D) auto-focusing display system as claimed in claim 5, wherein the image processing module further executes a number of image analyses and filtering algorithm on the 3D stereoscopic images, and corrects the 3D stereoscopic images in use of image data and depth diagram data.

### Claim 10 (depends on 5)

The three-dimensional (3D) auto-focusing display system as claimed in claim 5, wherein the image processing module further uses a method of extrapolating to extrapolate the focal point coordinates (x1, y1) of viewers, and therefore executes auto-focusing and translates the focal point coordinates (x1, y1) of viewers into the display coordinates (x2, y2) with respect to the display module, and confirms segments of the image in order to reflect the display coordinates (x2, y2), and to form a suitable stereoscopic gained image and confirm the 3D stereoscopic image being displayed is located on a focus of the display module.
