# US 2017/0257618 A1 · Converting a monocular camera into a binocular stereo camera

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0257618 A1
- Document ID: US20170257618A1
- Status: Published application
- Kind: A1
- Application number: 15/447,684
- Filed: 2017-03-02
- Published: 2017-09-07
- Earliest claimed: 2016-03-03
- Assignees: Disney Enterprises, Inc.
- Applicants: Disney Enterprises, Inc.
- Inventors: Eric C. HASELTINE; Joseph L. OLSON
- Web page: https://patentgrep.com/patent/US20170257618A1

## CPC

- H04N 13/218: using spatial multiplexing
- G02B 13/0065: {having a beam-folding prism or mirror}
- G02B 27/0172: {characterised by optical features}
- G03B 17/565: {Optical accessories, e.g. converters for close-up photography, tele-convertors, wide-angle convertors}
- G03B 35/00: Stereoscopic photography
- H04N 13/128: Adjusting depth or disparity
- H04N 13/296: Synchronisation thereof; Control thereof
- H04N 13/344: with head-mounted left-right displays
- G02B 2027/0127: {comprising devices increasing the depth of field}
- G02B 2027/0134: {of stereoscopic type}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- H04N 2213/001: Constructional or mechanical details
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)

## Abstract

An optical system, suitable for use within an augmented reality (AR)-capable display device, comprises a camera and an optical arrangement configured to acquire stereoscopic imagery of an object using the camera. The optical arrangement comprises a first reflective element arranged along a first optical path and defining a first convex surface configured to reflect first light received from the object as first reflected light, wherein at least a first portion of the first reflected light is directed onto a camera focal plane. The optical arrangement further comprises a second reflective element having a predefined disposition relative to the first reflective element. The second reflective element is arranged along a second optical path and defines a second convex surface configured to reflect second light received from the object as second reflected light, wherein at least a second portion of the second reflected light is directed onto the camera focal plane.

## Claims

### Claim 1

An optical system for an augmented reality (AR)-capable display device, the optical system comprising:
a camera having a camera focal plane; and
a first optical arrangement configured to acquire stereoscopic imagery of an object using the camera, the optical arrangement having a predefined disposition relative to a predefined first position of the camera, the first optical arrangement comprising:
a first reflective element arranged along a first optical path defined between the object and the camera, the first reflective element defining a first convex surface configured to reflect first light received from the object as first reflected light, wherein at least a first portion of the first reflected light is directed onto the camera focal plane; and
a second reflective element having a predefined disposition relative to the first reflective element, the second reflective element arranged along a second optical path defined between the object and the camera, the second reflective element defining a second convex surface configured to reflect second light received from the object as second reflected light, wherein at least a second portion of the second reflected light is directed onto the camera focal plane.

### Claim 2 (depends on 1)

The optical system of claim 1, further comprising:
a display; and
a second optical arrangement having a predefined disposition relative to a predefined second position of the display, the second optical arrangement defining a field of view for displaying light generated by the display.

### Claim 3 (depends on 2)

The optical system of claim 2, wherein the display and the camera are each included in a mobile computing device, the optical system further comprising:
a first mount element configured to removably attach with the mobile computing device to arrange the camera with the first position and to arrange the display with the second position.

### Claim 4 (depends on 1)

The optical system of claim 1, wherein the first convex surface is further configured to direct the first reflected light onto the camera focal plane, and
wherein the second convex surface is further configured to direct the second reflected light onto the camera focal plane.

### Claim 5 (depends on 1)

The optical system of claim 1, wherein the first optical arrangement further comprises:
a fold mirror element arranged along the first optical path and along the second optical path, the fold mirror element configured to direct the first portion of the first reflected light and the second portion of the second reflected light onto the camera focal plane.

### Claim 6 (depends on 1)

The optical system of claim 1, wherein the camera is included in a mobile computing device, the optical system further comprising:
a first mount element configured to removably attach with the mobile computing device to arrange the camera with the predefined position.

### Claim 7 (depends on 6)

The optical system of claim 6, wherein the first mount element defines an opening through which a portion of a surface of the mobile computing device is exposed, and
wherein the camera is arranged at the portion of the surface.

### Claim 8 (depends on 6)

The optical system of claim 6, wherein the first reflective element and the second reflective element are each coupled with a second mount element, the second mount element coupled with the first mount element.

### Claim 9 (depends on 8)

The optical system of claim 8, wherein the second mount element defines a mirrored surface that is arranged along the first optical path and along the second optical path, the mirrored surface configured to direct the first portion of the first light and the second portion of the second light onto the camera focal plane.

### Claim 10 (depends on 1)

The optical system of claim 1, wherein the first optical arrangement further comprises:
a prism subassembly configured to increase a field of view of the camera, the prism subassembly comprising:
a first prism element arranged between the camera and the first reflective element; and
a second prism element arranged between the camera and the second reflective element, the second prism element having a predefined disposition relative to the first prism element.

### Claim 11

An optical arrangement for acquiring stereoscopic imagery of an object using a single camera having a camera focal plane, the optical arrangement having a predefined disposition relative to a predefined position of the camera, the optical arrangement comprising:
a first reflective element arranged along a first optical path defined between the object and the camera, the first reflective element defining a first reflective surface;
a first beam splitter element arranged along the first optical path, the first beam splitter defining a first surface configured to direct, onto the camera focal plane, at least a first portion of first light reflected by the first reflective surface;
a second reflective element arranged along a second optical path defined between the object and the camera, the second reflective element defining a second reflective surface; and
a second beam splitter element having a predefined disposition relative to the first beam splitter element, the second beam splitter element defining a second surface configured to direct, onto the camera focal plane, a second portion of second light reflected by the second reflective surface.

### Claim 12 (depends on 11)

The optical arrangement of claim 11, wherein the first beam splitter element and the second beam splitter element are each substantially planar, and are joined together at an interface at substantially a 90-degree angle.

### Claim 13 (depends on 12)

The optical arrangement of claim 12, wherein the first reflective element and the second reflective element are each arranged to provide a predefined f-number of the optical arrangement that is selected to provide a predefined visibility reduction of the interface in the stereoscopic imagery.

### Claim 14 (depends on 11)

The optical arrangement of claim 11, wherein the first reflective surface comprises a first convex surface, and wherein the second reflective surface comprises a second convex surface.

### Claim 15 (depends on 11)

The optical arrangement of claim 11, wherein the second reflective element is further configured to:
when the object is arranged relative to the second reflective surface at an angle less than a predefined value, reflect the second light onto the camera focal plane.

### Claim 16 (depends on 11)

The optical arrangement of claim 11, wherein the first light, prior to being reflected by the first reflective surface, is transmitted through a third surface of the first beam splitter element that is opposing the first surface, and
wherein the second light, prior to being reflected by the second reflective surface, is transmitted through a fourth surface of the second beam splitter element that is opposing the second surface.

### Claim 17

A system comprising:
one or more computer processors;
a camera having a camera focal plane; and
an optical arrangement having a predefined disposition relative to a predefined position of the camera, the optical arrangement comprising:
a first reflective element arranged along a first optical path defined between an object and the camera, the first reflective element defining a first reflective surface;
a first beam splitter element arranged along the first optical path, the first beam splitter defining a first surface configured to direct, onto the camera focal plane, at least a first portion of first light reflected by the first reflective surface; and
a second reflective element arranged along a second optical path defined between the object and the camera, the second reflective element defining a second reflective surface, wherein second light is directed onto the camera focal plane via the second reflective surface, and
wherein the one or more computer processors are configured to determine, using the first portion of the first light and the second light, at least one of depth information and positional information of the object.

### Claim 18 (depends on 17)

The system of claim 17, wherein the optical arrangement further comprises:
a second beam splitter element having a predefined disposition relative to the first beam splitter element, the second beam splitter element defining a second surface configured to direct the second light onto the camera focal plane,
wherein the second light is reflected by the second reflective surface prior to being directed by the second surface onto the camera focal plane.

### Claim 19 (depends on 17)

The system of claim 17, wherein the second reflective element is further configured to:
when the object is arranged relative to the second reflective surface at an angle less than a predefined value, reflect the second light onto the camera focal plane.

### Claim 20 (depends on 19)

The system of claim 19, wherein the optical arrangement further comprises:
a second beam splitter element having a predefined disposition relative to the first beam splitter element, the second beam splitter element defining a second surface configured to direct the second light onto the camera focal plane,
wherein the second light is reflected by the second reflective surface prior to being directed by the second surface onto the camera focal plane, and
wherein determining at least one of depth information and positional information of the object comprises:
using first image processing operations upon determining the second reflective element reflects the second light onto the camera focal plane; and
using second image processing operations upon determining the second surface of the second beam splitter element directs the second light onto the camera focal plane.
