# US 10,455,214 B2 · Converting a monocular camera into a binocular stereo camera

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,455,214 B2
- Document ID: US10455214B2
- Status: Granted
- Kind: B2
- Application number: 15/447,684
- Filed: 2017-03-02
- Published: 2017-09-07
- Granted: 2019-10-22
- Earliest claimed: 2016-03-03
- Assignees: Disney Enterprises, Inc.
- Applicants: Disney Enterprises, Inc.
- Inventors: Eric C. Haseltine; Joseph L. Olson
- Web page: https://patentgrep.com/patent/US10455214B2

## CPC

- H04N 13/218: using spatial multiplexing
- G02B 13/0065: {having a beam-folding prism or mirror}
- G02B 27/0172: {characterised by optical features}
- G03B 17/565: {Optical accessories, e.g. converters for close-up photography, tele-convertors, wide-angle convertors}
- G03B 35/00: Stereoscopic photography
- H04N 13/128: Adjusting depth or disparity
- H04N 13/296: Synchronisation thereof; Control thereof
- H04N 13/344: with head-mounted left-right displays
- G02B 2027/0127: {comprising devices increasing the depth of field}
- G02B 2027/0134: {of stereoscopic type}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- H04N 2213/001: Constructional or mechanical details
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)

## Abstract

An optical system, suitable for use within an augmented reality (AR)-capable display device, comprises a camera and an optical arrangement configured to acquire stereoscopic imagery of an object using the camera. The optical arrangement comprises a first reflective element arranged along a first optical path and defining a first convex surface configured to reflect first light received from the object as first reflected light, wherein at least a first portion of the first reflected light is directed onto a camera focal plane. The optical arrangement further comprises a second reflective element having a predefined disposition relative to the first reflective element. The second reflective element is arranged along a second optical path and defines a second convex surface configured to reflect second light received from the object as second reflected light, wherein at least a second portion of the second reflected light is directed onto the camera focal plane.

## Claims

### Claim 1

An optical system for an augmented reality (AR)-capable display device, the optical system comprising:
a mobile computing device comprising a camera having a camera focal plane;
a first mount element to which the mobile computing device is removably attached, thereby arranging the camera in a first position;
a second mount element comprising a planar surface, wherein the second mount element is coupled with the first mount element at a proximal end of the planar surface; and
a first optical arrangement configured to acquire stereoscopic imagery of an object using the camera, the optical arrangement having a predefined disposition relative to the first position of the camera, the first optical arrangement comprising:
a first reflective element arranged at a distal end of the planar surface and having a first convex surface extending from the planar surface, the first reflective element arranged along a first optical path defined between the object and the camera, wherein the first convex surface is configured to reflect first light received from the object as first reflected light, wherein at least a first portion of the first reflected light is directed onto the camera focal plane; and
a second reflective element arranged at the distal end of the planar surface and having a second convex surface extending from the planar surface, the second reflective element spaced apart from the first reflective element and arranged along a second optical path defined between the object and the camera, wherein the second convex surface of the second reflective element is configured to reflect second light received from the object as second reflected light, wherein at least a second portion of the second reflected light is directed onto the camera focal plane.

### Claim 2 (depends on 1)

The optical system of claim 1, further comprising:
a display; and
a second optical arrangement having a predefined disposition relative to a predefined second position of the display, the second optical arrangement defining a field of view for displaying light generated by the display.

### Claim 3 (depends on 2)

The optical system of claim 2,
wherein the display is included in the mobile computing device, and
wherein the first mount element is further configured to arrange the display with the second position when the mobile computing device is removably attached to the first mount element.

### Claim 4 (depends on 2)

The optical system of claim 2, wherein the mobile computing device, the first mount element, and the first optical arrangement are arranged outside the field of view defined by the second optical arrangement.

### Claim 5 (depends on 1)

The optical system of claim 1, wherein the first convex surface is further configured to direct the first reflected light onto the camera focal plane, and
wherein the second convex surface is further configured to direct the second reflected light onto the camera focal plane.

### Claim 6 (depends on 1)

The optical system of claim 1, wherein the first optical arrangement further comprises:
a fold mirror element arranged at the planar surface, the fold mirror element configured to direct the first portion of the first reflected light and the second portion of the second reflected light onto the camera focal plane.

### Claim 7 (depends on 1)

The optical system of claim 1, wherein the first mount element defines an opening through which a portion of a surface of the mobile computing device is exposed, and
wherein the camera is arranged at the portion of the surface.

### Claim 8 (depends on 1)

The optical system of claim 1, wherein the planar surface is a mirrored surface that is arranged along the first optical path and along the second optical path, the mirrored surface configured to direct the first portion of the first light and the second portion of the second light onto the camera focal plane.

### Claim 9 (depends on 1)

The optical system of claim 1, wherein the first optical arrangement further comprises:
a prism subassembly configured to increase a field of view of the camera, the prism subassembly comprising:
a first prism element arranged between the camera and the first reflective element; and
a second prism element arranged between the camera and the second reflective element, the second prism element having a predefined disposition relative to the first prism element.

### Claim 10

An optical arrangement for acquiring stereoscopic imagery of an object using a single camera of a mobile computing device, the camera having a camera focal plane, the mobile computing device removably attached to a first mount element that arranges the camera in a first position, the optical arrangement having a predefined disposition relative to the first position of the camera, the optical arrangement comprising:
a first reflective element arranged at a distal end of a planar surface of a second mount element, the first reflective element having a first convex surface extending from the planar surface, the first reflective element arranged along a first optical path defined between the object and the camera, the second mount element coupled with the first mount element at a proximal end of the planar surface;
a first beam splitter element arranged along the first optical path, the first beam splitter defining a first surface configured to direct, onto the camera focal plane, at least a first portion of first light reflected by the first convex surface;
a second reflective element arranged at the distal end of the planar surface of the second mount element, the second reflective element having a second convex surface extending from the planar surface, the second reflective element spaced apart from the first reflective element, the second reflective element arranged along a second optical path defined between the object and the camera; and
a second beam splitter element having a predefined disposition relative to the first beam splitter element, the second beam splitter element defining a second surface configured to direct, onto the camera focal plane, a second portion of second light reflected by the second convex surface.

### Claim 11 (depends on 10)

The optical arrangement of claim 10, wherein the first beam splitter element and the second beam splitter element are each substantially planar, and are joined together at an interface at substantially a 90-degree angle.

### Claim 12 (depends on 11)

The optical arrangement of claim 11, wherein the first reflective element and the second reflective element are each arranged to provide a predefined f-number of the optical arrangement that is selected to provide a predefined visibility reduction of the interface in the stereoscopic imagery.

### Claim 13 (depends on 10)

The optical arrangement of claim 10, wherein the second reflective element is further configured to:
when the object is arranged relative to the second convex surface at an angle less than a predefined value, reflect the second light onto the camera focal plane.

### Claim 14 (depends on 10)

The optical arrangement of claim 10, wherein the first light, prior to being reflected by the first convex surface, is transmitted through a third surface of the first beam splitter element that is opposing the first surface, and
wherein the second light, prior to being reflected by the second convex surface, is transmitted through a fourth surface of the second beam splitter element that is opposing the second surface.

### Claim 15

A system comprising:
one or more computer processors;
a mobile computing device comprising a camera having a camera focal plane;
a first mount element to which the mobile computing device is removably attached, thereby arranging the camera in a first position;
a second mount element comprising a planar surface, wherein the second mount element is coupled with the first mount element at a proximal end of the planar surface; and
an optical arrangement having a predefined disposition relative to the first position of the camera, the optical arrangement comprising:
a first reflective element arranged at a distal end of the planar surface and having a first convex surface extending from the planar surface, the first reflective element arranged along a first optical path defined between an object and the camera;
a first beam splitter element arranged along the first optical path, the first beam splitter defining a first surface configured to direct, onto the camera focal plane, at least a first portion of first light reflected by the first convex surface; and
a second reflective element arranged at the distal end of the planar surface of the second mount element, the second reflective element having a second convex surface extending from the planar surface, the second reflective element spaced apart from the first reflective element, the second reflective element arranged along a second optical path defined between the object and the camera, wherein second light is directed onto the camera focal plane via the second convex surface, and
wherein the one or more computer processors are configured to determine, using the first portion of the first light and the second light, at least one of depth information and positional information of the object.

### Claim 16 (depends on 15)

The system of claim 15, wherein the optical arrangement further comprises:
a second beam splitter element having a predefined disposition relative to the first beam splitter element, the second beam splitter element defining a second surface configured to direct the second light onto the camera focal plane,
wherein the second light is reflected by the second convex surface prior to being directed by the second surface onto the camera focal plane.

### Claim 17 (depends on 15)

The system of claim 15, wherein the second reflective element is further configured to:
when the object is arranged relative to the second convex surface at an angle less than a predefined value, reflect the second light onto the camera focal plane.

### Claim 18 (depends on 17)

The system of claim 17, wherein the optical arrangement further comprises:
a second beam splitter element having a predefined disposition relative to the first beam splitter element, the second beam splitter element defining a second surface configured to direct the second light onto the camera focal plane,
wherein the second light is reflected by the second convex surface prior to being directed by the second surface onto the camera focal plane, and
wherein determining at least one of depth information and positional information of the object comprises:
using first image processing operations upon determining the second reflective element reflects the second light onto the camera focal plane; and
using second image processing operations upon determining the second surface of the second beam splitter element directs the second light onto the camera focal plane.
