US 11,636,708 B2Granted

Face detection in spherical images

AssigneeGoPro, Inc.

InventorsThomas Armel Derbanne, Bruno César Douady, Maxim Karpushin

Life of this patent

Estimating the term…

Loading patent…

Abstract

A face located along a stitch line in a spherical image is detected by rendering views of regions of the spherical image along the stitch line. The spherical image may be produced by combining first and second images. A first view of a projection of the spherical image is rendered. A scaling factor for rendering a second view of the projection is determined based characteristics of the first portion of the face. The second view is then rendered according to the scaling factor. The use of the scaling factor to render the second view causes a change in the depiction of the second portion of the face. For example, the scaling factor can indicate to change the resolution or expected size of the second portion of the face when rendering the second view. A face is then detected within the spherical image based on the rendered first and second views.

Claims20

Dependent claims

An image processor configured to perform operations, the operations comprising:

capturing a first image using a first lens and a second image using a second lens, wherein the first image depicts a first portion of a face and the second image depicts a second portion of the face;
producing a spherical image by combining the first image and the second image;
determining a projection of the spherical image, wherein the projection includes a number of views, each of the views including a two-dimensional representation of a portion of the spherical image;
rendering a first view of the projection of the spherical image based on a determination that the first portion of the face is located within the first view, wherein the first view corresponds to the first image;
determining, based on one or more characteristics of the first portion of the face, a scaling factor for rendering a second view of the projection of the spherical image;
rendering the second view according to the scaling factor, wherein use of the scaling factor to render the second view causes a change in depiction of the second portion of the face, wherein the second view corresponds to the second image;
and
detecting the face within the spherical image based on the rendered first view and the rendered second view.

5 more elements

An image capture apparatus, comprising:

a first image sensor and a second image sensor arranged in opposing directions;
a processor;
and
a memory including instructions executable by the processor to:
produce a spherical image by stitching a first image captured using the first image sensor and a second image captured using the second image;
scan the spherical image to detect a face located along a stitch line of the spherical image, wherein a first portion of the face is located in a first region corresponding to the first image and a second portion of the face is located in a second region corresponding to the second image;
determine a projection of the spherical image by transforming the first image and the second image using a projection scheme;
generate a first rendered view and a second rendered view of the projection of the spherical image, wherein the first rendered view corresponds to the first region and the second rendered view corresponds to the second region;
and
output an indication of the detected face within the first rendered view and the second rendered view.

7 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/420,741Filed 2 Jan 2020 · us provisional application
Priority: 4 Jan 2019
Published: US 2022/0108559 A17 Apr 2022
Granted: 25 Apr 2023
Term ends: Not estimatedThe source records don’t support an estimate.

Classification15 codes

G06T 3/06
Geometric image transformations in the plane of the image: topological mapping of higher dimensional structures onto lower dimensional surfaces
G06T 3/16
Geometric image transformations in the plane of the image: spatio-temporal transformations, e.g. video cubism
G06T 3/40
Geometric image transformations in the plane of the image: scaling of whole images or parts thereof, e.g. expanding or contracting
G06V 10/147
Optical characteristics of the device performing the acquisition or on the illumination arrangements: details of sensors, e.g. sensor lenses