# US 10,319,152 B2 · Methods and devices for selecting objects in images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,319,152 B2
- Document ID: US10319152B2
- Status: Granted
- Kind: B2
- Application number: 15/409,713
- Filed: 2017-01-19
- Published: 2017-05-11
- Granted: 2019-06-11
- Earliest claimed: 2012-02-28
- Assignees: BlackBerry Limited
- Applicants: BlackBerry Limited
- Inventors: Steven Henry Fyke
- Web page: https://patentgrep.com/patent/US10319152B2

## CPC

- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- G06F 18/24: Classification techniques
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- H04N 13/286: having separate monoscopic and stereoscopic modes
- G06T 2200/24: involving graphical user interfaces [GUIs]
- H04N 2013/0092: {Image segmentation from stereoscopic image signals}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Methods and devices for selecting objects in images are described. In one example aspect, a method includes: receiving stereoscopic image data, the stereoscopic image data includes a first image obtained from a first camera and a second image obtained from a second camera; identifying an object in the first image by analyzing the first image and the second image; displaying the first image, the identified object in the first image being selectable.

## Claims

### Claim 1

A method, implemented by a processor of an electronic device, for allowing selection of an object in an image, the method comprising:
receiving image data, the image data including a first image obtained from a first camera and a second image obtained from a second camera, the first camera and the second camera being oriented in a common direction;
identifying an object in the first image by analyzing the first image and the second image, wherein the analyzing includes identifying one or more boundary associated with the object in the first image based on discontinuities in visual characteristics; and
displaying an image based on one or both of the first image and the second image, the identified object in the first image being selectable.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
receiving a signal indicating a selection of the identified object; and
manipulating the first image based on the selection of the identified object.

### Claim 3 (depends on 2)

The method of claim 2, wherein manipulating includes cropping the identified object in the first image.

### Claim 4 (depends on 2)

The method of claim 2, wherein manipulating includes moving the identified object.

### Claim 5 (depends on 2)

The method of claim 2, wherein manipulating includes associating a caption with the identified object in the first image.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
receiving a signal indicating an instruction for copying the identified object; and
in response to the instruction, copying the identified object to an application.

### Claim 7 (depends on 1)

The method of claim 1, wherein identifying one or more boundary includes performing image segmentation.

### Claim 8 (depends on 7)

The method of claim 7, wherein performing image segmentation includes:
partitioning the image data into image segments;
assigning a visual characteristic label to each of the image segments;
grouping the image segments based on the visual characteristic labels to identify groups of image segments sharing visual characteristics; and
identifying the one or more boundary based on the identified sets of visual characteristics.

### Claim 9 (depends on 8)

The method of claim 8, wherein each of the image segments is a pixel.

### Claim 10 (depends on 1)

The method of claim 1, wherein visual characteristics include at least one of illumination, colour, intensity, and texture.

### Claim 11 (depends on 1)

The method of claim 1, the method further comprising:
determining depth information of image segments based on the first image and the second image; and
identifying the one or more boundary associated with the object in the first image based on discontinuities in the visual characteristics and based on the depth information corresponding to the discontinuities.

### Claim 12 (depends on 1)

The method of claim 1, wherein the image data is stereoscopic image data, the stereoscopic image data including the first image from the first camera and the second image from the second camera, wherein the first image and the second image are simultaneously obtained.

### Claim 13 (depends on 12)

The method of claim 12, wherein the stereoscopic image data is received in response to receiving an instruction to capture a non-stereoscopic image.

### Claim 14 (depends on 1)

The method of claim 1, further comprising:
discarding the second image from the electronic device after analyzing the first image and the second image.

### Claim 15

An electronic device comprising:
a memory;
a display;
a first camera and a second camera, the first camera and the second camera being oriented in a common direction; and
a processor coupled to the memory, the display, the first camera, and the second camera, the processor being configured to:
receive image data, the image data including a first image obtained from a first camera and a second image obtained from the second camera;
identify an object in the first image by analyzing the first image and the second image, wherein the analyzing includes identifying one or more boundary associated with the object in the first image based on discontinuities in visual characteristics; and
display an image based on one or both of the first image and the second image, the identified object in the first image being selectable.

### Claim 16 (depends on 15)

The electronic device of claim 15 wherein the processor is further configured to:
receive a signal indicating selection of the identified object; and
manipulate the first image based on the selection of the identified object.

### Claim 17 (depends on 16)

The electronic device of claim 16, wherein manipulate includes crop the identified object in the first image.

### Claim 18 (depends on 16)

The electronic device of claim 16, wherein manipulate includes move the identified object.

### Claim 19 (depends on 16)

The electronic device of claim 16, wherein manipulate includes associate a caption with the identified object in the first image.

### Claim 20

A non-transitory, tangible computer readable storage medium encoded with computer executable instructions, wherein execution of the computer executable instructions is for:
receiving image data, the image data including a first image obtained from a first camera and a second image obtained from a second camera, the first camera and the second camera being oriented in a common direction;
identifying an object in the first image by analyzing the first image and the second image, wherein the analyzing includes identifying one or more boundary associated with the object in the first image based on discontinuities in one or more visual characteristics; and
displaying an image based on one or both of the first image and the second image, the identified object in the first image being selectable.
