US 10,853,404 B2Granted

Digital picture frame photograph clustering

AssigneeAura Home, Inc.

InventorsOphir Frieder, Abdur Chowdhury, Eric Jensen, Ben Cherry, Richard Sanford, Alek Kolcz

Life of this patent

Estimating the term…

Loading patent…

Abstract

A method for automated routing of pictures taken on mobile electronic devices to a digital picture frame including a camera integrated with the frame, and a network connection module allowing the frame for direct contact and upload of photos from electronic devices or from photo collections of community members. The integrated camera is used to automatically determine an identity of a frame viewer and can capture gesture-based feedback. The displayed photos are automatically shown and/or changed according to the detected viewers. The photos can be filtered and cropped at the receiver side. Clustering photos by content is used to improve display and to respond to photo viewer desires.

Claims16

Dependent claims

A method of displaying photos on a digital picture frame including a digital display mounted within a frame, a camera connected to the frame, and a network connection module, the method comprising:

automatically determining with the camera an identity of a viewer of the digital picture frame;
automatically clustering photos of a digital photo collection over a timeframe for display to the viewer, wherein the clustering comprises:
preparing a plurality of sub-clusters, each for a common detected content in the photos selected from things, places, activities, or combinations thereof, wherein each of the plurality of sub-clusters is formed of the common detected content of interest at a similar time and/or age;
linking related sub-clusters of the common detected content together to form a cluster of the common detected content for display as a function of one or more predetermined features having limited change over a timeframe;
extracting photo features of the common detected content within each of the sub-cluster of photos to form a cluster representation, wherein the photo features are predetermined as having the limited change over a timeframe;
comparing the cluster representation to further cluster representations to determine related clusters;
linking or grouping the related clusters for display as a function of a matching cluster representation;
and
automatically displaying a slideshow on the digital display of the photos from the digital photo collection as a function of the clustering.

6 more elements

A method of displaying photos on a digital picture frame including a digital display mounted within a frame, a camera connected to the frame, and a network connection module, the method comprising:

automatically determining with the camera an identity of a viewer of the digital picture frame;
automatically clustering from a digital photo collection, via automated content recognition, photos over a multi-year timeframe of a content of interest to the viewer to obtain clustered photos of the content of interest, wherein the clustering comprises:
preparing a plurality of sub-clusters each including digital photos of the content of interest at a similar time and/or age;
extracting photo features within each of the plurality of sub-clusters that comprise a predetermined limited change over the timeframe to form a cluster representation of the content of interest;
comparing each cluster representation to further cluster representations of others of the plurality of sub-clusters to determine related clusters of the content of interest over the timeframe as a function of the cluster representation;
and
linking or grouping related sub-clusters to form the clustered photos of the content of interest for display;
automatically displaying on the digital display the clustered photos of the content of interest from the digital photo collection as a function of the clustering;
and
automatically displaying on the digital display the clustered photos from the digital photo collection as a function of the clustering.

7 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/563,511Filed 6 Sep 2019 · continuation
Priority: 10 Oct 2013
Published: US 2019/0050403 A126 Dec 2019
Granted: 1 Dec 2020
Term ends: Not estimatedThe source records don’t support an estimate.

Classification24 codes

G06F 16/435
Querying: filtering based on additional data, e.g. user or group profiles
G06F 16/48
Of multimedia data, e.g. slideshows comprising image and additional audio data: retrieval characterised by using metadata, e.g. metadata not…
G06F 16/55
Of still image data: clustering; Classification
G06F 18/23
Analysing: clustering techniques

Family

Application14/051,071Parent of this continuation-in-part · filed 10 Oct 2013
Application14/051,089Parent of this continuation-in-part · filed 10 Oct 2013
Application14/455,297Parent of this continuation-in-part · filed 8 Aug 2014
Application14/949,353Parent of this continuation-in-part · filed 23 Nov 2015
Application15/150,623Parent of this continuation-in-part · filed 10 May 2016
Application15/824,337Parent of this continuation-in-part · filed 28 Nov 2017
Application16/113,366Parent of this continuation · filed 27 Aug 2018
US 2019/0391995 A1Pre-grant publication · published 26 Dec 2019
Application16/113,366Parent of this continuation-in-part
US 10,474,407 B2Parent of this continuation-in-part
US 9,472,166 B2Parent of this continuation-in-part
US 9,420,015 B2Parent of this continuation-in-part
US 9,225,789 B2Parent of this continuation-in-part
US 9,338,759 B2Parent of this continuation-in-part
US 10,820,293 B2Related patent
US 10,824,666 B2Related patent
US 2015/0105096 A1Published application
US 2015/0106443 A1Published application
US 2015/0106449 A1Published application
US 2016/0140934 A1Published application
US 2016/0255162 A1Published application
US 2018/0146447 A1Published application
US 2019/0050403 A1Published application
US 10,853,404 B2This patent

From the US filing history. Foreign family members aren’t listed.