US 10,311,409 B1 · Detection and interpretation of visual indicators

Abstract

Devices, systems and methods are disclosed that detect and interpret the meaning of visual and/or audio indicators of devices, and provide information, solutions to potential malfunctions, and/or automatic ordering of consumable products to users. For example, sequences of visual indicators (such as LEDs) and/or audio indicators (such as speakers that output beeps) generated by home electronics and other devices may be monitored using an image capture component (such as a camera) or audio capture component (such as a microphone), and the sequences may be interpreted to provide users with information of what is wrong with a device, how to fix a device, purchase a new device, offer repair services, etc. The systems and methods may also provide users with notifications relating to such indicators when the user is away from home.

Claims17

Dependent claims

A computer-implemented method, comprising:

receiving a device identifier corresponding to an image capture device associated with a user profile;
receiving, from the image capture device, image data representing an object including an illuminated indicator;
determining an object identifier corresponding to the object;
determining, based in part on the object identifier, stored data indicating a location of a known indicator with respect to the object and information associated with the known indicator;
determining, using the image data and the stored data, a meaning of the illuminated indicator based at least in part on a luminescence of a pixel within a bounded region of the image data, the bounded region corresponding to the location;
determining an action associated with the meaning;
and
performing the action.

5 more elements

A system, comprising:

at least one processor;
and
at least one memory including instructions operable to be executed by the at least one processor to perform a set of actions, configuring the at least one processor to:
receive a device identifier corresponding to an image capture device associated with a user profile;
receive, from the image capture device, image data representing an object including an illuminated indicator;
process the image data to identify the object;
determine an object identifier corresponding to the object;
determine, based in part on the object identifier, stored data indicating a location of a known indicator with respect to the object and information associated with the known indicator;
determine, using the image data and the stored data, a meaning of the illuminated indicator in the image data based at least in part on a luminescence of a pixel within a bounded region corresponding to the location;
determine an action associated with the meaning;
and
perform the action.

9 more elements

Dependencies are inferred from the claim text.

Detection and interpretation of visual indicators

Life of this patent

Detection and interpretation of visual indicators

Life of this patent

Abstract

Claims17