Back to results
US 12,309,532 B1Granted
Ultra-high resolution concurrent camera stream systems
AssigneeAmazon Technologies, Inc.
InventorsAjay Kumar Ponnuswamy, Adriana Reus, Sachin R Kothari
Life of this patent
Estimating the term…
Abstract
Described herein are systems and techniques for concurrently transmitting ultra-high-definition video data from multiple ultra-high-definition cameras to a single computing device without exceeding the bandwidth of the communication protocols on board the device. The systems use a serializer and deserializer configuration to serialize the multiple ultra-high-definition video streams and concurrently stream them to a deserializer located at the computing device, where a dual or quad deserializer is used to return the video data to a parallel format, the video data useful for making one or more determinations about an environment around the system.
Claims20
An appliance comprising:
- a refrigeration compartment for storing items at a refrigerated temperature;
- a first door that provides access into an interior of the refrigeration compartment;
- a sensor array configured to detect sensor data comprising a state of the first door;
- a first camera configured to capture first image data of a first portion of the interior of the refrigeration compartment;
- a first serializer communicably coupled with the first camera and configured to receive and serialize the first image data into a serial format;
- a second camera configured to capture second image data of a second portion of the interior of the refrigeration compartment;
- a second serializer communicably coupled with the second camera and configured to receive and serialize the second image data into the serial format;
- a deserializer communicably coupled with the first serializer and the second serializer and configured to deserialize the first image data and the second image data from the serial format into a parallel data format;
- one or more processors;
- and
- one or more computer-readable media storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
- receiving the sensor data from the sensor array;
- determining an open state of the first door based on the sensor data;
- receiving the first image data from the deserializer;
- receiving the second image data from the deserializer;
- subsequent to the receiving of both of the first image data and the second image data from the deserializer,
- determining, based at least in part on content of the first image data and the second image data, a relevance of the first image data and the second image data, and
- determining, based at least in part on the relevance of the content of the first image data and the second image data, to drop one of the first image data or the second image data;
- and
- determining a user interaction with an item within the interior of the refrigeration compartment based on the first image data or second image data.
17 more elements
A system, comprising:
- a first camera configured to capture first image data of an environment;
- a first serializer communicably coupled with the first camera and configured to receive and serialize the first image data into a serial format;
- a second camera configured to capture second image data of the environment;
- a second serializer communicably coupled with the second camera and configured to receive and serialize the second image data into the serial format;
- and
- a deserializer communicably coupled with the first serializer, the second serializer, and a computing device, the deserializer configured to deserialize the first image data and the second image data from the serial format into a parallel format and communicate the first image data and the second image data to the computing device,
- wherein, subsequent to the computing device receiving both of the first image data and the second image data from the deserializer, the computing device:
- determines, based at least in part on content of the first image data and the second image data, a relevance of the first image data and the second image data;
- and
- determines, based at least in part on the relevance of the content of the first image data and the second image data, to drop one of the first image data or the second image data.
7 more elements
A method, comprising:
- receiving first ultra-high-definition image data with a first imaging device at a first time;
- serializing the first ultra-high-definition image data to generate first serialized data;
- receiving second ultra-high-definition image data with a second imaging device at the first time;
- serializing the second ultra-high-definition image data to generate second serialized data;
- conveying the first serialized data to a computing device;
- conveying the second serialized data to the computing device;
- deserializing the first serialized data and the second serialized data at the computing device,
- wherein, after the computing device deserializes the first serialized data and the second serialized data, the computing device:
- determines, based at least in part on content of the first ultra-high-definition image data and the second ultra-high-definition image data, a relevance of the first ultra-high-definition image data and the second ultra-high-definition image data;
- and
- determines, based at least in part on the relevance of the content of the first ultra-high-definition image data and the second ultra-high-definition image data, to drop one of the first serialized data or the second serialized data based at least in part on the relevance.
8 more elements
Dependencies are inferred from the claim text.