Real time object detection and tracking

A method performed by one or more data processing apparatus of a mobile device, the method comprising:

• detecting presence of one or more objects depicted in a viewfinder of a camera of the mobile device;
• in response to detecting the presence of the one or more objects:
• presenting, within the viewfinder and for each of the one or more objects, a visual indicator that indicates that content related to the object is being identified;
• sending image data representing the one or more objects to a content distribution system that selects content related to objects depicted in images;
• and
• tracking a location of each of the one or more objects in the viewfinder of the camera while waiting to receive content from the content distribution system;
• receiving, from the content distribution system, content related to the one or more objects;
• and
• for each of the one or more objects:
• determining, based on the tracking, a current location of the object in the viewfinder;
• and
• presenting, within the viewfinder and at the current location of the object, the received content related to the object.

A system comprising:

• one or more data processing apparatus;
• and
• a memory storage apparatus in data communication with the data processing apparatus, the memory storage apparatus storing instructions executable by the data processing apparatus and that upon such execution cause the data processing apparatus to perform operations comprising:
• detecting presence of one or more objects depicted in a viewfinder of a camera of a mobile device;
• in response to detecting the presence of the one or more objects:
• presenting, within the viewfinder and for each of the one or more objects, a visual indicator that indicates that content related to the object is being identified;
• sending image data representing the one or more objects to a content distribution system that selects content related to objects depicted in images;
• and
• tracking a location of each of the one or more objects in the viewfinder of the camera while waiting to receive content from the content distribution system;
• receiving, from the content distribution system, content related to the one or more objects;
• and
• for each of the one or more objects:
• determining, based on the tracking, a current location of the object in the viewfinder;
• and
• presenting, within the viewfinder and at the current location of the object, the received content related to the object.

A non-transitory computer storage medium encoded with a computer program, the program comprising instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations comprising:

• detecting presence of one or more objects depicted in a viewfinder of a camera of a mobile device;
• in response to detecting the presence of the one or more objects:
• presenting, within the viewfinder and for each of the one or more objects, a visual indicator that indicates that content related to the object is being identified;
• sending image data representing the one or more objects to a content distribution system that selects content related to objects depicted in images;
• and
• tracking a location of each of the one or more objects in the viewfinder of the camera while waiting to receive content from the content distribution system;
• receiving, from the content distribution system, content related to the one or more objects;
• and
• for each of the one or more objects:
• determining, based on the tracking, a current location of the object in the viewfinder;
• and
• presenting, within the viewfinder and at the current location of the object, the received content related to the object.