# US 10,311,308 B2 · Image processing to identify selected individuals in a field of view > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,311,308 B2 - Document ID: US10311308B2 - Status: Granted - Kind: B2 - Application number: 15/475,762 - Filed: 2017-03-31 - Published: 2018-10-04 - Granted: 2019-06-04 - Earliest claimed: 2017-03-31 - Assignees: International Business Machines Corporation - Applicants: International Business Machines Corporation - Inventors: Kuntal Dey; Seema Nagar; Sudhanshu S. Singh; Enara C. Vijil - Web page: https://patentgrep.com/patent/US10311308B2 ## CPC - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06V 20/30: in albums, collections or shared content, e.g. social network photos or video - H04N 23/611: where the recognised objects include parts of the human body - H04N 23/67: Focus control based on electronic image sensor signals - G06V 40/168: {Feature extraction; Face representation} - G06V 40/172: {Classification, e.g. identification} - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A computer-implemented method for detecting and ranking individuals includes capturing live image data of a scene using an imaging device and identifying overlap between reference image data of the selected individuals and the live image data, wherein the overlap includes image data of the selected individuals in the scene. The method also includes capturing sets of image data of the selected individuals while the imaging device is in motion and recording the movement to provide a tracking record having instructions for positioning the imaging device where the imaging device captured the sets of image data of the selected individuals in the scene. The method further includes determining a score for each of the selected individuals in the scene based on a value related to an ability to view each friend and/or a social relationship value in order to enable a user to select who to aim the imaging device at. ## Claims ### Claim 1 A system for detecting selected individuals, the system comprising: an imaging device; and a processor and a memory configured to: access reference image data of the selected individuals; capture, using the imaging device, live image data of a scene; identify overlap between the reference image data of the selected individuals and the live image data of the scene, wherein the overlap comprises image data of the selected individuals in the scene; based at least in part on the live image data of the selected individuals in the scene, capture, using the imaging device, sets of image data of the selected individuals in the scene, wherein capturing the sets of image data is performed while the imaging device is in motion; capture, using a movement sensor of the imaging device, movement data of the imaging device, wherein capture of the movement data is performed while the movement sensor is capturing the sets of image data of the selected individuals in the scene; based at least in part on the movement data and the sets of image data of the selected individuals in the scene, generate a tracking record comprising instructions for positioning the imaging device where the imaging device captured the sets of image data of the selected individuals in the scene; provide an indication on a display of the imaging device that each of the selected individuals has been detected in accordance with a ranking of the selected individuals, the ranking being based on an ability to view each friend and/or a value related to a social relationship; and provide movement instructions based on the tracking record to a user to move the imaging device in order to focus on one or more of the selected individuals in response to a selection by the user. ### Claim 2 (depends on 1) The system as claimed in claim 1, wherein the movement sensor comprises an accelerometer, a gyroscope, and/or a magnetometer. ### Claim 3 (depends on 1) The system as claimed in claim 1, wherein the imaging device comprises a zoom-lens and the processor is further configured to automatically zoom the zoom-lens while taking the series of images in order to provide increased image resolution capable of identifying facial features. ### Claim 4 (depends on 3) The system as claimed in claim 3, wherein the processor is further configured to automatically zoom the zoom-lens in response to the user moving the imaging device in accordance with the tracking record in order to provide sufficient resolution for viewing the selected individuals. ### Claim 5 (depends on 1) The system as claimed in claim 1, wherein the system is part of a cloud computing environment. ### Claim 6 A computer program product for detecting selected individuals, the computer program product comprising a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to: access reference image data of the selected individuals; capture, using an imaging device, live image data of a scene; identify overlap between the reference image data of the selected individuals and the live image data of the scene, wherein the overlap comprises image data of the selected individuals in the scene; based at least in part on the live image data of the selected individuals in the scene, capture, using the imaging device, sets of image data of the selected individuals in the scene, wherein capturing the sets of image data is performed while the imaging device is in motion; capture, using a movement sensor of the imaging device, movement data of the imaging device, wherein capture of the movement data is performed while the movement sensor is capturing the sets of image data of the selected individuals in the scene; based at least in part on the movement data and the sets of image data of the selected individuals in the scene, generate a tracking record comprising instructions for positioning the imaging device where the imaging device captured the sets of image data of the selected individuals in the scene; provide an indication on a display of the imaging device that each of the selected individuals has been detected in accordance with a ranking of scores for the selected individuals, the ranking being based on an ability to view each friend and/or a value related to a social relationship; and provide movement instructions based on the tracking record to a user to move the imaging device in order to focus on one or more of the selected individuals in response to a selection by the user. ### Claim 7 (depends on 6) The computer program product as claimed in claim 6, wherein the program instructions cause the processor to: generate a zone map comprising a zone for each of the detected individuals, each zone comprising a color indication corresponding to the ranking of scores for the detected individuals; and display the zone map on the display of the imaging device. ### Claim 8 (depends on 6) The computer program product as claimed in claim 6, wherein the imaging device comprises a zoom-lens and the program instructions cause the processor to automatically zoom the zoom-lens while taking the series of images in order to provide increased image resolution capable of identifying facial features. ### Claim 9 (depends on 8) The computer program product as claimed in claim 8, wherein the program instructions cause the processor to automatically zoom the zoom-lens in response to the user moving the imaging device in accordance with the tracking record in order to provide sufficient resolution for viewing the selected individuals. ### Claim 10 (depends on 6) The computer program product as claimed in claim 6, wherein the computer program product is part of a cloud computing environment.