# US 11,443,510 B2 · Method, system and computer program product that provides virtual assistance in facilitating visual comparison > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,443,510 B2 - Document ID: US11443510B2 - Status: Granted - Kind: B2 - Application number: 16/945,969 - Filed: 2020-08-03 - Published: 2022-02-03 - Granted: 2022-09-13 - Earliest claimed: 2020-08-03 - Assignees: Motorola Solutions, Inc. - Applicants: Motorola Solutions, Inc. - Inventors: Swee Yee Soo; Choon Kang Wong; Wai Seong Loh; Kuang Lin Chuang - Web page: https://patentgrep.com/patent/US11443510B2 ## CPC - G06V 20/20: in augmented reality scenes - G06V 40/172: {Classification, e.g. identification} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06V 10/74: Image or video pattern matching; Proximity measures in feature spaces - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships} - G06V 40/173: {face re-identification, e.g. recognising unknown faces across different face tracks} - H04N 7/185: {from a mobile camera, e.g. for remote control} - G06V 20/625: {License plates} - G06V 40/179: {metadata assisted face recognition} - G06V 2201/10: Recognition assisted with metadata - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method, system and computer program product that provides virtual assistance in facilitating visual comparison is disclosed. A method in accordance with example embodiments includes determining (by comparison of first metadata of an at least one user-provided image to second metadata of an at least one reference image) difference information as between an unknown object and a known object shown in the at least one user-provided image to the at least one reference image respectively. ## Claims ### Claim 1 A system comprising: a non-stationary camera configured to: capture at least one first image that depicts an unknown object; and output the at least one first image for generating first metadata elsewhere within the system; storage configured to store second metadata generated from at least one second image of a known object; and at least one processor in communication with the storage and the non-stationary camera, the at least one processor configured to: compare the first metadata to the second metadata to determine difference information as between the unknown and known objects, the difference information including at least one of a first information component and a second information component, wherein the first information component relates to appearance, and the second information component relates to size; and a mobile communications device that includes a speaker, the mobile communications device in communication with the at least one processor and configured to cause the speaker to emit an audio message that: includes at least some of the difference information; indicates that the unknown object is different than the known object; and explains why, consistent with the at least some of the difference information, there is no match between the unknown object and the known object. ### Claim 2 (depends on 1) The system as claimed in claim 1 wherein the known object is a person and a third information component relating to facial features is included in the difference information. ### Claim 3 (depends on 1) The system as claimed in claim 1 wherein the known object is a vehicle and a third information component relating to License Plate Recognition (LPR) is included in the difference information. ### Claim 4 (depends on 1) The system as claimed in claim 1 wherein the at least one first image is a plurality of video frames captured by the non-stationary camera. ### Claim 5 (depends on 1) The system as claimed in claim 1 wherein the second information component relating to size includes one or more of a height delta and a weight delta. ### Claim 6 (depends on 1) The system as claimed in claim 1 wherein the known object is an identifiable article for sale in a store. ### Claim 7 (depends on 1) The system as claimed in claim 1 wherein the mobile communications device further includes a display screen, and the at least one processor is further configured to cause the at least one second image to be delivered to mobile communications device for display on the display screen. ### Claim 8 (depends on 7) The system as claimed in claim 7 wherein the mobile communications device is a two-way radio or smart phone wirelessly connectable to at least one wireless network. ### Claim 9 (depends on 7) The system as claimed in claim 7 wherein the at least one second image includes a mug shot of a suspect. ### Claim 10 (depends on 1) The system as claimed in claim 1 wherein the audio message includes words that descriptively detail only the at least one of the first information component and the second information component. ### Claim 11 A computer-implemented method for providing live virtual assistance to a user of the live virtual assistance, the method comprising: receiving, at an at least one processor, first metadata generated from at least one user-provided image that depicts an unknown object; providing, to the at least one processor, second metadata generated from at least one reference image of a known object; comparing, using the at least one processor, the first metadata to the second metadata to determine difference information as between the unknown and known objects, the difference information including at least one of a first information component and a second information component, wherein the first information component relates to appearance, and the second information component relates to size; and causing an audio message to be generated for delivery to the user, and wherein the audio message: includes at least some of the difference information; indicates that the unknown object is different than the known object; and explains why, consistent with the at least some of the difference information, there is no match between the unknown object and the known object. ### Claim 12 (depends on 11) The computer-implemented method as claimed in claim 11 wherein the known object is a person and a third information component relating to facial features is included in the difference information. ### Claim 13 (depends on 11) The computer-implemented method as claimed in claim 11 wherein the known object is a vehicle and a third information component relating to License Plate Recognition (LPR) is included in the difference information. ### Claim 14 (depends on 11) The computer-implemented method as claimed in claim 11 wherein the at least one user-provided image is a plurality of video frames captured by a moving camera. ### Claim 15 (depends on 11) The computer-implemented method as claimed in claim 11 wherein the second information component relates to one or more of a height delta and a weight delta. ### Claim 16 (depends on 11) The computer-implemented method as claimed in claim 11 wherein the known object is an inanimate article and a third information component relating to categorization of the inanimate article in relation to one or more store inventories is included in the difference information. ### Claim 17 (depends on 11) The computer-implemented method as claimed in claim 11 further comprising causing the at least one reference image to be delivered to a mobile device of the user. ### Claim 18 (depends on 17) The computer-implemented method as claimed in claim 17 wherein the mobile device is a two-way radio or smart phone wirelessly connected over at least one network to a server that stores the at least one reference image. ### Claim 19 (depends on 11) The computer-implemented method as claimed in claim 11 wherein the audio message includes words that descriptively detail only the at least one of the first information component and the second information component. ### Claim 20 A computer-implemented method for providing live virtual assistance to a user of the live virtual assistance, the method comprising: receiving, at an at least one processor: first metadata generated from a first region of at least one user-provided image that depicts a first unknown object; and second metadata generated from a second region of the at least one user-provided image that depicts a second unknown object; providing, to the at least one processor, third metadata generated from at least one reference image of a known object; processing the first metadata, the second metadata and the third metadata to determine, using the at least one processor, that the first unknown object is more similar than the second unknown object to the known object; comparing, using the at least one processor, the first metadata to the third metadata to determine difference information as between the first unknown object and the known object; and generating a customized be on the lookout message that includes at least some of the difference information, and explains why, consistent with the at least some of the difference information, there is no match between the first unknown object and the known object.