# US 11,122,200 B2 · Supplying content aware photo filters > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,122,200 B2 - Document ID: US11122200B2 - Status: Granted - Kind: B2 - Application number: 16/773,601 - Filed: 2020-01-27 - Published: 2020-05-21 - Granted: 2021-09-14 - Earliest claimed: 2014-07-07 - Assignees: Snap Inc. - Applicants: Snap Inc. - Inventors: Timothy Sehn - Web page: https://patentgrep.com/patent/US11122200B2 ## CPC - H04N 1/32144: {embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp} - G06T 5/10: using non-spatial domain filtering - G06T 11/60: Creating or editing images; Combining images with text - G06V 20/20: in augmented reality scenes - H04N 1/00244: {with a server, e.g. an internet server (fax-servers or the like for store and forward H04N1/324)} - H04N 23/61: based on recognised objects - H04N 23/62: Control of parameters via user interfaces - H04N 23/63: by using electronic viewfinders - H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters} - H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image} - H04W 4/021: Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences - G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units} - G09G 2340/12: Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels - H04N 2201/0084: Digital still camera - H04N 2201/3245: of image modifying data, e.g. handwritten addenda, highlights or augmented reality information - H04N 2201/3253: Position information, e.g. geographical position at time of capture, GPS data - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract A server includes a photo filter module with instructions executed by a processor to identify when a client device captures a photograph. Photograph filters are selected based upon attributes of the client device and attributes of the photograph. The photograph filters are supplied to the client device. ## Claims ### Claim 1 A system comprising: a processor configured to execute instructions for performing operations comprising: receiving, by a client device, a plurality of photograph filters, each of the plurality of photograph filters being configured to overlay an image to augment the image, wherein a first filter of the plurality of photograph filters that is configured to modify an entirety of the image slides across the image in response to a first user input comprising a first swipe motion, and wherein a second filter of the plurality of photograph filters that is configured to modify only a first particular feature of an object depicted in the image slides across the image modified by the first filter in response to a second user input comprising a second swipe motion received after the first user input, a given one of the plurality of photograph filters comprising weather information at a time at which the image was captured by the client device, wherein the plurality of photograph filters is selected to be received by the client device using bids from vendors, where the bids from the vendors are based on characteristics of a user of the client device, a location of the user, and content of the image. ### Claim 2 (depends on 1) The system of claim 1, wherein the plurality of photograph filters is selected by a server based upon a geolocation of the client device on which the image is presented and the object depicted in the image. ### Claim 3 (depends on 1) The system of claim 1, wherein the weather information comprises a temperature at the time at which the image was captured, and wherein the plurality of photograph filters is configured to be independently alternatively selectable by a user to overlay the image. ### Claim 4 (depends on 1) The system of claim 1, wherein a selected one of the plurality of photograph filters and a photograph corresponding to the image are routed by a server to another client device. ### Claim 5 (depends on 1) The system of claim 1, wherein the first filter includes an object specific filter, and wherein the second filter includes textual content that is excluded from the first filter. ### Claim 6 (depends on 1) The system of claim 1, wherein a server identifies when the client device presents the image on a display, and wherein the second filter causes a variety of filters with different visual attributes of the first particular feature of the object to be supplied to the client device. ### Claim 7 (depends on 1) The system of claim 1, wherein the given one of the plurality of photograph filters includes brand indicia, and wherein the given one of the plurality of photograph filters includes an image associated with the brand indicia. ### Claim 8 (depends on 1) The system of claim 1, wherein the first filter that overlays the image is replaced by the second filter in response to user input to cause the second filter to overlay the image, wherein a third filter of the plurality of photograph filters that is configured to modify a second particular feature of the object depicted in the image is selected in response to a third user input received after the second user input, wherein the third filter includes textual content that is excluded from the first and second filters. ### Claim 9 (depends on 1) The system of claim 1, wherein the plurality of photograph filters is configured to be independently selectable in response to a gesture applied to the image as presented on the client device, wherein the plurality of photograph filters is selected by a server based on popularity. ### Claim 10 (depends on 1) The system of claim 1, wherein the given one of the plurality of photograph filters includes a brand associated with an establishment proximate to a geolocation of the client device. ### Claim 11 (depends on 1) The system of claim 1, wherein an attribute of the client device is identified based on established preferences of the client device, and wherein the plurality of photograph filters is selected by a server based upon one or more attributes of the client device and one or more attributes of the image. ### Claim 12 (depends on 11) The system of claim 11, wherein the established preferences are derived from prior use patterns. ### Claim 13 (depends on 11) The system of claim 11, wherein the one or more attributes of the image include a physical environment captured in the image. ### Claim 14 (depends on 1) The system of claim 1, wherein the operations further comprise appending a message to the image. ### Claim 15 A method comprising: receiving, by a client device, a plurality of photograph filters, each of the plurality of photograph filters being configured to overlay an image to augment the image, wherein a first filter of the plurality of photograph filters that is configured to modify an entirety of the image slides across the image in response to a first user input comprising a first swipe motion, and wherein a second filter of the plurality of photograph filters that is configured to modify only a first particular feature of an object depicted in the image slides across the image modified by the first filter in response to a second user input comprising a second swipe motion received after the first user input, a given one of the plurality of photograph filters comprising weather information at a time at which the image was captured by the client device, wherein the plurality of photograph filters is selected to be received by the client device using bids from vendors, where the bids from the vendors are based on characteristics of a user of the client device, a location of the user, and content of the image. ### Claim 16 (depends on 15) The method of claim 15, wherein the plurality of photograph filters are selected by a server based upon a geolocation of the client device on which the image is presented and the object depicted in the image. ### Claim 17 (depends on 15) The method of claim 15, wherein the weather information comprises a temperature at the time at which the image was captured, and wherein the plurality of photograph filters is configured to be independently alternatively selectable by a user to overlay the image. ### Claim 18 (depends on 15) The method of claim 15, wherein the given one of the plurality of photograph filters includes a brand associated with an establishment proximate to a geolocation of the client device and an indicia associated with the brand, wherein the first filter includes a first brand of a restaurant that sponsors the first filter and an image of a food item associated with the restaurant, and wherein the second filter includes a second brand of a store that sponsors the second filter and an image of a tangible item associated with the store. ### Claim 19 (depends on 18) The method of claim 18, wherein the image of the food item in the first filter comprises an image of a hamburger or taco, and wherein the image of the tangible item in the second filter comprises an image of a surf board or sunglasses. ### Claim 20 A non-transitory machine-readable storage medium that includes instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising: receiving, by a client device, a plurality of photograph filters each of the plurality of photograph filters being configured to overlay an image to augment the image, wherein a first filter of the plurality of photograph filters that is configured to modify an entirety of the image slides across the image in response to a first user input comprising a first swipe motion, and wherein a second filter of the plurality of photograph filters that is configured to modify only a first particular feature of an object depicted in the image slides across the image modified by the first filter in response to a second user input comprising a second swipe motion received after the first user input, a given one of the plurality of photograph filters comprising weather information at a time at which the image was captured by the client device, wherein the plurality of photograph filters is selected to be received by the client device using bids from vendors, where the bids from the vendors are based on characteristics of a user of the client device, a location of the user, and content of the image.