# US 2019/0318212 A1 · Automated image scale adjustment based upon document and image context > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0318212 A1 - Document ID: US20190318212A1 - Status: Published application - Kind: A1 - Application number: 15/952,013 - Filed: 2018-04-12 - Published: 2019-10-17 - Earliest claimed: 2018-04-12 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: Amnon Itamar Govrin; Erez Kikin Gil; Keri Talbot; Aleta Bashaw - Web page: https://patentgrep.com/patent/US20190318212A1 ## CPC - G06T 11/60: Creating or editing images; Combining images with text - G06F 40/103: Formatting, i.e. changing of presentation of documents (automatic justification G06F40/189; automatic line break hyphenation G06F40/191) - G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting - G06V 30/274: {Syntactic or semantic context, e.g. balancing} - G06V 30/414: Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text - G06V 40/172: {Classification, e.g. identification} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Disclosed are methods, systems, and machine readable mediums which provide for an automatic image scaling that may be utilized in a variety of contexts, including for scaling images inserted into documents. The image may be scaled based upon one or more scaling features that may be utilized alone or in combination. Scaling features may be described by scaling feature categories, although as will be appreciated, the scaling features may be placed in one or more categories. Example feature categories may include image characteristics; image content; content of the document and context of the image within the document; past user behavior and preferences; and the like. ## Claims ### Claim 1 A method for automated digital image scaling, the method comprising: receiving a selection of a digital image and a desired placement position in a digital document, the digital image having a first size; automatically determining a second size of the digital image, the second size different than the first size and calculated based upon a determined relevance of one or more recognized objects depicted in the digital image to a portion of the digital document; automatically scaling the digital image from the first size to the second size; and automatically placing the scaled digital image in the digital document at the desired placement position. ### Claim 2 (depends on 1) The method of claim 1, wherein the determined relevance of one or more recognized objects depicted in the digital image to a portion of the digital document comprises a match between a semantic meaning of textual content within a defined proximity to the desired placement position and at least one of the one or more recognized objects. ### Claim 3 (depends on 2) The method of claim 2, wherein automatically determining the second size of the digital image, the second size different than the first size and calculated based upon the determined relevance of one or more recognized objects depicted in the digital image to the portion of the digital document comprises: calculating the second size based upon a frequency with which one of the one or more recognized objects is mentioned in text of the digital document. ### Claim 4 (depends on 2) The method of claim 2, wherein automatically determining the second size of the digital image, the second size different than the first size and calculated based upon the determined relevance of one or more recognized objects depicted in the digital image to the portion of the digital document comprises: calculating the second size based upon a relevance of one or more recognized objects depicted in the digital image to one or more recognized objects in a second digital image that are already in the digital document and that are within a defined proximity to the desired placement position. ### Claim 5 (depends on 1) The method of claim 1, further comprising: calculating a semantic meaning of the digital image based upon the one or more recognized objects depicted in the digital image; and wherein determining the second size of the digital image, the second size different than the first size and calculated based upon the determined relevance of one or more recognized objects depicted in the digital image to the portion of the digital document comprises: comparing the recognized objects depicted in the digital image to recognized objects depicted in one or more other digital images in the digital document. ### Claim 6 (depends on 1) The method of claim 1, wherein determining the second size of the digital image, is further based upon one or more of: a resolution, an aspect ratio, or a color profile. ### Claim 7 A machine-readable medium for automated digital image scaling, the machine-readable medium comprising instructions, which when performed by a machine, causes the machine to perform operations comprising: receiving a selection of a digital image and a desired placement position in a digital document, the digital image having a first size; automatically determining a second size of the digital image, the second size different than the first size and calculated based upon a determined relevance of one or more recognized objects depicted in the digital image to a portion of the digital document; automatically scaling the digital image from the first size to the second size; and automatically placing the scaled digital image in the digital document at the desired placement position. ### Claim 8 (depends on 7) The machine-readable medium of claim 7, wherein the one or more recognized objects depicted in the digital image comprise textual content in the digital image. ### Claim 9 (depends on 7) The machine-readable medium of claim 7, wherein the one or more recognized objects depicted in the digital image comprise recognized faces in the digital image. ### Claim 10 (depends on 7) The machine-readable medium of claim 7, wherein the one or more recognized objects depicted in the digital image comprise one of: logos, icons, decorations, or clip art. ### Claim 11 (depends on 7) The machine-readable medium of claim 7, wherein the determined relevance of one or more recognized objects depicted in the digital image to a portion of the digital document comprises a match between a semantic meaning of textual content within a defined proximity to the desired placement position and at least one of the one or more recognized objects. ### Claim 12 A computing device for automated digital image scaling, the computing device comprising: a processor; a memory, the memory comprising instructions, which when executed by the processor, cause the computing device to perform operations comprising: receiving a selection of a digital image and a desired placement position in a digital document, the digital image having a first size; automatically determining a second size of the digital image, the second size different than the first size and calculated based upon a determined relevance of one or more recognized objects depicted in the digital image to a portion of the digital document; automatically scaling the digital image from the first size to the second size; and automatically placing the scaled digital image in the digital document at the desired placement position. ### Claim 13 (depends on 12) The computing device of claim 12, wherein the one or more recognized objects depicted in the digital image comprise textual content in the digital image. ### Claim 14 (depends on 12) The computing device of claim 12, wherein the one or more recognized objects depicted in the digital image comprise recognized faces in the digital image. ### Claim 15 (depends on 12) The computing device of claim 12, wherein the one or more recognized objects depicted in the digital image comprise one of: logos, icons, decorations, or clip art. ### Claim 16 (depends on 12) The computing device of claim 12, wherein the determined relevance of one or more recognized objects depicted in the digital image to a portion of the digital document comprises a match between a semantic meaning of textual content within a defined proximity to the desired placement position and at least one of the one or more recognized objects. ### Claim 17 (depends on 16) The computing device of claim 16, wherein the operations of automatically determining the second size of the digital image, the second size different than the first size and calculated based upon the determined relevance of one or more recognized objects depicted in the digital image to the portion of the digital document comprises: calculating the second size based upon a frequency with which one of the one or more recognized objects is mentioned in text of the digital document. ### Claim 18 (depends on 16) The computing device of claim 16, wherein the operations of automatically determining the second size of the digital image, the second size different than the first size and calculated based upon the determined relevance of one or more recognized objects depicted in the digital image to the portion of the digital document comprises: calculating the second size based upon a relevance of one or more recognized objects depicted in the digital image to one or more recognized objects in a second digital image that are already in the digital document and that are within a defined proximity to the desired placement position. ### Claim 19 (depends on 12) The computing device of claim 12, wherein the operations further comprise: calculating a semantic meaning of the digital image based upon the one or more recognized objects depicted in the digital image; and wherein determining the second size of the digital image, the second size different than the first size and calculated based upon the determined relevance of one or more recognized objects depicted in the digital image to the portion of the digital document comprises: comparing the recognized objects depicted in the digital image to recognized objects depicted in one or more other digital images in the digital document. ### Claim 20 (depends on 12) The computing device of claim 12, wherein the operations of determining the second size of the digital image, is further based upon one or more of: a resolution, an aspect ratio, or a color profile.