# US 2023/0054531 A1 · Image data processing device and image data processing system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2023/0054531 A1 - Document ID: US20230054531A1 - Status: Published application - Kind: A1 - Application number: 18/048,433 - Filed: 2022-10-20 - Published: 2023-02-23 - Earliest claimed: 2020-05-22 - Assignees: FUJIFILM Corporation - Applicants: FUJIFILM Corporation - Inventors: Kenji MAKINO; Masahiro TERADA; Daisuke HAYASHI; Shunta EGO - Web page: https://patentgrep.com/patent/US20230054531A1 ## CPC - G06V 40/161: {Detection; Localisation; Normalisation} - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06V 10/776: Validation; Performance evaluation - G06V 40/174: {Facial expression recognition} - H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - G06T 2207/10144: Varying exposure - G06T 2207/30201: Face - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An image data processing device and an image data processing system are provided. An image data processing device performs a process of inputting a plurality of image data items in which imaging ranges at least partially overlap, detecting a face of a person in an image indicated by the image data, and recognizing a personal attribute of the person on the basis of the detected face for each of the image data items, a process of generating map data, in which the recognized personal attribute has been recorded in association with a position of the person in the image indicated by the image data, for each of the image data items, a process of interpolating the personal attribute of the person who overlaps between a plurality of the map data items, and a process of combining the plurality of map data items after the interpolation to generate composite map data. ## Claims ### Claim 1 An image data processing device that processes image data items which are obtained from a plurality of imaging devices and in which imaging ranges at least partially overlap, the image data processing device comprising a processor configured to perform: a process of detecting a face of a person in an image indicated by the image data and recognizing a personal attribute of the person on the basis of the detected face for each of the image data items; a process of generating map data, in which the recognized personal attribute has been recorded in association with a position of the person in the image indicated by the image data, for each of the image data items; a process of interpolating the personal attribute of the person who overlaps between a plurality of the map data items; and a process of combining the plurality of map data items after the interpolation to generate composite map data, wherein in a case in which information of the personal attribute is not capable of being interpolated with another map data item, the processor interpolates the information with another information item of the personal attribute having a similar change in attribute information over time. ### Claim 2 (depends on 1) The image data processing device according to claim 1, wherein the processor further performs a process of generating a heat map from the composite map data. ### Claim 3 (depends on 2) The image data processing device according to claim 2, wherein the processor further performs a process of displaying the generated heat map on a display. ### Claim 4 (depends on 2) The image data processing device according to claim 2, wherein the processor further performs a process of outputting the generated heat map to an outside. ### Claim 5 (depends on 1) The image data processing device according to claim 1, wherein the processor collates the personal attributes of the person who overlaps between the plurality of map data items and interpolates the personal attribute of the person lost in one map data item with the personal attribute of the person in another map data item. ### Claim 6 (depends on 1) The image data processing device according to claim 1, wherein the processor also calculates a recognition accuracy in a case in which the personal attribute of the person is recognized. ### Claim 7 (depends on 6) The image data processing device according to claim 6, wherein the processor replaces the personal attribute of the person with relatively low recognition accuracy with the personal attribute of the person with relatively high recognition accuracy to interpolate the personal attribute of the overlapping person. ### Claim 8 (depends on 6) The image data processing device according to claim 6, wherein the processor gives a weight corresponding to the recognition accuracy, calculates an average of the personal attributes of each of the persons, and replaces the personal attribute with the calculated average to interpolate the personal attribute of the overlapping person. ### Claim 9 (depends on 6) The image data processing device according to claim 6, wherein the processor has a plurality of recognition accuracies, adopts information of the personal attribute of the person having a recognition accuracy equal to or greater than a first threshold value, and interpolates the personal attribute of the overlapping person. ### Claim 10 (depends on 6) The image data processing device according to claim 6, wherein the processor further performs a process of excluding information of the personal attribute having a recognition accuracy equal to or less than a second threshold value in the map data after interpolation. ### Claim 11 (depends on 1) The image data processing device according to claim 1, wherein the processor further performs a process of specifying the person who overlaps between the plurality of map data items. ### Claim 12 (depends on 11) The image data processing device according to claim 11, wherein the processor specifies the person who overlaps between the plurality of map data items on the basis of a disposition relationship of the person in the map data. ### Claim 13 (depends on 11) The image data processing device according to claim 11, wherein the processor specifies the person who overlaps between the plurality of map data items on the basis of the personal attribute of the person at each position in the map data. ### Claim 14 (depends on 1) The image data processing device according to claim 1, wherein the processor recognizes at least one of gender, age, or emotion as the personal attribute on the basis of the face of the person. ### Claim 15 (depends on 1) The image data processing device according to claim 1, wherein the processor instructs the plurality of imaging devices to image an area, in which the imaging ranges overlap each other, under different conditions. ### Claim 16 (depends on 15) The image data processing device according to claim 15, wherein the processor instructs the plurality of imaging devices to image the area, in which the imaging ranges overlap each other, in different directions. ### Claim 17 (depends on 15) The image data processing device according to claim 15, wherein the processor instructs the plurality of imaging devices to image the area, in which the imaging ranges overlap each other, with different exposures. ### Claim 18 An image data processing system comprising: a plurality of imaging devices whose imaging ranges at least partially overlap; and an image data processing device that processes image data items obtained from the plurality of imaging devices, wherein the image data processing device includes a processor configured to perform: a process of detecting a face of a person in an image indicated by the image data and recognizing a personal attribute of the person on the basis of the detected face for each of the image data items; a process of generating map data, in which the recognized personal attribute has been recorded in association with a position of the person in the image indicated by the image data, for each of the image data items; a process of interpolating the personal attribute of the person who overlaps between a plurality of the map data items; and a process of combining the plurality of map data items after the interpolation to generate composite map data, and in a case in which information of the personal attribute is not capable of being interpolated with another map data item, the processor interpolates the information with another information item of the personal attribute having a similar change in attribute information over time. ### Claim 19 (depends on 18) The image data processing system according to claim 18, wherein the plurality of imaging devices image an area, in which imaging ranges overlap each other, under different conditions. ### Claim 20 (depends on 19) The image data processing system according to claim 19, wherein the plurality of imaging devices image the area, in which the imaging ranges overlap each other, in different directions. ### Claim 21 (depends on 19) The image data processing system according to claim 19, wherein the plurality of imaging devices image the area, in which the imaging ranges overlap each other, with different exposures.