# US 2023/0410522 A1 · Information processing apparatus, control method, and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2023/0410522 A1 - Document ID: US20230410522A1 - Status: Published application - Kind: A1 - Application number: 18/241,770 - Filed: 2023-09-01 - Published: 2023-12-21 - Earliest claimed: 2017-03-31 - Assignees: NEC Corporation - Applicants: NEC Corporation - Inventors: Takuya Ogawa - Web page: https://patentgrep.com/patent/US20230410522A1 ## CPC - G06V 20/53: {Recognition of crowd images, e.g. recognition of crowd congestion} - G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) - G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44) - G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) - H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An information processing apparatus of the present invention detects a queue (20) of objects from video data (12). Further, the information processing apparatus of the present invention generates element information using a video frame (14) in which the queue (20) of objects is detected. The element information is information in which an object area (24) in the video frame (14) occupied by the object (22) included in the queue (20) of objects is associated with an attribute of the object (22). Furthermore, the information processing apparatus of the present invention detects a change in the queue (20) of objects based on the element information and the detection result of the object to video frame (14) generated after the video frame (14) in which the element information is generated. Then, the information processing apparatus of the present invention generates element information for the queue (20) of objects in which a change is detected to update the element information used later. ## Claims ### Claim 1 An information processing apparatus comprising: at least one memory configured to store instructions; and at least one processor configured to execute the instructions to: detect a queue of objects from video frame; generate, based on a plurality of the video frames detected the queue, an object area in the video frame occupied by the object included in the queue and a position information of the object in the queue; and detect that a first object leaves the queue in a case where the first object is not detected from the object area of the first object, it is detected that a second object enters into the object area of the first object, and it is detected that a third object is stationary, the first object having not been at ends of the queue, the second object having been at right behind the first object, the third object having been right before the first object. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein the at least one processor is further configured to execute the instructions to: compute a staying time at an end of the queue for the object being positioned at the end; and compute a time obtained by multiplying the computed time by a length of the queue as a waiting time of the queue. ### Claim 3 (depends on 2) The information processing apparatus according to claim 2, wherein the at least one processor is further configured to execute the instructions to: compute, as the staying time of the object at the end of the queue, a time between when the object leaves the end of the queue and when another object subsequently leaves the end of the queue. ### Claim 4 A control method executed by one or more computers, comprising: detecting a queue of objects from video frame; generating, based on a plurality of the video frames detected the queue, an object area in the video frame occupied by the object included in the queue and a position information of the object in the queue; and detect that a first object leaves the queue in a case where the first object is not detected from the object area of the first object, it is detected that a second object enters into the object area of the first object, and it is detected that a third object is stationary, the first object having not been at ends of the queue, the second object having been at right behind the first object, the third object having been right before the first object. ### Claim 5 (depends on 4) The control method according to claim 4, further comprising: computing a staying time at an end of the queue for the object being positioned at the end; and computing a time obtained by multiplying the computed time by a length of the queue as a waiting time of the queue. ### Claim 6 (depends on 5) The control method according to claim 5, further comprising: computing, as the staying time of the object at the end of the queue, a time between when the object leaves the end of the queue and when another object subsequently leaves the end of the queue. ### Claim 7 A non-transitory storage medium storing a program causing a computer to execute a control method, the control method comprising: detecting a queue of objects from video frame; generating, based on a plurality of the video frames detected the queue, an object area in the video frame occupied by the object included in the queue and a position information of the object in the queue; and detect that a first object leaves the queue in a case where the first object is not detected from the object area of the first object, it is detected that a second object enters into the object area of the first object, and it is detected that a third object is stationary, the first object having not been at ends of the queue, the second object having been at right behind the first object, the third object having been right before the first object. ### Claim 8 (depends on 7) The non-transitory storage medium according to claim 7, wherein the control method further comprises: computing a staying time at an end of the queue for the object being positioned at the end; and computing a time obtained by multiplying the computed time by a length of the queue as a waiting time of the queue. ### Claim 9 (depends on 8) The non-transitory storage medium according to claim 8, wherein the control method further comprises: computing, as the staying time of the object at the end of the queue, a time between when the object leaves the end of the queue and when another object subsequently leaves the end of the queue.