# US 2014/0192159 A1 · Camera registration and video integration in 3d geometry model > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0192159 A1 - Document ID: US20140192159A1 - Status: Published application - Kind: A1 - Application number: 14/122,324 - Filed: 2011-06-14 - Published: 2014-07-10 - Earliest claimed: 2011-06-14 - Assignees: Metrologic Instruments, Inc. - Inventors: Henry Chen; Xiaoli Wang; Hao Bai; Saad J Ros; Tom Plocher - Web page: https://patentgrep.com/patent/US20140192159A1 ## CPC - G06T 15/00: Three-dimensional [3D] image rendering - G06T 15/20: Perspective computation - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06T 2215/16: Using real world measurements to influence rendering - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Apparatus, systems, and methods may operate to receive a real image or real images of a coverage area of a surveillance camera. Building Information Model (BIM) data associated with the coverage area may be received. A virtual image may be generated using the BIM data. The virtual image may include at least one three-dimensional (3-D) graphics that substantially corresponds to the real image. The virtual image may be mapped with the real image. Then, the surveillance camera may be registered in a BIM coordination system using an outcome of the mapping. ## Claims ### Claim 1 A system comprising: one or more processors to operate a registration module, the registration module configured to: (a) receive a real image of a coverage area of a surveillance camera, the coverage area corresponding to at least one portion of a surveillance area; (b) receive Building Information Model (BIM) data associated with the coverage area; (c) generate a virtual image using the BIM data, the virtual image including at least one three-dimensional (3-D) graphics substantially corresponding to the real image; (d) map the virtual image with the real image; and (e) register the surveillance camera in a BIM coordination system using an outcome of the mapping. ### Claim 2 (depends on 1) The system of claim 1, wherein the generation of the virtual image is based on initial extrinsic parameters of the surveillance camera. ### Claim 3 (depends on 2) The system of claim 2, wherein the initial extrinsic parameters are received as one or more user inputs or imported from a camera planning system or a camera installation system. ### Claim 4 (depends on 1) The system of claim 1, wherein the mapping comprises: matching a plurality of pairs of points on the virtual image and the real image; calculating at least one geometry coordination for a corresponding one of the points on the virtual image; and calculating refined extrinsic parameters for the surveillance camera using the at least one geometry coordination. ### Claim 5 (depends on 4) The system of claim 4, wherein each point in the plurality of pairs of points comprises a vertex associated with a geometric feature extracted from a corresponding one of the virtual image or the real image. ### Claim 6 (depends on 5) The system of claim 5, wherein the geometric feature associated with the virtual image is driven from the BIM data. ### Claim 7 (depends on 5) The system of claim 5, wherein the geometric feature comprises a shape or at least one portion of a boundary line of an object or a building structure viewed in a corresponding one of the virtual image or the real image. ### Claim 8 (depends on 4) The system of claim 4, wherein the matching comprises marking at least one of the plurality of pairs as matching as a function of a user input. ### Claim 9 (depends on 4) The system of claim 4, wherein the matching comprises removing at least one pair of points from a group of automatically suggested pairs of points as a function of a corresponding user input. ### Claim 10 (depends on 1) The system of claim 1, further comprising a display unit, wherein the registration module is configured to display the mapping of the virtual image with the real image via the display unit. ### Claim 11 (depends on 1) The system of claim 1, wherein the registering comprises calculating refined extrinsic parameters of the surveillance camera, the refined extrinsic parameters including a current location and a current orientation of the surveillance camera in the BIM coordinate system. ### Claim 12 (depends on 11) The system of claim 11, further comprising a display unit, wherein the registration module is configured to present, via the display unit, the coverage area in three dimensional (3-D) graphics using the refined extrinsic parameters. ### Claim 13 (depends on 12) The system of claim 12, wherein the presenting comprises highlighting the coverage area. ### Claim 14 (depends on 12) The system of claim 12, wherein the presenting comprises projecting an updated image on a portion of the coverage area, the updated image being obtained from the surveillance camera in real time. ### Claim 15 (depends on 14) The system of claim 14, wherein the projecting comprises inhibiting display of at least one portion of the updated image based on a constraint on a user perspective. ### Claim 16 (depends on 15) The system of claim 15, wherein the user perspective comprises a cone shape determined based on the refined extrinsic parameters. ### Claim 17 (depends on 11) The system of claim 11, wherein the registration module is further configured to detect a camera drift using the refined extrinsic parameters, wherein the detecting the camera drift comprises: comparing the refined extrinsic parameters with initial extrinsic parameters of the surveillance camera; and triggering an alarm of a camera drift event based on a determination that a difference between the initial extrinsic parameters and the refined extrinsic parameters reaches a specified threshold. ### Claim 18 (depends on 11) The system of claim 11, wherein the refined extrinsic parameters of the surveillance camera are calculated periodically. ### Claim 19 A computer-implemented method comprising: (a) receiving, using one or more processors, a real image of a coverage area of a surveillance camera, the coverage area corresponding to at least one portion of a surveillance area; (b) receiving Building Information Model (BIM) data associated with the coverage area; (c) generating a virtual image using the BIM data, the virtual image including at least one three-dimensional (3-D) graphics substantially corresponding to the real image; (d) mapping the virtual image with the real image; and (e) registering the surveillance camera in a BIM coordination system using an outcome of the mapping. ### Claim 20 A non-transitory computer-readable storage medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising: (a) receiving a real image of a coverage area of a surveillance camera, the coverage area corresponding to at least one portion of a surveillance area; (b) receiving Building Information Model (BIM) data associated with the coverage area; (c) generating a virtual image using the BIM data, the virtual image including at least one three-dimensional (3-D) graphics substantially corresponding to the real image; (d) mapping the virtual image with the real image; and (e) registering the surveillance camera in a BIM coordination system using an outcome of the mapping.