Method and apparatus for assigning image location and direction to a floorplan diagram based on artificial intelligence
AssigneeRakuten, Inc.
InventorsBjorn Stenger, Tomoyuki Mukasa, Jiu Xu, Lu Yan
Life of this patent
Estimating the term…
Abstract
A computer implemented method using artificial intelligence for matching images with locations and directions by acquiring a plurality of panoramic images, detecting objects and their locations in each of the panoramic images, acquiring a floorplan image, detecting objects and their locations in the floorplan image, comparing the objects and locations detect in each of the panoramic image to the objects and locations detected in the floorplan image, and determining a location in the floorplan image where each panoramic image was taken.
Claims20
A computer implemented method using artificial intelligence for matching images with locations and directions, the method comprising:
- acquiring a plurality of room images taken with a camera;
- using artificial intelligence to detect at least one object in each of the plurality of room images;
- detecting an object location of the at least one object detected in each of the room images;
- acquiring a floorplan image;
- using artificial intelligence to detect at least one object in the floorplan image;
- detecting an object location of the at least one object detected in the floorplan image;
- comparing the at least one object and object location detected in each of the plurality of room images to the at least one object and object location detected in the floorplan image;
- and
- determining a location in the floorplan image where each room image was taken.
An artificial intelligence (AI) system for matching images with locations and directions, the apparatus comprising a central processing unit (CPU), a graphical processing unit (GPU), and a memory, the CPU configured to:
- acquire a plurality of room images;
- acquire a floorplan image;
- the GPU is configured to:
- detect objects and the object locations in each of the room images;
- detect objects and the object locations in the floorplan image;
- wherein the CPU is further configured to:
- compare the objects and object locations detected in each of the room images to the objects and object locations detected in the floorplan image;
- and
- determine a location in the floorplan image where each room image was taken.
A non-transitory computer readable medium for causing an artificial intelligence (AI) system, which comprises a central processing unit (CPU), a graphical processing unit (GPU), and a memory, to match images with locations of where the images were taken and directions the images were taken in, the non-transitory computer readable medium causing the AI system to:
- acquire a plurality of room images;
- acquire a floorplan image;
- the non-transitory computer readable medium causing the GPU to:
- detect objects and the object locations in each of the room images;
- detect objects and the object locations in the floorplan image;
- wherein the non-transitory computer readable medium further causes the CPU to:
- compare the objects and object locations detected in each of the room images to the objects and object locations detected in the floorplan image;
- and
- determine a location in the floorplan image where each room image was taken.
Dependencies are inferred from the claim text.