Methods, devices, and systems for identifying and tracking an object with multiple cameras

An object identifying and tracking system, comprising:

• at least one trackable object, comprising at least two light elements of different wavelength combined together to form a light source, wherein the at least two light elements comprises a first light element emitting invisible light and a second light element emitting visible light;
• a first image capturer, disposed at one end of an imaging device, comprising a first band-pass filter allowing the invisible light to pass through and a first camera capturing light passing through the first band-pass filter;
• a second image capturer, disposed at the other end of the imaging device, comprising a second band-pass filter allowing the visible light to pass through and a second camera capturing light passing through the second band-pass filter;
• a first processor, coupled to the first image capturer, configured to instruct the first image capturer to capture an invisible image including the at least one trackable object and image of the invisible light, determine a first candidate pixel region associated with pixels of the invisible light in the invisible image, and generate a candidate area corresponding to light sources of the visible image based on the first candidate pixel region;
• a second processor, coupled to the second image capturer, configured to instruct the second image capturer to capture a visible image including the at least one trackable object and image of the visible light, and generate a second candidate pixel region corresponding to light sources from the visible image based on the candidate area;
• a post processor, coupled to the first processor and the second processor, configured to calculate 3D positions of light sources in real world based on the first candidate pixel region and the second candidate pixel region.

An object identifying and tracking method, comprising:

• combining at least two light elements of different wavelength together to form a light source inside a trackable object, wherein the at least two light elements comprises a first light element emitting invisible light, and a second light element emitting visible light;
• disposing the light source onto a place in real world whose location is interested by a virtual reality (VR) system;
• constructing an image capture system using at least two image sensors disposed at two ends of an imaging device and two band-pass filters, wherein the first band-pass filter allows invisible light to pass through, and the second band-pass filter allows visible light to pass through;
• capturing a pair of raw images, through the image capture system, by obtaining an invisible image through the first band-pass filter and a visible image through the second band-pass filter, wherein the image of the invisible light emitted by the first light element is captured in the invisible image, the image of the visible light emitted by the second light element is captured in the visible image;
• processing the invisible image to determine a first candidate pixel region associated with pixels of the invisible light emitted by the first light element in the invisible image and generate a candidate area corresponding to light sources of the visible image based on the first candidate pixel region;
• processing the visible image to generate a second candidate pixel region corresponding to light sources from the visible image based on the candidate area;
• and
• processing the first candidate pixel region and the second candidate pixel region to calculate 3D positions of light sources in real world.