Systems and methods for a dual modality sensor system

A method for generating an image of an object within a region, comprising:

• receiving electromagnetic radiation from a plurality of sites on an object within a region, the electromagnetic radiation comprising electromagnetic waves within a first frequency band;
• identifying a portion of interest on the object based on the received electromagnetic radiation;
• transmitting ultrasound, via a first ultrasonic transmitter of an ultrasonic transmission system, into the region;
• receiving, via a first ultrasonic receiver of an ultrasonic receiver system, ultrasonic reflections of the transmitted ultrasound from the portion of interest on the object within the region, the ultrasonic reflections comprising sound waves within a second frequency band, the second frequency band being different than the first frequency band, the ultrasonic reflections including direct ultrasonic reflection and rebounded ultrasonic reflection, wherein the direct ultrasonic reflection is reflected from a first portion of the portion of interest on the object and the rebounded ultrasonic reflection is reflected from a second, different portion of the portion of interest on the object;
• generating, via a processor, image data of the portion of interest on the object at a first resolution based on the received ultrasonic reflections;
• determining a kinematic value associated with the portion of interest based on at least one of the received electromagnetic radiation and the received ultrasonic reflections, wherein positional data is generated based at least on the direct ultrasonic reflection and the rebounded ultrasonic reflection, wherein the kinematic value is determined based at least in part on the positional data;
• and
• modifying the state of an entertainment device based on the determined kinematic value associated with the portion of interest on the object.

A method for generating an image of an object within a region, comprising:

• transmitting ultrasound, via an ultrasonic transmission system, into the region;
• receiving, via an ultrasonic receiver system, ultrasonic reflections of the transmitted ultrasound from a plurality of sites on the object within the region, the ultrasonic reflections comprising sound waves within a first frequency band, the ultrasonic reflections including direct ultrasonic reflection and rebounded ultrasonic reflection, wherein the direct ultrasonic reflection is reflected from a first portion of the object and the rebounded ultrasonic reflection is reflected from a second, different portion of the object;
• generating, via a processor, image data of the object at a first resolution based on the received ultrasonic reflections, wherein the image data at the first resolution includes at least one ambiguity;
• receiving electromagnetic radiation reflected by the object that is sufficient to resolve the at least one ambiguity, the electromagnetic radiation comprising electromagnetic waves within a second frequency band, the second frequency band being different than the first frequency band;
• generating enhanced image data resolving the at least one ambiguity based on the received electromagnetic radiation;
• determining a kinematic value associated with the object based on at least one of the received electromagnetic radiation and the received ultrasonic reflections, wherein positional data is generated based at least on the direct ultrasonic reflection and the rebounded ultrasonic reflection, wherein the kinematic value is determined based at least in part on the positional data;
• and
• modifying the state of an entertainment device based on the determined kinematic value associated with the portion of interest on the object.

A system for generating an image of an object within a region, comprising:

• an ultrasonic transmitter configured to transmit ultrasound into the region;
• an ultrasonic receiver configured to receive an ultrasonic reflection of the transmitted ultrasound from a plurality of sites on the object within the region, the ultrasonic reflections comprising sound waves within a first frequency band, the ultrasonic reflection including a direct ultrasonic reflection and a rebounded ultrasonic reflection, wherein the direct ultrasonic reflection is reflected from a first portion of the object and the rebounded ultrasonic reflection is reflected from a second, different portion of the object;
• a first imaging module configured to generate coarse image data of the object at a first resolution based on the received ultrasonic reflections;
• an identification module configured to identify a portion of interest on the object based on the coarse image data;
• an electromagnetic radiation receiver configured to receive electromagnetic radiation from the identified portion of interest on the object, the electromagnetic radiation comprising electromagnetic waves within a second frequency band, the second frequency band being different than the first frequency band;
• a second imaging module configured to generate fine image data of the portion of interest on the object at a second resolution based on electromagnetic radiation received by the electromagnetic radiation receiver, wherein the second resolution is greater than the first resolution;
• a kinematic determination module configured to determine a kinematic value associated with the portion of interest on the object based on at least one of received electromagnetic radiation and received ultrasonic reflections, wherein positional data is generated based at least on the direct ultrasonic reflection and the rebounded ultrasonic reflection, wherein the kinematic value is determined based at least in part on the positional data;
• and
• a modification module configured to modify the state of an entertainment device based on the kinematic value associated with the portion of interest on the object.

A system for generating an image of an object within a region, comprising:

• an electromagnetic radiation receiver configured to receive electromagnetic radiation from a plurality of sites on an object within a region, the electromagnetic radiation comprising electromagnetic waves within a first frequency band;
• an identification module configured to identify a portion of interest on the object based on the received electromagnetic radiation;
• an ultrasonic transmitter configured to transmit ultrasound into the region;
• an ultrasonic receiver configured to receive an ultrasonic reflection of the transmitted ultrasound from the portion of interest on the object within the region, the ultrasonic reflections comprising sound waves within a second frequency band, the second frequency band being different than the first frequency band, the ultrasonic reflection including a direct ultrasonic reflection and a rebounded ultrasonic reflection, wherein the direct ultrasonic reflection is reflected from a first portion of the object and the rebounded ultrasonic reflection is reflected from a second, different portion of the object;
• a first imaging module configured to generate image data of the portion of interest on the object at a first resolution based on the received ultrasonic reflections;
• a kinematic determination module configured to determine a kinematic value associated with the portion of interest on the object based on at least one of received electromagnetic radiation and received ultrasonic reflections, wherein positional data is generated based at least on the direct ultrasonic reflection and the rebounded ultrasonic reflection, wherein the kinematic value is determined based at least in part on the positional data;
• and
• a modification module configured to modify the state of an entertainment device based on the kinematic value associated with the portion of interest on the object.