Neural network accelerator system for improving semantic image segmentation

A non-transitory computer readable medium comprising instructions, which, when executed, cause processor circuitry to at least:

• transmit an input image to at least one of vision network circuitry and imaging network circuitry;
• generate, by the vision network circuitry, a first output based on a first feature map of the input image being generated by image scaling circuitry;
• generate, by the imaging network circuitry, a second output of the input image;
• upscale the first output, by bottleneck extender circuitry, to a resolution based on the second output;
• concatenate the first and second output to generate a concatenated output;
• apply a convolution operation to the concatenated output;
• and
• generate, by segmentation head circuitry, a pixel level segmentation class map from the concatenated output.

An apparatus comprising:

• means for transmitting an input image to at least one of vision network circuitry and imaging network circuitry;
• means for generating, by the vision network circuitry, a first output based on a first feature map of the input image being generated by image scaling circuitry;
• means for generating, by the imaging network circuitry, a second output of the input image;
• means for upscaling the first output, by bottleneck extender circuitry, to a resolution based on the second output;
• means for concatenating the first and second output to generate a concatenated output;
• means for applying a convolution operation to the concatenated output;
• and
• means for generating, by segmentation head circuitry, a pixel level segmentation class map from the concatenated output.

An apparatus to perform semantic image segmentation comprising:

• mode selecting circuitry to transmit an input image to at least one of vision network circuitry and imaging network circuitry,
• the vision network circuitry to generate a first output based on a first feature map of the input image being generated by image scaling circuitry,
• the imaging network circuitry to generate a second output of the input image;
• bottleneck extender circuitry to:
• upscale the first output to a resolution based on the second output;
• concatenate the first and second output to generate a concatenated output;
• and
• apply a convolution operation to the concatenated output;
• and
• segmentation head circuitry to generate a pixel level segmentation class map from the concatenated output.