Adjusting audio and non-audio features based on noise metrics and speech intelligibility metrics

An apparatus, comprising:

• an interface system;
• and
• a control system configured to:
• receive, via the interface system, a content stream that includes video data and audio data corresponding to the video data;
• determine at least one of a noise metric or a speech intelligibility metric;
• perform a compensation process in response to at least one of the noise metric or the speech intelligibility metric, wherein performing the compensation process involves altering a processing of the audio data based, at least in part, on metadata and at least one of the noise metric or the speech intelligibility metric, wherein the compensation process further comprises controlling a closed captioning system, a surtitling system or a subtitling system and wherein controlling the closed captioning system, the surtitling system or the subtitling system involves determining whether to simplify speech-based text, based, at least in part, on a determination that the speech intelligibility metric or the noise metric is below a threshold level, wherein simplifying the speech-based text includes modifying the speech-based text to include more or less text;
• process the video data;
• provide processed video data to at least one display device of an environment;
• render the audio data for reproduction via a set of audio reproduction transducers of the environment, to produce rendered audio signals;
• provide, via the interface system, the rendered audio signals to at least some audio reproduction transducers of the set of audio reproduction transducers of the environment.

One or more non-transitory media having software stored thereon, the software including instructions for controlling one or more devices to perform a method, the method comprising:

• receiving, by a control system and via an interface system, a content stream that includes video data and audio data corresponding to the video data, the audio data including audio objects and metadata corresponding to the audio objects, wherein an audio object is a discrete sound element with associated metadata;
• determining, by the control system, at least one of a noise metric or a speech intelligibility metric;
• performing, by the control system, a compensation process in response to at least one of the noise metric or the speech intelligibility metric, wherein performing the compensation process involves altering a processing of the audio data based, at least in part, on metadata and at least one of the noise metric or the speech intelligibility metric, wherein the compensation process further comprises controlling a closed captioning system, a surtitling system or a subtitling system and wherein controlling the closed captioning system, the surtitling system or the subtitling system involves determining whether to simplify speech-based text, based, at least in part, on a determination that the speech intelligibility metric or the noise metric is below a threshold level, wherein simplifying the speech-based text includes modifying the speech-based text to include more or less text;
• processing, by the control system, the video data;
• providing, by the control system, processed video data to at least one display device of an environment;
• rendering, by the control system, the audio data for reproduction via a set of audio reproduction transducers of the environment, to produce rendered audio signals;
• providing, via the interface system, the rendered audio signals to at least some audio reproduction transducers of the set of audio reproduction transducers of the environment.