Audio response modality
The following example demonstrates how some models can directly generate audio as part of their response.audio_agent.py
You can find the audio response in the
RunOutput.response_audio object.There is a distinction between audio response modality and generated audio artifacts. When the model responds with audio, it is stored in the
RunOutput.response_audio object. The generated audio artifacts are stored in the RunOutput.audio list.Audio input and Audio output
The following example demonstrates how to provide a combination of audio and text inputs to an agent and obtain both text and audio outputs.audio_agent.py