Hello Everyone,
Today I am going to share my thoughts on the Enhancing IVR with generative answers optimised for voice in Copilot Studio.
To enhance an IVR with generative answers optimised for voice in Microsoft Copilot Studio, you essentially combine LLM-based generative responses with voice-channel best practices so answers sound natural when spoken by a bot. Below is a practical step-by-step approach used in production IVR systems.
1. Enable Generative Answers in Copilot Studio
In Microsoft Copilot Studio you can allow the bot to generate responses from knowledge sources.
Steps
Open your Copilot Studio bot.
Go to Topics → Generative Answers.
Enable Generative AI responses.
Connect knowledge sources such as:
SharePoint
Public websites
Dataverse
Uploaded documents (PDF/Word)
This allows the bot to generate answers instead of only using scripted topics.
2. Configure Voice Channel (IVR)
To make the bot work as an IVR, connect it to voice channels via:
Azure Communication Services
Microsoft Teams
Dynamics 365 Customer Service
Third-party contact centers (Genesys, Avaya, etc.)
These platforms handle:
Speech-to-text
Text-to-speech
Call routing
3. Optimize Generative Answers for Voice
LLM responses are normally written for text, so you must shape them for spoken IVR.
Use Voice Response Instructions
In the Generative Answers configuration, add instructions like:
Respond in a short conversational style suitable for voice.
Use sentences under 15 words.
Avoid bullet lists and long explanations.
Pause between ideas.
If the answer is long, summarize first and offer to provide more details.
Example transformation:
Normal LLM output
Our return policy allows customers to return products within 30 days provided that the product is unused and in its original packaging.
Voice-optimized
You can return items within 30 days.
The product must be unused and in the original packaging.
4. Add Fallback Logic for IVR
In IVR flows you should always handle uncertain AI answers.
Typical pattern:
User question
↓
Generative Answer
↓
Confidence check
↓
If low confidence → transfer to agent
Use Power Automate actions or topic conditions to:
escalate calls
ask clarification questions
repeat simplified answers
5. Limit Response Length
IVR responses must be shorter than chat responses.
Recommended limits:
Type Length
Primary answer 1–2 sentences
Follow-up details Optional
Total speaking time < 15 seconds
6. Add Confirmation Prompts
Voice bots should confirm understanding.
Example:
“Your order was shipped yesterday.
Would you like the tracking number?”
This improves call flow and reduces frustration.
7. Improve Voice Naturalness (SSML)
Use Speech Synthesis Markup Language (SSML) with Azure TTS.
Example:
Your order shipped yesterday.
Would you like the tracking number?
This works with:
Azure AI Speech
8. Monitor and Retrain
Track voice interactions using analytics in:
Copilot Studio analytics
Dynamics contact center insights
Improve by:
Adding missing knowledge
Shortening responses
Adjusting prompt instructions
Example: IVR Flow with Generative Answers
Caller question
↓
Speech to text
↓
Copilot Studio
↓
Generative Answer
↓
Voice optimized response
↓
Text to speech
↓
Caller hears response
That’s it for today.
I hope this helps.
Malla Reddy Gurram aka @uk365guy