Playing Spoken Feedback
Since your user will be driving while interacting with your SDL app, speech phrases can provide important feedback to your user. At any time during your app's lifecycle you can send a speech phrase using the Speak request and the head unit's text-to-speech (TTS) engine will produce synthesized speech from your provided text.
When using the Speak RPC, you will receive a response from the head unit once the operation has completed. From the response you will be able to tell if the speech was completed, interrupted, rejected or aborted. It is important to keep in mind that a speech request can interrupt another ongoing speech request. If you want to chain speech requests you must wait for the current speech request to finish before sending the next speech request.
Note
On Manticore, spoken feedback works best in Google Chrome, Mozilla Firefox, or Microsoft Edge. Spoken feedback does not work in Apple Safari at this time.
Creating the Speak Request
The speech request you send can simply be a text phrase, which will be played back in accordance with the user's current language settings, or it can consist of phoneme specifications to direct SDL’s TTS engine to speak a language-independent, speech-sculpted phrase. It is also possible to play a pre-recorded sound file (such as an MP3) using the speech request. For more information on how to play a sound file please refer to Playing Audio Indications.
Getting the Supported Speech Capabilities
Once you have successfully connected to the module, you can access supported speech capabilities properties on the sdlManager.getSystemCapabilityManager() instance.
sdlManager.getSystemCapabilityManager().getCapability(SystemCapabilityType.SPEECH, new OnSystemCapabilityListener() { @Override public void onCapabilityRetrieved(Object capability) { List<SpeechCapabilities> speechCapabilities = (List<SpeechCapabilities>) capability; } @Override public void onError(String info) { // Handle error } }, false);
Below is a list of commonly supported speech capabilities.
| Speech Capability | Description |
|---|---|
| Text | Text phrases |
| SAPI Phonemes | Microsoft speech synthesis API |
| File | A pre-recorded sound file |
Creating Different Types of Speak Requests
Once you know what speech capabilities are supported by the module, you can create the speak requests.
Text Phrase
TTSChunk ttsChunk = new TTSChunk("hello", SpeechCapabilities.TEXT); List<TTSChunk> ttsChunkList = Collections.singletonList(ttsChunk); Speak speak = new Speak(ttsChunkList);
SAPI Phonemes Phrase
TTSChunk ttsChunk = new TTSChunk("h eh - l ow 1", SpeechCapabilities.SAPI_PHONEMES); List<TTSChunk> ttsChunkList = Collections.singletonList(ttsChunk); Speak speak = new Speak(ttsChunkList);
Sending the Speak Request
speak.setOnRPCResponseListener(new OnRPCResponseListener() { @Override public void onResponse(int correlationId, RPCResponse response) { SpeakResponse speakResponse = (SpeakResponse) response; if (!speakResponse.getSuccess()){ switch (speakResponse.getResultCode()){ case DISALLOWED: DebugTool.logInfo(TAG, "The app does not have permission to use the speech request"); break; case REJECTED: DebugTool.logInfo(TAG, "The request was rejected because a higher priority request is in progress"); break; case ABORTED: DebugTool.logInfo(TAG, "The request was aborted by another higher priority request"); break; default: DebugTool.logInfo(TAG, "Some other error occurred"); } return; } DebugTool.logInfo(TAG, "Speech was successfully spoken"); } }); sdlManager.sendRPC(speak);