xcore.ai’s unique architecture combined with the XCORE-VOICE framework allows designers to incorporate keyword, event detection, or advanced local dictionary support to create a complete voice interface solution.
Example Designs
XCORE-VOICE is a highly flexible voice solution that allows you to pick and choose voice components to run alongside your desired AI model. Detailed documentation is available to guide you through options as highlighted in the sections below.
We have included several example designs that will enable you to get started immediately.
Following that you can download the source code to further compile, according to your needs.
Far-Field Voice Local Command
- Dual PDM microphone with point and stationary noise reduction with integrated speech recognition engine.
- Recognising 16 sample commands with control of peripherals via UART. Optional audio play-back “spoken response”.
- Easily modified, provided as source with extensive libraries. Create your own custom through our partners.
Far-Field Voice Assistant
- 2-microphone far-field voice assistant front-end
- Audio pipeline including echo cancelation, interference cancelling and noise suppression
- Stereo reference input and voice assistant output each supported as I2S or USB (UAC2.0)
Asynchronous Sample Rate Convertor (ASRC)
- I2S to USB interface supporting asynchronous sampling rates between 44.1 kHz – 192 kHz
- Bidirectional signal path
Developer Resources
An XMOS solution is a convenient way to access a collection of software, examples, libraries and documentation for developers with an application in mind, and where all the components are guaranteed to work together.
XCORE-VOICE SDK
Frameworks
XMOS Frameworks are a collection of high-level components, already interoperable and sharing a common design approach.
| FRAMEWORK | DESCRIPTION | DOCUMENTATION |
|---|---|---|
FWK-VOICE | A collection of audio and voice signal processing components, implemented to use the 32-bit Block-Floating Point arithmetic of the xcore.ai Vector Processing Unit (VPU) | HTML |
| CONTAINED WITHIN FWK-VOICE | DESCRIPTION | DOCUMENTATION |
|---|---|---|
| Acoustic Echo Canceller (AEC) | Configurable for number of microphones and play-back channels | HTML |
| Automatic Delay Estimation and Correction (ADEC) | Functions for measuring and correcting delay offsets between AEC reference and loudspeaker signals | HTML |
| Interference Canceller (IC) | Point noise cancellation, using two microphone input | HTML |
| Noise Suppression (NS) | Removes stationary noise | HTML |
| Automatic Gain Control (AGC) | Maintains output between target levels | HTML |
| Voice To Noise Ratio Estimator (VNR) | ML based alternative to a classic VAD, providing a more informative estimation of voice presence in noise. | HTML |
| Asynchronous Sample Rate Convertor (ASRC) | Provides asynchronous signal exchange between two interfaces | HTML |
| FRAMEWORK | DESCRIPTION | DOCUMENTATION |
|---|---|---|
FWK-IO | IO Peripherals | HTML |
FWK-RTOS | XMOS’s SMP port of FreeRTOS | HTML SMP DEMO  |
Libraries
XMOS Libraries provide reusable software, as source, for common functions
| LIBRARY | DESCRIPTION | DOCUMENTATION |
|---|---|---|
LIB_MIC_ARRAY | Allows 1 to 16 PDM microphones to be connected to an xcore device, with configurable filtering and decimation. | HTML |
LIB_XCORE_MATH | Comprehensive library of mathematical and DSP functions, including integer, float, vectorised and complex operations. | HTML |
Speech Recognition Partners
PRE-BUILT EXAMPLE
This binary includes an example of
US English commands
| Spoken Command |
|---|
| Switch on the TV |
| Switch off the TV |
| Channel up |
| Channel down |
| Volume up |
| Volume down |
| Switch on the lights |
| Switch off the lights |
| Brightness up |
| Brightness down |
| Switch on the fan |
| Switch off the fan |
| Speed up the fan |
| Slow down the fan |
| Set higher temperature |
| Set lower temperature |
Mandarin commands
| Spoken Command | Translation |
|---|---|
| 打開電視 | Turn on the TV |
| 下一頻道 | Next channel |
| 上一頻道 | Previous channel |
| 增加音 | Increase sound |
| 降低音量 | Lower the volume |
| 關閉電視 | Turn off the TV |
| 開燈 | Turn on the light |
| 增加亮度 | Increase brightness |
| 減少亮度 | Reduce brightness |
| 關燈 | Turn off the lights |
| 開風扇 | Turn on the fan |
| 提高風速 | Increase wind speed |
| 降低風速 | Reduce wind speed |
| 提高溫度 | Increase temperature |
| 降低溫度 | Reduce the temperature |
| 關風扇 | Turn off the fan |
This is for evaluation purposes only. Please refer to the following quick start guide
CREATE YOUR OWN
PRE-BUILT EXAMPLE
This is for evaluation purposes only. Please refer to the following quick start guide
CREATE YOUR OWN
Buy
| PART NUMBER | DATASHEET | BUY |
|---|---|---|
| XU316-1024-QF60A-C24 | DATASHEET | DIGIKEY |
| XU316-1024-QF60B-C24 | DATASHEET | DIGIKEY |
| XU316-1024-QF60A-C32 | DATASHEET | DIGIKEY |
| XU316-1024-QF60B-C32 | DATASHEET | DIGIKEY |
| XU316-1024-QF60A-I24 | DATASHEET | DIGIKEY |
| XU316-1024-QF60B-I24 | DATASHEET | DIGIKEY |
| XU316-1024-QF60A-I32 | DATASHEET | DIGIKEY |
| XU316-1024-QF60B-I32 | DATASHEET | DIGIKEY |
