MATRIX Labs have now released two new Raspberry Pi accessory boards that combines a whole new level of sensors built into miniature computer. The MATRIX Creator was built with an aim of giving every hobbyist, tinkerer, and hackers around the world a complete, affordable and a user friendly instrument for simple as well as complex Internet of Things project developments. It is powered by a Xilinx Spartan 6 FPGA, a super powered miniature ARM Cortex M3 microcontroller, an awesome collection of sensors for motion sensing, temperature, humidity, light, ultraviolet and infrared measurement, an 8-microphone array and a 35-LED array also known as everloop.
MATRIX Voice, on the other hand is a smaller board that mainly focuses on voice detection and recognition projects. In addition to its ability to connect with Raspberry Pi, it can also be used as a standalone module by taking advantage of its FPGA capabilities.
Before diving into the projects, you must know what exactly is a MATRIX Voice/Creator is, its specifications and its capabilities. Learn more about it from the below link.
Great!! Now you know what a MATRIX device is and what it can do. Now let us take a look on different layers of MATRIX Devices. Depending on your background, coding skills and the type of application you are plainning to build, you can choose from any of these three different layers.
MATRIX Open System (MOS)
Abstraction layer for HAL. Hosts a ZeroMQ + Protobuf communication layer which makes device information accessible via high-level interfaces. Supports 40+ different languages, C++, Python, Ruby, PHP, Java, etc.
HAL is the lowest-level abstraction for the MATRIX Creator drivers. You can interface directly with HAL, or use the higher level components like CORE, and MATRIX OS. C++ drivers for sensors and available components. Tooling for accessing the FPGA and microcontrollers on the MATRIX device.
Now let us start by setting up MOS. MOS allows you to create applications in Java Script and deploy the application to a remote device with ease. For that you will need a Local machine (Where you program the application) and a MATRIX device connected Raspberry Pi, where we deploy and run the application.
MATRIX Core Setup
Set up MATRIX Core on your raspberry Pi and start programming your MATRIX Device Core Layer using Python. Use python to interact with the sensors and make amazing projects.
MATRIX HAL Setup
HAL or Hardware Abstraction Layer is the lowest level layer of the MATRIX Creator drivers. You can either interact directly with HAL, or use the higher level components like MALOS or the MATRIX OS to tinker with the MATRIX Device. This uses C++ drivers for available sensors and hardware.
MATRIX Voice / Creator Projects
Now you know what the MATRIX device is, what it can do and how to set up environment and run demo applications. Lets start building something fun.
PocketSphinx has an awesome collection of libraries for speech recognition algorithms for efficient speech recognition. Now let us configure PocketSphinx and start using voice commands in your MATRIX Device.