The TFLM module integrates tensorflow micro into SOF as an audio classifiction and in the future an audio processing module. This module is currently still work in progress, and needs a few features to be completed before its ready for production.
Please run ./scripts/tensorflow-clone.sh before building as this will clone all dependencies required to build tensor flow micro with optimized xtensa kernels.
Please select the following in Kconfig
CONFIG_CPP=y
CONFIG_STD_CPP17=y
CONFIG_SOF_STAGING=y
To build as built-in, select CONFIG_COMP_TENSORFLOW=y in Kconfig and build.
To build as a llext module, select CONFIG_COMP_TENSORFLOW=m in Kconfig and the build.
The TFLM SOF module needs features created by the MFCC module as its input. This step is still in progress. The following pipeline will be used
Mic --> MFCC --> TFLM --> Classification
-
Create MFCC pipeline and align with TFLM micro_speech audio feature extraction configuration.
-
Support compressed output PCM with Classification results.
-
Load tflite models via binary kcontrol.
-
Support audio processing via TFLM module.