tinyML Talks: Unleashing the Power of the New XIAO ESP32S3 Sense: Tackling Anomaly Detection, Image Classification, and Keyword Spotting with TinyML

As machine learning continues to evolve and integrate with embedded systems, TinyML emerges at the intersection, offering the potential to run machine learning models on low-power microcontrollers. This talk will delve into the fascinating world of Tiny Machine Learning (TinyML) using the a Thumb-Size ESP32 CAM Dev Board: Seeed Studio XIAO ESP32S3 Sense. We will explore three significant projects demonstrating the wide range of possibilities with TinyML. Our journey begins with an Anomaly Detection and Motion Classification project. Here, we will use an Inertial Measurement Unit (IMU) sensor to identify unusual patterns and classify various types of motion. We will discuss collecting and preprocessing sensor data, training a machine-learning model, and deploying it onto the ESP32S3 for real-time inference. Next, we will explore Image Classification, showing how the XIAO ESP32S3 Sense, with its built-in camera, can identify and classify objects. We will discuss the challenges of working with image data, including handling high dimensionality and data variability, and demonstrate how we overcame these challenges to build a robust classifier. Finally, we will conclude the talk with a project on Keyword Spotting. Using the built-in microphone of the XIAO ESP32S3 Sense, we will demonstrate how to train a model to recognize specific spoken keywords. This portion of the talk introduces sound classification, a compelling field with many applications, from voice assistants to environmental sound classification. Throughout the talk, we will use the Arduino IDE and Edge Impulse Studio to create and deploy the TinyML models. Attendees will gain insights into data collection, pre-processing, model design, and impulse design.


June 13, 2023



Contact us



Timezone: PDT

Unleashing the Power of the New XIAO ESP32S3 Sense: Tackling Anomaly Detection, Image Classification, and Keyword Spotting with TinyML

Marcelo ROVAI, Co-Chair

TinyML4D group

Marcelo ROVAI, Co-Chair

TinyML4D group

Marcelo Rovai is born in São Paulo and held a Master’s in Data Science from the Universidad del Desarrollo (UDD) in Chile and an MBA from IBMEC (INSPER) in Brazil. He graduated in 1982 as an Engineer from UNIFEI, Federal University of Itajubá, with a specialization from Escola Politécnica de Engenharia of São Paulo University (USP), both institutions located in Brazil. Rovai has experience as a teacher, engineer, and executive in several technology companies such as CDT/ETEP, AVIBRAS Aeroespacial, SID Informática, ATT-GIS, NCR, DELL, COMPAQ (HP), and more recently at IGT as a VP and a Senior Advisor for Latin America. Marcelo Rovai publishes articles about electronics on websites such as MJRoBot.org, Hackster.io, Instructables.com, and Medium.com. Furthermore, he is a volunteer Professor at the UNIFEI in Brazil and a lecturer at several Congresses and Universities on IoT and TinyML. He is an active member and a Co-Chair of the TinyML4D group, an initiative to bring TinyML education to developing countries.

Schedule subject to change without notice.