tinyML Talks: Physics-Aware Auto Tiny Machine Learning

Tiny machine learning has enabled resource-constrained end devices to make intelligent inferences for time-critical and remote applications from unstructured data. However, realizing edge artificial intelligence systems that can perform long-term high-level reasoning and obey the underlying physics within the tight platform resource budget is challenging. The talk introduces the concept of neurosymbolic auto tiny machine learning, where the synergy of physics-based process models and neural operators is automatically co-optimized based on platform resource constraints. Neurosymbolic artificial intelligence combines the context awareness and integrity of symbolic techniques with the robustness and performance of machine learning models. The talk showcases how fast, gradient-free and black-box Bayesian optimization can automatically construct the most performant learning-enabled, physics, and context-aware intelligent programs from a search space containing neural and symbolic operators. Several previously unseen applications are showcased, including onboard physics-aware neural-inertial navigation, on-device human activity recognition, on-chip fall detection, neural-Kalman filtering, and co-optimization of neural and symbolic processes.


March 5, 2024



Contact us



Timezone: PST

Physics-Aware Auto Tiny Machine Learning

Swapnil Sayan SAHA, Algorithm Development Engineer

STMicroelectronics Inc.

Swapnil Sayan SAHA, Algorithm Development Engineer

STMicroelectronics Inc.

Swapnil Sayan Saha is an algorithm development engineer at STMicroelectronics Inc. He received his Ph.D. and M.S. in Electrical and Computer Engineering from the University of California, Los Angeles in 2023 and 2021 respectively, and B.Sc. in Electrical and Electronics Engineering from the University of Dhaka in 2019. His research explores how rich, robust, and complex inferences can be made from sensors onboard low-end embedded systems within tight resource budgets in a platform-aware fashion. To date, he has published more than 25 peer-reviewed articles/patents and received more than 30 awards in robotics, technical, and business-case forums worldwide.

Schedule subject to change without notice.