The emergence of Tiny Machine Learning (TinyML) has positively revolutionized the field of Artificial Intelligence by promoting the joint design of resource-constrained IoT hardware devices and their learning-based software architectures. TinyML carries an essential role within the fourth and fifth industrial revolutions in helping societies, economies, and individuals employ effective AI-infused computing technologies (e.g., smart cities, automotive, and medical robotics). Given its multidisciplinary nature, the field of TinyML has been approached from many different angles: this comprehensive survey wishes to provide an up-to-date overview focused on all the learning algorithms within TinyML-based solutions. The survey is based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodological flow, allowing for a systematic and complete literature survey. In particular, firstly we will examine the three different workflows for implementing a TinyML-based system, i.e., ML-oriented, HW-oriented, and co-design. Secondly, we propose a taxonomy that covers the learning panorama under the TinyML lens, examining in detail the different families of model optimization and design, as well as the state-of-the-art learning techniques. Thirdly, this survey will present the distinct features of hardware devices and software tools that represent the current state-of-the-art for TinyML intelligent edge applications. Finally, we discuss the challenges and future directions.

翻译：微型机器学习（TinyML）的出现通过推动资源受限的物联网硬件设备及其基于学习的软件架构的协同设计，积极革新了人工智能领域。TinyML在第四次和第五次工业革命中发挥着关键作用，助力社会、经济和个人应用有效的AI赋能计算技术（如智慧城市、汽车和医疗机器人）。鉴于其多学科性质，TinyML领域已从多个不同角度被广泛探讨：本综合性综述旨在提供一份聚焦于TinyML解决方案中所有学习算法的最新概述。该综述基于系统综述和元分析首选报告项目（PRISMA）方法流程，实现系统且完整的文献调研。具体而言，首先我们将考察实现TinyML系统的三种不同工作流程，即面向机器学习、面向硬件和协同设计。其次，我们提出一种涵盖TinyML视角下学习全景的分类法，详细审视模型优化与设计的不同类别，以及当前最先进的学习技术。再次，本综述将介绍代表TinyML智能边缘应用当前最先进水平的硬件设备和软件工具的独特特征。最后，我们讨论挑战与未来方向。