With the advance of the powerful heterogeneous, parallel and distributed computing systems and ever increasing immense amount of data, machine learning has become an indispensable part of cutting-edge technology, scientific research and consumer products. In this study, we present a review of modern machine and deep learning. We provide a high-level overview for the latest advanced machine learning algorithms, applications, and frameworks. Our discussion encompasses parallel distributed learning, deep learning as well as federated learning. As a result, our work serves as an introductory text to the vast field of modern machine learning.

翻译：随着强大的异构、并行及分布式计算系统的发展以及海量数据的持续增长，机器学习已成为尖端技术、科学研究与消费产品中不可或缺的组成部分。本研究对现代机器学习与深度学习进行了综述。我们高层次概述了最新先进的机器学习算法、应用及框架，讨论涵盖并行分布式学习、深度学习及联邦学习。因此，本文可作为现代机器学习广阔领域的入门文献。