Deep models are dominating the artificial intelligence (AI) industry since the ImageNet challenge in 2012. The size of deep models is increasing ever since, which brings new challenges to this field with applications in cell phones, personal computers, autonomous cars, and wireless base stations. Here we list a set of problems, ranging from training, inference, generalization bound, and optimization with some formalism to communicate these challenges with mathematicians, statisticians, and theoretical computer scientists. This is a subjective view of the research questions in deep learning that benefits the tech industry in long run.

翻译：自2012年ImageNet挑战赛以来，深度模型一直主导着人工智能行业。此后，深度模型的规模持续增长，这给其在手机、个人电脑、自动驾驶汽车及无线基站等领域的应用带来了新的挑战。本文列举了一系列问题，涵盖训练、推理、泛化界以及优化等方面，并通过形式化表述与数学家、统计学家和理论计算机科学家交流这些挑战。本文是对深度学习研究问题的一种主观视角，旨在长期推进技术产业发展。