In this thought-provoking article, we discuss certain myths and legends that are folklore among members of the high-performance computing community. We gathered these myths from conversations at conferences and meetings, product advertisements, papers, and other communications such as tweets, blogs, and news articles within and beyond our community. We believe they represent the zeitgeist of the current era of massive change, driven by the end of many scaling laws such as Dennard scaling and Moore's law. While some laws end, new directions are emerging, such as algorithmic scaling or novel architecture research. Nevertheless, these myths are rarely based on scientific facts, but rather on some evidence or argumentation. In fact, we believe that this is the very reason for the existence of many myths and why they cannot be answered clearly. While it feels like there should be clear answers for each, some may remain endless philosophical debates, such as whether Beethoven was better than Mozart. We would like to see our collection of myths as a discussion of possible new directions for research and industry investment.
翻译:在这篇引人深思的文章中,我们讨论了高性能计算领域成员间流传的一些神话与传说。这些神话源自我们在会议、产品广告、论文以及推特、博客、新闻文章等社区内外的交流收集而来。我们认为,它们代表了当前大规模变革时代的时代精神——这一变革由登纳德缩放定律和摩尔定律等众多缩放定律的终结所驱动。尽管某些定律终结,但新方向正在涌现,例如算法缩放或新型架构研究。然而,这些神话鲜有科学依据,更多是基于某些证据或论述。事实上,我们认为这正是诸多神话存在的原因,也是它们无法被明确解答的根源。尽管每个神话看似应有明确答案,但有些可能成为永无止境的哲学辩论,例如贝多芬是否比莫扎特更出色。我们希望将这些神话的汇编视为对研究和产业投资可能新方向的探讨。