In this thought-provoking article, we discuss certain myths and legends that are folklore among members of the high-performance computing community. We gathered these myths from conversations at conferences and meetings, product advertisements, papers, and other communications such as tweets, blogs, and news articles within and beyond our community. We believe they represent the zeitgeist of the current era of massive change, driven by the end of many scaling laws such as Dennard scaling and Moore's law. While some laws end, new directions are emerging, such as algorithmic scaling or novel architecture research. Nevertheless, these myths are rarely based on scientific facts, but rather on some evidence or argumentation. In fact, we believe that this is the very reason for the existence of many myths and why they cannot be answered clearly. While it feels like there should be clear answers for each, some may remain endless philosophical debates, such as whether Beethoven was better than Mozart. We would like to see our collection of myths as a discussion of possible new directions for research and industry investment.
翻译:在这篇引人深思的文章中,我们讨论了高性能计算社群中流传的某些神话与传说。这些传说源自我们在会议交流、产品广告、学术论文,以及社群内外的推文、博客和新闻报道等沟通渠道中收集到的信息。我们认为,它们反映了当前巨变时代的时代精神——这种变革由登纳德缩放定律和摩尔定律等众多缩放定律的终结所驱动。尽管部分定律走向终结,但新方向正在涌现,例如算法缩放或新型架构研究。然而,这些传说鲜少基于科学事实,更多依赖于某些证据或论证。事实上,我们认为这正是许多神话存在的根本原因,也是它们难以被明确解答的缘由。尽管每个传说看似应有清晰答案,但某些问题可能永远停留在无休止的哲学辩论中,比如"贝多芬是否优于莫扎特"。我们愿将收集的这些神话视为对研究与产业投资新可能方向的探讨。