Influence Maximization (IM) is a crucial problem in data science. The goal is to find a fixed-size set of highly-influential seed vertices on a network to maximize the influence spread along the edges. While IM is NP-hard on commonly-used diffusion models, a greedy algorithm can achieve $(1-1/e)$-approximation, repeatedly selecting the vertex with the highest marginal gain in influence as the seed. Due to theoretical guarantees, rich literature focuses on improving the performance of the greedy algorithm. To estimate the marginal gain, existing work either runs Monte Carlo (MC) simulations of influence spread or pre-stores hundreds of sketches (usually per-vertex information). However, these approaches can be inefficient in time (MC simulation) or space (storing sketches), preventing the ideas from scaling to today's large-scale graphs. This paper significantly improves the scalability of IM using two key techniques. The first is a sketch-compression technique for the independent cascading model on undirected graphs. It allows combining the simulation and sketching approaches to achieve a time-space tradeoff. The second technique includes new data structures for parallel seed selection. Using our new approaches, we implemented PaC-IM: Parallel and Compressed IM. We compare PaC-IM with state-of-the-art parallel IM systems on a 96-core machine with 1.5TB memory. PaC-IM can process large-scale graphs with up to 900M vertices and 74B edges in about 2 hours. On average across all tested graphs, our uncompressed version is 5--18$\times$ faster and about 1.4$\times$ more space-efficient than existing parallel IM systems. Using compression further saves 3.8$\times$ space with only 70% overhead in time on average.
翻译:影响力最大化(Influence Maximization, IM)是数据科学中的一个关键问题。其目标是在网络中找到一个固定规模的高影响力种子顶点集,以最大化沿边传播的影响力。尽管IM在常用的扩散模型上是NP难的,但贪婪算法可以实现$(1-1/e)$-近似,即反复选择边际影响力增益最大的顶点作为种子。由于理论保证,大量文献致力于提升贪婪算法的性能。为估计边际增益,现有工作要么运行影响力传播的蒙特卡洛(Monte Carlo, MC)模拟,要么预存数百个草图(通常为每个顶点的信息)。然而,这些方法可能在时间(MC模拟)或空间(存储草图)上效率低下,导致无法扩展到当今的大规模图。本文通过两项关键技术显著提升了IM的可扩展性。第一项是针对无向图独立级联模型的草图压缩技术,它允许将模拟与草图方法结合以实现时间-空间权衡。第二项技术包括用于并行种子选择的新数据结构。利用我们的新方法,我们实现了PaC-IM:并行压缩IM。我们将PaC-IM与当前最先进的并行IM系统在具有1.5TB内存的96核机器上进行了比较。PaC-IM可在约2小时内处理包含多达9亿顶点和740亿条边的大规模图。在所有测试图上,我们的未压缩版本平均比现有并行IM系统快5-18倍,空间效率高约1.4倍。使用压缩后进一步节省了3.8倍空间,而时间开销平均仅为70%。