These are the lecture notes for the course CM0622 - Algorithms for Massive Data, Ca' Foscari University of Venice. The goal of this course is to introduce algorithmic techniques for dealing with massive data: data so large that it does not fit in the computer's memory. Broadly speaking, there are two main solutions to deal with massive data: (lossless) compressed data structures and (lossy) data sketches. These notes cover the latter topic: probabilistic filters, sketching under various metrics, Locality Sensitive Hashing, nearest neighbour search, algorithms on streams (pattern matching, counting).
翻译:本文为威尼斯大学CM0622课程《大数据算法》的课堂讲义。该课程旨在介绍处理海量数据的算法技术:当数据规模超出计算机内存容量时的解决方案。广义而言,处理海量数据主要有两类解决方案:(无损)压缩数据结构与(有损)数据草图。本讲义涵盖后一主题:概率过滤器、基于多种度量的草图算法、局部敏感哈希、最近邻搜索、流式算法(模式匹配、计数)。