Paul Boniol

Logo

Researcher at Inria

IASD Master: Data acquisition, extraction, and storage

The objective of this course is to present the principles of the knowledge discovery and data mining pipeline, covering acquisition, storage, and extraction. From storing data to searching for similarities, the course will include a mix of lectures and practical sessions.

Lectures

Each lecture has two 1.5 h parts (with a 15 min break in between), starts at 9 am and ends at 12:15 pm. For each lecture (except for lab days), I provide a Q&A session to serve as a recap and a technical dive into what we discussed during the corresponding lecture. Click on a lecture title to see its abstract and key topics.
SlidesExercise notebook (Colab)Q&A sessionNot available yet
Session
Title
Slides
Exercises
Q&A
Sep. 18Lecture 1
Introduction: data acquisition and searching the web
PDF
Ex1 Notebook Ex2 Notebook
Q&A

An overview of the knowledge discovery pipeline, from data acquisition to storage and extraction, and of the course organization. We then discuss data acquisition from a Web perspective: what information retrieval for web data is, and how search engines crawl, index, and rank data.

  • KDD pipeline
  • Web crawling
  • Semantic similarity (TF-IDF)
  • PageRank
Sep. 25Lecture 2
Data storage: from hardware to databases
PDF
Ex1 Notebook
Q&A

How data is physically stored and accessed: the memory hierarchy, disks and SSDs, files, pages and buffers. We see why access patterns matter for performance, and how these constraints shape the design of storage structures and database management systems.

  • Memory hierarchy
  • HDD vs SSD
  • Pages & blocks
  • File organisation
Oct. 02Lecture 3
Foundations of relational and non-relational databases
PDF
—
Q&A

The relational model and SQL, and the limits of relational systems at scale. We then introduce the NoSQL family (key-value, column, document and graph stores) and the trade-offs between consistency, availability and partition tolerance.

  • Relational model
  • SQL
  • ACID
  • Distribution & replication
  • CAP theorem
  • NoSQL families
Oct. 16Lecture 4
Handling complex data: document and graph databases
PDF

Semi-structured and connected data: document databases built on JSON-like documents, and graph databases for highly connected data, with their data models and query languages. The second part of the session is the first practice session (Lab 1).

  • Semi-structured data
  • JSON documents
  • MongoDB & aggregation
  • Property graphs
  • Graph databases
Oct. 23Lecture 5
Data extraction: foundations of similarity search
PDF
—
Q&A

Introduction to data extraction and Similarity search. We start with the basic search mechanisms in databases and distributed systems. We then take a deep dive into ordered indexes and B-trees, and hash indexes, such as extensible hashing and consistent hashing for distributed systems.

  • Indexing
  • B+-trees
  • Extensible Hashing
  • Consistent Hashing
Oct. 30Lecture 6
Multi-dimensional similarity search
PDF

Similarity search as a core extraction task: given a query, find the most similar objects in a collection. We define distance measures (Euclidean, elastic distances such as DTW), dimensionality reduction (PAA, APCA, SAX), and the lower-bounding principle that enables exact search without scanning everything. The second part of the session is the second practice session (Lab 2).

  • Nearest-neighbour queries
  • Euclidean distance
  • Dynamic Time Warping
  • PAA / APCA
  • Lower bounds
Nov. 06Lecture 7
Indexing for Similarity Search
PDF
Ex1 Notebook Ex2 Notebook
Not available yet

Indexing data in many dimensions: space-partitioning and data-partitioning trees, bounding regions and best-first nearest-neighbor search, and why these structures degrade as dimensionality grows. We then cover time-series indexing techniques that combine space partitioning with lower bounds for exact search.

  • k-d trees
  • R-trees & MBRs
  • MINDIST
  • Best-first search
  • Curse of dimensionality
  • Time series indexes
Nov. 20Lecture 8
Approximate Similarity Search and toward complex queries
Not available yet
—
Not available yet

When exact answers are too expensive, approximate methods trade a little accuracy for large speed-ups. The second part of the lecture is a wrap-up of the course and an opening towards other extraction tasks built on top of similarity search, such as motif and anomaly discovery.

  • Exact vs approximate k-NN
  • Graph-based search (HNSW)
  • Motifs, Segments & anomalies
  • Course recap

Final Exam 50% of the final grade

This exam lasts 2.5 h. The only documents allowed are 6 handwritten A4 sheets (both sides). Communicating devices are strictly forbidden. When writing code, imprecision in language syntax will be tolerated. The exam is graded out of 20 points. The questions will cover Lectures 1 (Sep. 18) to 8 Part 1 (Nov. 20). There is only one bonus question on Lecture 8 Part 2 (Nov. 06).

SessionTypePDF
Dec. 01Written exam (2.5 h)Not available yet

Practice Sessions 50% of the final grade

This course has two practice sessions covering both database systems (Lab 1) and similarity-based algorithms (Lab 2). Each practice session is divided into Part 1, tackled in class, and Part 2, to do as homework. The notebook, with code, results, and explanation, should be filled out (for both Part 1 and Part 2) and sent to me by email in both PDF and IPYNB formats (at paul [dot] boniol [at] inria [dot] fr) before the corresponding deadline (at 5 pm CEST (Central European Summer Time)). Each practice session is graded out of 20 points.

SessionTitleTopicNotebookDataDeadline
Oct. 16Lab 1 · Database of documents PDF Notebook Data Nov. 05
Oct. 30Lab 2 · Similarity search PDF Notebook Data Nov. 19

External Resources

This course is highly inspired by previous courses of other professors and researchers listed below:

Author(s)TitleLink
Pierre SenellartData acquisition, extraction, and storage (2025–2026)Link
Philippe RigauxBDpediaLink
Themis PalpanasTime Series ManagementLink
R. Behmo, N. TraversOpenClassrooms NoSQL courseLink
Maude ManouvrierSQL, NoSQL, NewSQLLink
A. Silberschatz, H. F. Korth, S. SudarshanDatabase System ConceptsLink