Paging Through a Parquet File in DuckDB: File_row_number or Offset?
rustyconover
38 points
5 comments
July 30, 2026
Related Discussions
Found 5 related stories in 133.8ms across 10,991 title embeddings via pgvector HNSW
- DuckDB V2 PEG-based SQL parser karma_daemon · 62 pts · August 21, 2026 · 52% similar
- Why DuckDB 2.0 is faster tosh · 185 pts · October 10, 2026 · 50% similar
- Show HN: ParqDB – Vector search in the browser from Parquet over HTTP" petrizhang · 11 pts · August 21, 2026 · 50% similar
- A Preview of DuckDB v2.0 ibotty · 588 pts · August 17, 2026 · 48% similar
- Choose DuckDB rather than SQLite rubenvanwyk · 85 pts · July 29, 2026 · 47% similar
Discussion Highlights (2 comments)
matharmin
I'd assume it's common knowledge that you cannot paginate using OFFSET + LIMIT unless you use ORDER BY on an unique set of columns, no matter what database you're using. The only exception is when the database provides an explicit order guarantee without the ORDER BY, such as the case with `preserve_insertion_order = true` here.
RobinL
There's also a pseudocolumn called rowid that's worth knowing about for similar purposes but on duckdb tables: https://duckdb.org/docs/lts/sql/statements/select#:~:text=Ro...