Paging Through a Parquet File in DuckDB: File_row_number or Offset?

rustyconover 38 points 5 comments July 30, 2026
rusty.today · View on Hacker News

Discussion Highlights (2 comments)

matharmin

I'd assume it's common knowledge that you cannot paginate using OFFSET + LIMIT unless you use ORDER BY on an unique set of columns, no matter what database you're using. The only exception is when the database provides an explicit order guarantee without the ORDER BY, such as the case with `preserve_insertion_order = true` here.

RobinL

There's also a pseudocolumn called rowid that's worth knowing about for similar purposes but on duckdb tables: https://duckdb.org/docs/lts/sql/statements/select#:~:text=Ro...

Semantic search powered by Rivestack pgvector
15,510 stories · 144,699 chunks indexed