What is the best approach for fetching large amount of records from postgresql with ecto

[josevalim]

@michalmuskala

You need to remember that LIMIT + OFFSET pagination is prone to race conditions

LIMIT + OFFSET is also linear. When getting the last 100 in the 1 million, you will go through the first 99900. Using an ID or a stream with a timeout of :infinity would be preferred I would say.