At work, we have a process that captures small snapshots of data for an analysis routine that we run hundreds of times per day. The snapshots are analyzed by data science as well. We default to storing these snapshots in s3, but usually the data shifts over to being stored in postgres as we mature how each snapshot is used. I don’t see any value in defaulting to s3. I don’t know how much more it costs to store a json object in s3 file versus in a postgres/rds row, but I can’t imagine that being a compelling reason. Has anybody else faced this choice and chosen s3? If so, why?

The only times where I find plain flat files compelling for json data are when you are sending data between organizations, which may not share access to a relational database, or if you want portable data sets which can be exported and saved individually for use offline by users.