I’ve got a potential project that I think Broadway is well matched for, but I wanted to ask here for a sanity check
The basic workflow is:
- Periodically fetch data from a JSON HTTP API
- Store / cache the data
- Convert data / munge data into another format
- Provide data over XML HTTP API
To begin with there will only be one endpoint, but in the future there will be many different sources. Each may have different schedules for fetching data.
If I was doing this in Ruby (my background) I would probably use some sort of background job to fetch and convert the data, and then serve the data via Rails.
One reason Broadway is attractive to me is because it has features like rate limiting, which I can see being useful as this scales.
Would you use Broadway for this?