Making a little app that will process and collate lists of hostnames from third-party blacklists (ads, malware, etc.), and serve the result to a few Pi-hole installations. This will remove the not-insignificant burden of processing the lists from each Pi-hole installation, which is taking ten minutes on a Raspberry Pi with the given blacklist subscriptions. It will have a simple web UI to enable selection of blacklists and creating of whitelists.
We have a combined (not de-duped) total of about 20 million black-listed hostnames, so it’s a nice opportunity to try out streaming and processing in parallel. We’re streaming chunks of hostnames from the database with Ecto to Flow. It’s the first time I’ve used Flow, and it’s wonderful to be able to use all cores so easily.