Thanks @benwilson512 and @dom!
It looks like that is indeed the problem: running the pipelines while looking at the load charts in Obeserver, I can see that the processes memory steadily inches upwards…
As I’m doing string manipulation within the pipeline (essentially parsing text and returning lists of text fragments), it looks like I need to learn more about binary management and garbage collection (e.g. Memory leaking with long running processes). So if you’ve got any pointers there (or generally debugging and figuring out what is taking up memory), I’m all ears!
Thanks again for pointing me in the right direction, it probably would have taken me a while to figure out the OS was killing the IEx session…
