zhangzhen
I am going to use genstage and flow to build a bioinformatics pipeline for the analysis of tumor samples. The pipeline takes millions of reads of several samples and needs to launch external programs built in separate docker images to process such reads. bwa is one of the most important programs, which aligns the reads to the reference genome. It is very computation intensive and needs to be executed with multiple threads. Could someone please tell me how to achieve this?
Cheers,
Zhen Zhang
Where Next?
Trending in Questions
Other Trending Topics
Latest on Elixir Forum
Sponsor Spotlight
Elixir, Erlang & messaging conferences from Code Sync. Next up: ElixirConf US (10–11 Sep) & Code BEAM Europe (21–22 Oct), Haarlem + online.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #library
- #deployment
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #elixirconf
- #channels
- #exunit
- #discussion
- #code-sync
- #podcasts
- #javascript
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #ai
- #elixirconf-us
- #blog-post
- #elixir-ls
- #phoenix_html
- #iex
- #graphql
- #genstage
- #websockets
- #supervisor
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #elixirconf-eu
- #metaprogramming
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Elixir, Erlang & BEAM conferences from Code Sync - join us in 2026!
Practical resources that improve the lives of professional developers.
Master modern tools, write cleaner code, and tackle real-world challenges.
Bringing learning, work and compliance together since 1987.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"
Showing Posts 1 to 1- Show Best Posts
- Show All (oldest first)
- Show All (newest first)
NobbZ
This depends on multiple things…
If your app is in docker and your other application is deamon like, just let them both manage via docker compose and send data between them, you’ll probably need to implement the protocol yourself.
If your app does not run in docker and the other app is in docker and uses single jobs, just start them via
System.cmd/3as you would start it from the command line.If your app does run in docker and the other application does do a per job run, you can either use docker in docker to start the other app in a container in the container (not a good idea) or use external provisioning services to manage that stuff.