mashton
Unexpected :ssh_sftp :timeout after SIGINT
I’m trying to understand an unexpected :timeout during :ssh_sftp.start_channel/3. This is the flow of events:
- A Broadway pipeline is running, using a BroadwayKafka producer
- The application receives SIGINT and starts to shutdown
- Broadway batchers execute
Broadway.handle_batch/4, kicking off a series of synchronous events - The last of which is writing a file to a remote SFTP server
The precise timing:
- SIGINT received: 15:39:26.382
- First SFTP connection attempted: 15:39:27.618
- First SFTP connection timeout: 15:39:32.620
- The last Kafka consumer leaves the group and the app exits with
0: 15:39:52.711
So the connection “times out” before the app fully shuts down.
I have two threads I’m not sure how to pull on any further:
- The fact that the timeouts occur about exactly 5s after the attempt makes me think there’s some other underlying timeout. But why would we only hit this timeout on SIGINT?
- Maybe
:timeoutis a misleading error here and there’s something else going on entirely
Anybody have any ideas? I’m hoping there’s a magic “Ah you forgot about !” solution here.
First Post!
D4no0
There are some more timeouts involved in the ssh client, like for example send_timeout for gen_tcp that is used by ssh client.
Have you tried running ssh with debug messages logging to console? ssh — OTP 29.0.2 (ssh 6.0.1)
Last Post!
mashton
Sorry, I should have included this in the first place. Here’s the stack trace for the timeout:
[
{:gen_server, :call, 2, [file: ~c"gen_server.erl", line: 370]},
{:ssh_transport, :default_algorithms, 0, [file: ~c"ssh_transport.erl", line: 96]},
{:ssh_options, :default, 1, [file: ~c"ssh_options.erl", line: 727]},
{:ssh_options, :default, 1, [file: ~c"ssh_options.erl", line: 602]},
{:ssh_options, :handle_options, 3, [file: ~c"ssh_options.erl", line: 184]},
{:ssh, :connect, 4, [file: ~c"ssh.erl", line: 187]},
{:ssh_sftp, :start_channel, 3, [file: ~c"ssh_sftp.erl", line: 200]},
{MyApp.SftpClient, :start, 1, [file: ~c"lib/sftp_client.ex", line: 59]}
]
and the beginning of the error:
{:timeout, {:gen_server, :call, [:application_controller, {:set_env, :ssh, :"$def-algs$", ... (a long list of encryption algs, presumably configuration)...
Popular in Questions
Other popular topics
Latest on Elixir Forum
Sponsor Spotlight
Catch errors, track performance, monitor hosts and more.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #elixirconf-us
- #advent-of-code
- #distillery
- #processes
- #api
- #forms
- #metaprogramming
- #security
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking, logs, uptime, and Just Enough APM. Built for developers.
Practical resources that improve the lives of professional developers.
Develop your skills with books, videos, and courses.
The deployment platform built for Elixir: PaaS ease, VPS control.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"