{:error, :econnrefused} with ExAws.S3 and local Minio

dorgan

Hi,

I’m setting up a dev environment for my current project using docker-compose. Everything works fine.

I added an S3 service using minio/minio image so I don’t hit the production S3 server while testing stuff. It seems to work too, as I can see the dashboard and upload files through it.

But I’m failing to make it work with ExAws. Whenever I try to upload a file like:

file_path
  |> ExAws.S3.Upload.stream_file()
  |> ExAws.S3.upload(bucket(), path, opts)
  |> ExAws.request()

It fails with {:error, :econnrefused}

ExAws is configured as:

config :ex_aws,
  debug_requests: true,
  region: "local"

config :ex_aws, :s3, %{
  access_key_id: "minioadmin",
  secret_access_key: "minioadmin",
  scheme: "http://",
  host: "localhost",
  port: 5000,
  region: "local",
  bucket: "uploads"
}

And it logs:

app_1     | [debug] Request URL: "http://localhost:5000/uploads/uploads/media/8de8a3a0-37d8-4da5-9a5b-c371223be9ff.gif?uploads=1"
app_1     | [debug] Request HEADERS: [{"Authorization", "AWS4-HMAC-SHA256 Credential=minioadmin/20200920/local/s3/aws4_request,SignedHeaders=content-length;content-type;host;x-amz-acl;x-amz-content-sha256;x-amz-date,Signature=93d180c17e16ca812fc0200e038ce9e4a13ec43fc8d995072a4ee28557b615fd"}, {"host", "localhost:5000"}, {"x-amz-date", "20200920T171910Z"}, {"content-length", 0}, {"content-type", "image/gif"}, {"x-amz-acl", "public-read"}, {"x-amz-content-sha256", "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"}]
app_1     | [debug] Request BODY: ""
app_1     | [warn] ExAws: HTTP ERROR: :econnrefused

IO.inspecting the request:

app_1     | %ExAws.S3.Upload{
app_1     |   bucket: "uploads",
app_1     |   opts: [acl: :public_read, content_type: "image/gif"],
app_1     |   path: "uploads/media/8de8a3a0-37d8-4da5-9a5b-c371223be9ff.gif",
app_1     |   service: :s3,
app_1     |   src: %File.Stream{
app_1     |     line_or_bytes: 5242880,
app_1     |     modes: [:raw, :read_ahead, :binary],
app_1     |     path: "/tmp/plug-1600/multipart-1600622348-348284052294283-2.gif",
app_1     |     raw: true
app_1     |   },
app_1     |   upload_id: nil
app_1     | }

and the docker-compose.yml service:

  s3:
    image: minio/minio
    ports:
      - "5000:9000"
    volumes:
      - "s3:/data"
    environment:
      MINIO_ACCESS_KEY: "minioadmin"
      MINIO_SECRET_KEY: "minioadmin"
    command: server /data

With the same code, it is running fine in production with DigitalOcean Spaces(no docker though), so I believe it has todo with the way things are configured here, but what can it be?

6 comments

#exaws #ex_aws_s3 #minio

0 3165 6

2022-01-20 14:35:06 UTC

Showing Posts 1 to 6

Show Best Posts
Show All (oldest first)
Show All (newest first)

dorgan

The issue was that I was configuring ExAws to use the port exposed by docker, but I needed to use the port in the docker network, which is 9000, not 5000, also the host should be the same name as the service, that is s3, not localhost

Post #1

pdgonzalez872

Good work! Thanks for sharing the solution!

Post #2

akashv

I use the same setup except I use waffle and waffle_ecto to handle the uploads. It is quite easier to setup and use.

Post #3

ambareesha7

Hi @akashv can you please share the config/setup details
i’m trying to setup waffle and minIO in my project but i could not get good resources to setup

thank you

Post #4

akashv

I haven’t been online for a while.

I found below dev configs in my code, not updated for latest versions

# waffle config
config :waffle,
  storage: Waffle.Storage.S3,
  bucket: "bucketname",
  asset_host: "https://dev.sitename.org/assets/" 
# asset host is for waffle url generation only

# ex_aws config
config :ex_aws,
  json_codec: Jason,
  access_key_id: "minio",
  secret_access_key: "minio123",
  s3: [
    scheme: "http://",
    host: "localhost",
    port: "9000"
  ]

Minio docker config-

minio:
    image: minio/minio
    restart: always
    volumes:
      - ./data/s3-minio:/data
    ports:
      - "0.0.0.0:9000:9000"
    environment:
      MINIO_ACCESS_KEY: minio
      MINIO_SECRET_KEY: minio123
    command: "server /data"
    healthcheck:
      test: ["CMD", "curl", "-f", "http://localhost:9000/minio/health/live"]
      interval: 30s
      timeout: 20s
      retries: 3

Post #5