dinasol

dinasol

how would I create database on release task with elixir 1.9?
I found on hexdocx Deploying with Releases — Phoenix v1.8.8 how to run migration, but not database creation

before I upgraded to 1.9 I had in my release script create and migrate following this: https://ronantreacy.com/blog/deploying-phoenix-applications-using-docker-and-distillery

here is my code for creating database:

defmodule Release.Tasks do

  @start_apps [ :postgrex, :ecto ]

  @myapps [:my_app]

  @repos [MyApp.Repo]

  def createdb do

    # Ensure all apps have started
    Enum.each(@myapps, fn(x) ->
      :ok = Application.load(x)
    end)

    # Start postgrex and ecto
    Enum.each(@start_apps, fn(x) ->
      {:ok, _} = Application.ensure_all_started(x)
    end)

    # Create the database if it doesn't exist
    Enum.each(@repos, &ensure_repo_created/1)

    :init.stop()
  end
  

  defp ensure_repo_created(repo) do
    case repo.__adapter__.storage_up(repo.config) do
      :ok -> :ok
      {:error, :already_up} -> :ok
      {:error, term} -> {:error, term}
    end
  end

end

and then I ran it on the pre_start hook like this:
bin/my_app command Elixir.Release.Tasks createdb,
which worked well,

now when I am using 1.9 release, i try running with

./bin/my_app eval 'Release.Tasks.createdb()' 

which follows this error:

** (KeyError) key :database not found in: [telemetry_prefix: [:my_app, :repo], otp_app: :my_app, timeout: 15000, pool_size: 10]
    (elixir) lib/keyword.ex:393: Keyword.fetch!/2
    (ecto_sql) lib/ecto/adapters/postgres.ex:128: Ecto.Adapters.Postgres.storage_up/1
    lib/create_migrate_task.ex:57: Release.Tasks.ensure_repo_created/1
    (elixir) lib/enum.ex:783: Enum."-each/2-lists^foreach/1-0-"/2
    (elixir) lib/enum.ex:783: Enum.each/2
    lib/create_migrate_task.ex:18: Release.Tasks.createdb/0
    (stdlib) erl_eval.erl:680: :erl_eval.do_apply/6

note:
this is my config.exs: (I did not use run time configuration)

import Config

config :my_app,
       ecto_repos: [MyApp.Repo]

config :school, MyApp.Repo,
       database: "my-cool-db",
       password: "changeme",
       hostname: "123.456.8.789",
       port: "5432",
       timeout: 60_000,
       pool_size: 10,
       max_overflow: "100",
       queue_target: 60_000,
       queue_interval: 120_000

Showing Posts 1 to 3

LostKobrakai

LostKobrakai

Production database are most often manually created, because security is more important. At best your app doesn’t have credentials for a user, which is allowed to create databases.

dinasol

dinasol OP

@LostKobrakai I have a release that is deployed on various environments - dev, staging etc.. so it is necessary for me to have them created automatically on boot

here is my final code which worked well (also when having configuration in run time release.exs)

defmodule Release.Tasks do
  @moduledoc false

  @start_apps [:postgrex, :ecto, :ecto_sql]

  @myapps [:my_app]
  
  def create_and_migrate() do
    createdb()
    migrate()
  end

  def createdb do
    # Start postgrex and ecto
    IO.puts "Starting dependencies..."

    # Start apps necessary for executing migrations
    Enum.each(@start_apps, &Application.ensure_all_started/1)

    Enum.each(@myapps, &create_db_for/1)
    IO.puts "createdb task done!"

  end

  def create_db_for(app) do
    for repo <- get_repos(app) do
      :ok = ensure_repo_created(repo)
    end
  end

  defp ensure_repo_created(repo) do
    IO.puts "create #{inspect repo} database if it doesn't exist"
    case repo.__adapter__.storage_up(repo.config) do
      :ok -> :ok
      {:error, :already_up} -> :ok
      {:error, term} -> {:error, term}
    end
  end


  def migrate() do
    IO.puts "Start running migrations.."
    Enum.each(@myapps, &run_migrations_for/1)
    IO.puts "migrate task done!"
  end

  def run_migrations_for(app) do
    IO.puts "Running migrations for '#{app}'"
    for repo <- get_repos(app) do
      {:ok, _, _} = Ecto.Migrator.with_repo(repo, &Ecto.Migrator.run(&1, :up, all: true))
    end
    IO.puts "Finished running migrations for '#{app}'"
  end

  defp get_repos(app) do
    Application.load(app)
    Application.fetch_env!(app, :ecto_repos)
  end

  def rollback(repo, version) do
    {:ok, _, _} = Ecto.Migrator.with_repo(repo, &Ecto.Migrator.run(&1, :down, to: version))
  end

end
11
Post #2
geofflangenderfer

geofflangenderfer

this is a hole in the existing docs. It skips over creating prod databases.

How are you calling create_and_migrate() on your remote server?

Like this? ./bin/my_app eval ‘Release.Tasks.create_and_migrate()’

— All posts loaded —

Where Next? Top

Trending in Questions Top

stjefim
Hello! Suppose you are building workflow (order / task / payment) processing system with the following requirements: Each workflow con...
New
Blokh
Hey guys, I’ve got a huge CSV ( around 10 GB ) that needs to be processed hourly Do you guys have any suggestions what is the best prac...
New
roeland
Kia ora, We have been using elixir-google-api to connect to Google Drive. However, with the updates to Tesla due to CVEs this is now bro...
New
kszambelanczyk
Hello! Could someone please give me a help/sample code, how to delete a file from s3 using waffle/waffle_ecto from Phoenix app. I creat...
New
Onor.io
I have what I’ve heard referred to as a “lookup table” in my database. This is a way of assigning codes to common values. One common lo...
New
jaybe78
Hello, I’m developing a online persistent chat system (what’s app) like using elixir/dynamodb/aws for a mobile app(flutter). The diffic...
New
Trolleger
What approach to take when sending live updates to “random” users Hi! I have a question, I have a little chat app, and when I create a DM...
New

Other Trending Topics Top

garrison
Hobbes is a low-level distributed database for the Elixir programming language. Hobbes provides a simple, safe, and scalable storage lay...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
mcass19
ExRatatui lets you cook up rich terminal UIs in Elixir, powered by Rust’s ratatui via Rustler NIFs. Build interactive terminal applicatio...
New
Damirados
Hello everyone. After busy few months I am happy to announce v0.1.0 of Emerge &amp; Solve. They are GUI (Emerge) and State management (S...
New
netoum
Corex is an accessible, unstyled UI component library for Phoenix that integrates Zag.js state machines using Vanilla JavaScript and Live...
New
wintermeyer
There are three potential reasons for members of this forum to have a look at https://vutuv.de You are tired or annoyed of LinkedIn. Yo...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews