Can't compile elixir_full when using Mix

[jannikbecher]

Unfortunately I can't compile the project from Elixir with Mix. It has something to do with elixir_full.

[gorenje]

Hard for me to debug since I use rebar to compile the project.

Could you create a sample dockerfile perhaps? Something that replicates the compilation steps you have? That way it's also a clean environment and we're on the same page.

[jannikbecher]

FROM elixir:1.18-alpine

RUN apk add --no-cache \
    git \
    build-base \
    && mix local.hex --force \
    && mix local.rebar --force

WORKDIR /app

RUN mix archive.install hex igniter_new --force

RUN mix igniter.new test_app --install erlang_red@github:gorenje/erlang-red

CMD ["mix", "run", "--no-halt"]

[jannikbecher]

This is the version right before adding exerl to the repo.

FROM elixir:1.18-alpine

RUN apk add --no-cache \
    git \
    build-base \
    && mix local.hex --force \
    && mix local.rebar --force

WORKDIR /app

RUN mix archive.install hex igniter_new --force

RUN mix igniter.new test_app --install erlang_red@github:gorenje/erlang-red@b368623637da15c5151c0b8c673204d0b04aeded

CMD ["mix", "run", "--no-halt"]

[gorenje]

I could reproduce the error:

* Getting elixir_full (1.18)
fatal: '1.18' does not appear to be a git repository
fatal: Could not read from remote repository.

interesting ... let me have a look

[gorenje]

RUN mix igniter.new test_app --install erlang_red@github:gorenje/erlang-red@b368623637da15c5151c0b8c673204d0b04aeded

that's the version just before I moved to using the exerl plugin to compile elixir helpers, i.e. the version where there was no separate library for Elixir code.

[gorenje]

Ok, it is definitely the {elixir_full, {ex, "1.18"}} line that is causing the issues :(

I suspect that ex is a resource specification from exerl --> @filmor is that correct?

More details:

Over on the elixir_build_with_exerl branch, I created a dockerfile that compiles erlang_red:

prompt> make elixir-build
docker build -f Dockerfile.elixir -t er-elixir .
Sending build context to Docker daemon  85.67MB
Step 1/7 : FROM elixir:1.18-alpine
---> d395e02c2613
Step 2/7 : RUN apk add --no-cache     git     build-base     && mix local.hex --force     && mix local.rebar --force
---> Using cache
---> 41b59cdc71a0
Step 3/7 : WORKDIR /app
---> Using cache
---> e700fc63a6ad
Step 4/7 : RUN mix archive.install hex igniter_new --force
---> Using cache
---> 77fa4f04fdb3
Step 5/7 : ENV SHELL=/bin/sh
---> Using cache
---> 81483d4688ee
Step 6/7 : COPY . erlang_red
---> dcd34d15758f
Step 7/7 : RUN mix igniter.new test_app --install erlang_red@path:../erlang_red
---> Running in f68cb76747f5
* creating README.md
* creating .formatter.exs
* creating .gitignore
* creating mix.exs
* creating lib
* creating lib/test_app.ex
* creating test
* creating test/test_helper.exs
* creating test/test_app_test.exs

Your Mix project was created successfully.
You can use "mix" to compile it, test it, and more:

  cd test_app
  mix test

Run "mix help" for more commands.
Fetching and compiling dependencies ✔
Updating project's igniter dependency ✔
installing igniter ✔
temporarily adding igniter ✔
compiling igniter ✔
setting up igniter ✔
compiling erlang_red ✔

Successfully installed:

* erlang_red
Removing intermediate container f68cb76747f5
---> 16ffae7efc57
Successfully built 16ffae7efc57
Successfully tagged er-elixir:latest

But then:

prompt> make elixir-run
...
docker run -it -t er-elixir sh
/app # cd test_app
/app/test_app # mix run
./build.sh 'v2.3.8'
errexit         on
noglob          off
ignoreeof       off
monitor         off
noexec          off
xtrace          off
verbose         off
noclobber       off
allexport       off
notify          off
nounset         on
errtrace        off
vi              off
pipefail        off
env: can't execute 'bash': No such file or directory
make: *** [Makefile:14: build-nif] Error 127
===> Hook for compile failed!

** (Mix) Could not compile dependency :quicer, "/root/.mix/elixir/1-18/rebar3 bare compile --paths /app/test_app/_build/dev/lib/*/ebin" command failed. Errors may have been logged above. You can recompile this dependency with "mix deps.compile quicer --force", update it with "mix deps.update quicer" or clean it with "mix deps.clean quicer"
/app/test_app #

I stopped there since bash missing is an image thing but unfortunately, I removed the elixir_full dependency that will break all other erlang builds, so this really isn't an option.

[filmor]

I will have a look tomorrow. Elixir (being Elixir) could simply ignore this dependency, but it is indeed a resource spec from the exerl plugin.

[gorenje]

So I removed the line, confirmed all the Erlang docker image compiled so it seems that Elixir is included via the elixir helpers package.

The Dockerfile.elixir however still does not work, this time with an error that a directory is empty:

/app/test_app # mix run
===> Compilation failed: there is no code in this directory (/app/test_app/_build/dev/lib/erlang_red_helpers), it is unreadable or for some other reason is not a recognizable application structure.
** (Mix) Could not compile dependency :erlang_red_helpers, "/root/.mix/elixir/1-18/rebar3 bare compile --paths /app/test_app/_build/dev/lib/*/ebin" command failed. Errors may have been logged above. You can recompile this dependency with "mix deps.compile erlang_red_helpers --force", update it with "mix deps.update erlang_red_helpers" or clean it with "mix deps.clean erlang_red_helpers"

@filmor thanks for the quick response, seems to be fixed by removing the line 👍

[jannikbecher]

Thank you guys, it's working now :)

[gorenje]

@jannikbecher would you have a working docker image for that? Would really like to include one in the project. The one I created is still failing with a missing directory error ...

[jannikbecher]

I tried a few things but couldn't get a working example with this Dockerfile:

FROM elixir:1.18-alpine

RUN apk update && apk add --no-cache \
      alpine-sdk \
      bash \
      curl \
      cmake \
      perl \
      linux-headers \
      rebar3 \
      git \
      build-base \
    && mix local.hex --force \
    && mix local.rebar --force

WORKDIR /app

RUN mix archive.install hex igniter_new --force

RUN mix igniter.new test_app --install erlang_red@github:gorenje/erlang-red

WORKDIR /app/test_app

CMD ["mix", "run", "--no-halt"]

I always get this error:
===> Compilation failed: there is no code in this directory (/app/test_app/_build/dev/lib/erlang_red_helpers), it is unreadable or for some other reason is not a recognizable application structure. ** (Mix) Could not compile dependency :erlang_red_helpers, "/root/.mix/elixir/1-18-otp-27/rebar3 bare compile --paths /app/test_app/_build/dev/lib/*/ebin" command failed. Errors may have been logged above. You can recompile this dependency with "mix deps.compile erlang_red_helpers --force", update it with "mix deps.update erlang_red_helpers" or clean it with "mix deps.clean erlang_red_helpers"

So I looked into my working example and unfortunately after cleaning the dependencies it is not working anymore. So I think the erlang_red_helpers were cached from a previous version.
So probably still an issue with the elixir_full dependency..

[gorenje]

So probably still an issue with the elixir_full dependency..

I don't know, erlang_red_helpers is - as far as I can see - a perfectly "normal" Erlang library, why mix should just install a single file in its directory is beyond me.

This is the contents of the directory:

/app/test_app # ls -la /app/test_app/_build/dev/lib/erlang_red_helpers
total 16
drwxr-xr-x    2 root     root          4096 May 22 18:51 .
drwxr-xr-x    1 root     root          4096 May 22 18:51 ..
-rw-r--r--    1 root     root            91 May 22 18:51 mix.rebar.config
/app/test_app # cat /app/test_app/_build/dev/lib/erlang_red_helpers/mix.rebar.config
{erl_opts,[debug_info]}.
{deps,[{earmark,"1.4.47"},{nimble_csv,"1.2.0"}]}.
{overrides,[]}.
/app/test_app #

I'm no mix nor rebar expert so I have absolutely no idea what is happening there :(

Crazy.