Pulling dependencies from protected repositories

[javatechno]

I am running Jbang in Docker container (atlering Karavan devmode). I want to download a custom version of CamelJbang to test it. It is located in a private repository, which can be accessed using username/password auth.
This is the Dockerfile.

FROM maven:3.9.6-eclipse-temurin-17
LABEL "org.opencontainers.image.title"="karavan-devmode"
LABEL "org.opencontainers.image.description"="Apache Camel Karavan DevMode"
#LABEL "org.opencontainers.image.url"="https://camel.apache.org"
#LABEL "org.opencontainers.image.licenses"="Apache 2.0"
#LABEL "org.opencontainers.image.version"="4.4.1"

RUN apt-get update && apt-get install git && apt-get clean

ENV JBANG_VERSION=0.115.0
ENV CAMEL_VERSION=4.6.1
ENV KARAVAN="/karavan"
ENV JBANG_DIR="$KARAVAN/.jbang"
ENV MAVEN_CONFIG="~/.m2"
ENV JBANG_REPO=$MAVEN_CONFIG
ENV BUILDER_PATH="$KARAVAN/builder"
ENV CODE_DIR="$KARAVAN/code"
ENV KAMELETS_DIR="$CODE_DIR/kamelets"
ENV PATH="$PATH:$KARAVAN/.jbang/bin"

RUN mkdir -p $JBANG_REPO \
    && mkdir -p $CODE_DIR \
    && mkdir -p $BUILDER_PATH \
    && mkdir -p $MAVEN_CONFIG

RUN useradd -rm -d /karavan -s /bin/bash -g root -G sudo -u 1001 karavan
COPY "./.m21/settings.xml" "/karavan/.m2/"
COPY "./.m21/settings.xml" "~/.m2/"
COPY "./.m21/settings.xml" "root/.m2/"
RUN cat /karavan/.m2/settings.xml
RUN cat root/.m2/settings.xml
RUN cat ~/.m2/settings.xml
RUN chown -R karavan $MAVEN_CONFIG

RUN chgrp -R 0 $KARAVAN && chmod -R g+rwX $KARAVAN

#Maven config путь
USER karavan
EXPOSE 8080
WORKDIR $CODE_DIR

#RUN mvn dependency:get -DremoteRepositories=https://repo.croc.ru:443/artifactory/RocInt/ -Dartifact=ru.rocint.ri.karavan:keycloak-custom-provider:1.0-SNAPSHOT
#RUN mvn help:evaluate -Dexpression=settings.localRepository -q -DforceStdout

RUN curl -Ls https://sh.jbang.dev | bash -s - app setup \
    && jbang trust add  --verbose  https://github.com/javatechno/camel \
        && jbang app install  --verbose https://github.com/javatechno/camel/blob/main/dsl/camel-jbang/camel-jbang-main/dist/CamelJBang.java \
        && jbang config set cache-evict never \
        && jbang config list --verbose \

EXPOSE 8080
WORKDIR $CODE_DIR
CMD jbang $JBANG_OPTIONS -Dcamel.jbang.version=$CAMEL_VERSION camel@apache/camel run --source-dir=$CODE_DIR --console

I am trying to copy settings.xml from local machine to different folders of Docker container for JBang to use it, but it does not seem to. The proof is: commented mvn commands do work and successfully download needed dependencies, but JBang fails to do so.

Here is my settings.xml, which I am passing to Docker:

<settings xmlns="http://maven.apache.org/SETTINGS/1.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
          xsi:schemaLocation="http://maven.apache.org/SETTINGS/1.0.0
                      http://maven.apache.org/xsd/settings-1.0.0.xsd"
>

    <servers>
        <server>
            <id>gitlab-maven</id>
            <username>{name}</username>
            <password>{pwd}</password>
            <configuration>
            </configuration>
        </server>
        <server>
            <id>ri-karavan</id>
            <username>{name}</username>
            <password>{pwd}</password>
        </server>
        <server>
            <id>ri-karavan-plugin</id>
            <username>{name}</username>
            <password>{pwd}</password>
        </server>
    </servers>

    <activeProfiles>
        <activeProfile>ri-karavan</activeProfile>
    </activeProfiles>


    <profiles>
        <profile>
            <id>ri-karavan</id>
            <repositories>
                <repository>
                    <id>ri-karavan</id>
                    <url>https://repo.croc.ru:443/artifactory/RocInt/</url>
                    <releases>
                        <enabled>true</enabled>
                    </releases>
                    <snapshots>
                        <enabled>true</enabled>
                        <updatePolicy>always</updatePolicy>
                    </snapshots>
                </repository>
            </repositories>

            <pluginRepositories>
                <pluginRepository>
                    <id>ri-karavan-plugin</id>
                    <url>https://repo.croc.ru:443/artifactory/RocInt/</url>
                    <releases>
                        <enabled>true</enabled>
                    </releases>
                    <snapshots>
                        <enabled>true</enabled>
                        <updatePolicy>always</updatePolicy>
                    </snapshots>
                </pluginRepository>

            </pluginRepositories>


        </profile>
    </profiles>

</settings>

And these are headers of the file I am trying to install:

//REPOS apache=https://repository.apache.org/snapshots,krok=https://repo.croc.ru:443/artifactory/RocInt,maven=https://repo1.maven.org/maven2
//DEPS org.apache.camel:camel-bom:${camel.jbang.version:4.6.1-SNAPSHOT}@pom
//DEPS org.apache.camel:camel-jbang-core:${camel.jbang.version:4.6.1-SNAPSHOT}
//DEPS org.apache.camel.kamelets:camel-kamelets:${camel-kamelets.version:4.6.1-SNAPSHOT}

If I understood correctly, JBang must use /karavan/.m2/settings.xml file for authentication, because it is a working directory of user, created in Docker.

JBang from container produces the following error:

Downloading JBang ...
Installing JBang...
[jbang] JBang environment is already set up.
[jbang] (You can use --force to perform the setup anyway)
[jbang] [0:399] jbang version 0.116.0
[jbang] [0:402] Trusting permanently: [https://github.com/javatechno/camel]
[jbang] [0:338] jbang version 0.116.0
[jbang] [0:343] Resolving resource ref: https://github.com/javatechno/camel/blob/main/dsl/camel-jbang/camel-jbang-main/dist/CamelJBang.java
[jbang] [0:508] Requesting HTTP GET https://raw.githubusercontent.com/javatechno/camel/main/dsl/camel-jbang/camel-jbang-main/dist/CamelJBang.java
[jbang] [0:508] Headers {User-Agent=[JBang/0.116.0 (Linux/5.10.16.3-microsoft-standard-WSL2/amd64) Java/17.0.10/Eclipse Adoptium]}
[jbang] [0:959] Downloaded file https://raw.githubusercontent.com/javatechno/camel/main/dsl/camel-jbang/camel-jbang-main/dist/CamelJBang.java
[jbang] [0:961] Resolved resource ref as: https://github.com/javatechno/camel/blob/main/dsl/camel-jbang/camel-jbang-main/dist/CamelJBang.java (cached as: /karavan/.jbang/cache/urls/8ccf0bd9e176458499db35aa4eda612da28bb918fa8163263871160624e2495f/CamelJBang.java)
[jbang] [0:992] Build required as /karavan/.jbang/cache/jars/CamelJBang.java.444a26b7ebfe52664795253ae91cc94e13b128869292a40a660f681768ef5fe8/CamelJBang.jar not readable or not found.
[jbang] [0:996] Looking for JDK: 17
[jbang] [1:002] Using JDK: 17 (17.0.10+7, current, /opt/java/openjdk)
[jbang] [1:004] Resolving artifact(s): org.apache.camel:camel-bom:4.6.1-SNAPSHOT@pom, org.apache.camel:camel-jbang-core:4.6.1-SNAPSHOT, org.apache.camel.kamelets:camel-kamelets:4.6.1-SNAPSHOT
[jbang] [1:007] Repositories: apache=https://repository.apache.org/snapshots, krok=https://repo.croc.ru:443/artifactory/RocInt, maven=https://repo1.maven.org/maven2
[jbang] [1:007] Resolving dependencies...
[jbang] [1:125]    org.apache.camel:camel-bom:4.6.1-SNAPSHOT@pom
[jbang] [1:977] Deleting folder /karavan/.jbang/cache/jars/CamelJBang.java.444a26b7ebfe52664795253ae91cc94e13b128869292a40a660f681768ef5fe8/classes
[jbang] [1:980] Deleting folder /karavan/.jbang/cache/jars/CamelJBang.java.444a26b7ebfe52664795253ae91cc94e13b128869292a40a660f681768ef5fe8/generated
[jbang] [1:980] [ERROR] Could not read artifact descriptor for org.apache.camel:camel-bom:pom:4.6.1-SNAPSHOT
dev.jbang.cli.ExitException: Could not read artifact descriptor for org.apache.camel:camel-bom:pom:4.6.1-SNAPSHOT
        at dev.jbang.dependencies.ArtifactResolver.resolveDescriptor(ArtifactResolver.java:330)
        at dev.jbang.dependencies.ArtifactResolver.getManagedDependencies(ArtifactResolver.java:318)
        at dev.jbang.dependencies.ArtifactResolver.lambda$resolve$1(ArtifactResolver.java:187)
        at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:273)
        at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625)
        at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
        at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
        at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921)
        at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682)
        at dev.jbang.dependencies.ArtifactResolver.resolve(ArtifactResolver.java:188)
        at dev.jbang.dependencies.DependencyUtil.resolveDependencies(DependencyUtil.java:109)
        at dev.jbang.dependencies.DependencyResolver.resolve(DependencyResolver.java:66)
        at dev.jbang.source.BuildContext.resolveClassPath(BuildContext.java:118)
        at dev.jbang.source.buildsteps.CompileBuildStep.compile(CompileBuildStep.java:78)
        at dev.jbang.source.buildsteps.CompileBuildStep.build(CompileBuildStep.java:56)
        at dev.jbang.source.buildsteps.CompileBuildStep.build(CompileBuildStep.java:41)
        at dev.jbang.source.AppBuilder.build(AppBuilder.java:97)
        at dev.jbang.source.AppBuilder.build(AppBuilder.java:22)
        at dev.jbang.cli.AppInstall.install(App.java:151)
        at dev.jbang.cli.AppInstall.doCall(App.java:104)
        at dev.jbang.cli.BaseCommand.call(BaseCommand.java:145)
        at dev.jbang.cli.BaseCommand.call(BaseCommand.java:21)
        at picocli.CommandLine.executeUserObject(CommandLine.java:1953)
        at picocli.CommandLine.access$1300(CommandLine.java:145)
        at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2358)
        at picocli.CommandLine$RunLast.handle(CommandLine.java:2352)
        at dev.jbang.cli.JBang$3.handle(JBang.java:148)
        at dev.jbang.cli.JBang$3.handle(JBang.java:143)
        at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179)
        at picocli.CommandLine$RunLast.execute(CommandLine.java:2316)
        at picocli.CommandLine.execute(CommandLine.java:2078)
        at dev.jbang.Main.main(Main.java:14)
Caused by: org.eclipse.aether.resolution.ArtifactDescriptorException: Failed to read artifact descriptor for org.apache.camel:camel-bom:pom:4.6.1-SNAPSHOT
        at org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.loadPom(DefaultArtifactDescriptorReader.java:245)
        at org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.readArtifactDescriptor(DefaultArtifactDescriptorReader.java:175)
        at org.eclipse.aether.internal.impl.DefaultRepositorySystem.readArtifactDescriptor(DefaultRepositorySystem.java:269)
        at dev.jbang.dependencies.ArtifactResolver.resolveDescriptor(ArtifactResolver.java:328)
        ... 32 more
Caused by: org.eclipse.aether.resolution.ArtifactResolutionException: The following artifacts could not be resolved: org.apache.camel:camel-bom:pom:4.6.1-SNAPSHOT (absent): Could not transfer artifact org.apache.camel:camel-bom:pom:4.6.1-SNAPSHOT from/to krok (https://repo.croc.ru:443/artifactory/RocInt): status code: 401, reason phrase:  (401)
        at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:473)
        at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifacts(DefaultArtifactResolver.java:261)
        at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifact(DefaultArtifactResolver.java:243)
        at org.apache.maven.repository.internal.DefaultArtifactDescriptorReader.loadPom(DefaultArtifactDescriptorReader.java:234)
        ... 35 more
Caused by: org.eclipse.aether.transfer.ArtifactTransferException: Could not transfer artifact org.apache.camel:camel-bom:pom:4.6.1-SNAPSHOT from/to krok (https://repo.croc.ru:443/artifactory/RocInt): status code: 401, reason phrase:  (401)
        at org.eclipse.aether.connector.basic.ArtifactTransportListener.transferFailed(ArtifactTransportListener.java:44)
        at org.eclipse.aether.connector.basic.BasicRepositoryConnector$TaskRunner.run(BasicRepositoryConnector.java:417)
        at org.eclipse.aether.connector.basic.BasicRepositoryConnector.get(BasicRepositoryConnector.java:260)
        at org.eclipse.aether.internal.impl.DefaultArtifactResolver.performDownloads(DefaultArtifactResolver.java:537)
        at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:449)
        ... 38 more
Caused by: org.apache.http.client.HttpResponseException: status code: 401, reason phrase:  (401)
        at org.eclipse.aether.transport.http.HttpTransporter.handleStatus(HttpTransporter.java:619)
        at org.eclipse.aether.transport.http.HttpTransporter.execute(HttpTransporter.java:488)
        at org.eclipse.aether.transport.http.HttpTransporter.implGet(HttpTransporter.java:435)
        at org.eclipse.aether.spi.connector.transport.AbstractTransporter.get(AbstractTransporter.java:64)
        at org.eclipse.aether.connector.basic.BasicRepositoryConnector$GetTaskRunner.runTask(BasicRepositoryConnector.java:482)
        at org.eclipse.aether.connector.basic.BasicRepositoryConnector$TaskRunner.run(BasicRepositoryConnector.java:414)
        ... 41 more
[jbang] [1:985] If you believe this a bug in jbang, open an issue at https://github.com/jbangdev/jbang/issues
Error response from daemon: The command '/bin/sh -c curl -Ls https://sh.jbang.dev | bash -s - app setup     && jbang trust add  --verbose  https://github.com/javatechno/camel         && jbang app install  --verbose -D"settings=/karavan/.m2/settings.xml" https://github.com/javatechno/camel/blob/main/dsl/camel-jbang/camel-jbang-main/dist/CamelJBang.java         && jbang config set cache-evict never         && jbang config list --verbose EXPOSE 8080' returned a non-zero code: 1

What am I missing?

P.S. I checked the dependency location in artifactory.

[maxandersen]

Does it work locally without docker in the mix?

[javatechno]

No, same error:

Same settings.xml file

[javatechno]

jbang version - 0.116.0

[maxandersen]

I noticed the server IDs in settings.xml does not match your //REPOS IDs. Jbang (and maven) looks up server settings by Id, not by URL.

So change "krok"
To the right Id.

[javatechno]

Yes, that was definitely as issue and my mistake, thank you for your support)
Haven't found any direct mentioning about that in documentation though. Don't you mind adding it?

[maxandersen]

I dont mind adding it but I thing we can do it better if you want to make a PR for it where in the docs you as user would have noticed it ? Up.for doing that ?