SVT:Cannot start application in container due pt write too long error

[rumanaHaque]

I am running TER - https://github.ibm.com/websphere/system-test/issues/906 to test the Liberty Tools using Eclipse in Windows VM.

I imported ACME ee10 application to the worskspace, and I can start and stop the application successfully using the Start and Stop commands from the Liberty Dashboard.

I have podman installed and started in my Windows VM, but when I try to run the "Start in Container" using the Liberty Dashboard, I get the following error.

[INFO] Building container image...
[INFO] podman  build --pull -f C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\target\.libertyDevc\tempContainerfile7210582164098440854 -t acmewebejbear-dev-mode C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar
[ERROR] time="2023-10-25T07:45:08-07:00" level=error msg="1 error occurred:\n\t* archive/tar: write too long\n\n\n"
[ERROR] Error: Post "http://d/v4.7.0/libpod/build?dockerfile=%5B%22target%2F.libertyDevc%2FtempContainerfile7210582164098440854%22%5D&forcerm=1&httpproxy=1&identitylabel=1&idmappingoptions=%7B%22HostUIDMapping%22%3Atrue%2C%22HostGIDMapping%22%3Atrue%2C%22UIDMap%22%3A%5B%5D%2C%22GIDMap%22%3A%5B%5D%2C%22AutoUserNs%22%3Afalse%2C%22AutoUserNsOpts%22%3A%7B%22Size%22%3A0%2C%22InitialSize%22%3A0%2C%22PasswdFile%22%3A%22%22%2C%22GroupFile%22%3A%22%22%2C%22AdditionalUIDMappings%22%3Anull%2C%22AdditionalGIDMappings%22%3Anull%7D%7D&isolation=1&jobs=1&layers=1&networkmode=0&nsoptions=%5B%7B%22Name%22%3A%22user%22%2C%22Host%22%3Atrue%2C%22Path%22%3A%22%22%7D%5D&omithistory=0&output=acmewebejbear-dev-mode&outputformat=application%2Fvnd.oci.image.manifest.v1%2Bjson&pullpolicy=always&rm=1&shmsize=67108864&t=acmewebejbear-dev-mode": io: read/write on closed pipe
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for acme-ee10 0.0.1-SNAPSHOT:
[INFO]
[INFO] acme-ee10 .......................................... SUCCESS [  1.493 s]
[INFO] AcmeCommon ......................................... SUCCESS [  1.055 s]
[INFO] AcmeAnnuityCommon .................................. SUCCESS [ 13.209 s]
[INFO] AcmeAnnuityJAXRSCommon ............................. SUCCESS [  4.739 s]
[INFO] AcmeAnnuityEJB3 .................................... SUCCESS [  1.293 s]
[INFO] AcmeAnnuityEJB3JAXWS ............................... SUCCESS [  0.297 s]
[INFO] AcmeAnnuityEJB3JAXWS_CDI ........................... SUCCESS [  0.340 s]
[INFO] AcmeAnnuityEJB3MDB ................................. SUCCESS [  0.752 s]
[INFO] AcmeAnnuityJAXRSWSes_jaxrs11_m1 .................... SUCCESS [  1.064 s]
[INFO] AcmeAnnuityJAXRSWSes_jaxrs11_m2 .................... SUCCESS [  0.213 s]
[INFO] AcmeAnnuityJAXRSWSes_jaxrs20 ....................... SUCCESS [  0.180 s]
[INFO] AcmeAnnuityPojoWSes ................................ SUCCESS [  0.293 s]
[INFO] AcmeAnnuityWeb ..................................... SUCCESS [  0.300 s]
[INFO] AcmeWebEjbEar ...................................... FAILURE [  5.778 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  31.570 s
[INFO] Finished at: 2023-10-25T07:45:08-07:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal io.openliberty.tools:liberty-maven-plugin:3.10-SNAPSHOT:devc (default-cli) on project AcmeWebEjbEar: Error starting the server in dev mode.: Could not build container image using Containerfile: C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\Dockerfile. Address the following container build error and then start dev mode again: time="2023-10-25T07:45:08-07:00" level=error msg="1 error occurred:\n\t* archive/tar: write too long\n\n\n" RC=125 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <args> -rf :AcmeWebEjbEar

[rumanaHaque]

Here's the Dockerfile that I used.

ARG BASE_IMAGE=icr.io/appcafe/open-liberty:beta

FROM $BASE_IMAGE

COPY  --chown=1001:0  ./AcmeWebEjbEar/target/AcmeWebEjbEar.ear /config/apps/
COPY  --chown=1001:0  config/server.xml /config/server.xml
COPY  --chown=1001:0  config/jvm.options /config/jvm.options
COPY  --chown=1001:0  config/ACME_Liberty_combined_docker.xml /config/ACME_Liberty_combined_docker.xml






user 1001

#DB2 files
#COPY --chown=1001:0 ./db2jars /config/db2jars

#JaxRS 3rd party lib
#RUN mkdir /opt/ibm/wlp/usr/shared/resources/thirdPartyLib
#COPY --chown=1001:0 ./thirdPartyLib/* /config/thirdPartyLib/

#truststore for LDAP
#COPY  --chown=1001:0 config/trustStore.jks /config/trustStore.jks

#Add trust file for jaxrs-secure
#RUN mkdir /opt/ibm/wlp/usr/shared/resources/security
#COPY --chown=1001:0 config/trust.jks /config/trust.jks

#create dir structure for ACME logs
#RUN mkdir /logs/ACME
#RUN mkdir /logs/ACME/client

# Setting for the verbose option
ARG VERBOSE=true
ARG FULL_IMAGE=false

# This script will add the requested XML snippets to enable Liberty features and grow image to be fit-for-purpose using featureUtility.
# Only available in 'kernel-slim'. The 'full' tag already includes all features for convenience.

#RUN if [[ -z "$FULL_IMAGE" ]] ; then echo Skip running features.sh for full image ; else  ; fi
#RUN if [ "$FULL_IMAGE" = "true" ] ; then echo "Skip running features.sh for full image" ; else features.sh ; fi
#RUN features.sh

# Add interim fixes for WL/OL (optional)
#COPY --chown=1001:0  interim-fixes /opt/ol/fixes/
#COPY --chown=1001:0  interim-fixes /opt/ibm/fixes/

# This script will add the requested XML snippets and grow image to be fit-for-purpose
RUN configure.sh

[rumanaHaque]

I get the same error when I try to run the mvn liberty:devc command from the command prompt as well.

c:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar>mvn liberty:devc
[INFO] Scanning for projects...
[INFO]
[INFO] -------------------< AcmeAnnuityMaven:AcmeWebEjbEar >-------------------
[INFO] Building AcmeWebEjbEar 0.0.1-SNAPSHOT
[INFO] --------------------------------[ ear ]---------------------------------
[WARNING] The POM for AcmeAnnuityMaven:AcmeAnnuityCommon:jar:0.0.1-SNAPSHOT is invalid, transitive dependencies (if any) will not be available, enable debug logging for more details
[WARNING] The POM for AcmeAnnuityMaven:AcmeAnnuityJAXRSWSes_jaxrs20:war:0.0.1-SNAPSHOT is invalid, transitive dependencies (if any) will not be available, enable debug logging for more details
[WARNING] The POM for AcmeAnnuityMaven:AcmeAnnuityJAXRSWSes_jaxrs11_m1:war:0.0.1-SNAPSHOT is invalid, transitive dependencies (if any) will not be available, enable debug logging for more details
[WARNING] The POM for AcmeAnnuityMaven:AcmeAnnuityJAXRSWSes_jaxrs11_m2:war:0.0.1-SNAPSHOT is invalid, transitive dependencies (if any) will not be available, enable debug logging for more details
[INFO]
[INFO] --- liberty-maven-plugin:3.10-SNAPSHOT:devc (default-cli) @ AcmeWebEjbEar ---
[INFO] The recompileDependencies parameter is set to "false". On a file change only the affected classes will be recompiled.
[INFO] Running maven-ear-plugin:generate-application-xml
[INFO] Running maven-resources-plugin:resources
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory c:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\src\main\resources
[INFO] Running liberty:deploy
[INFO] Copying 6 files to C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\target\liberty\wlp\usr\servers\defaultServer
[INFO] CWWKM2144I: Update server configuration file server.xml from C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\src\main\liberty\config\server.xml.
[INFO] CWWKM2144I: Update server configuration file jvm.options from C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\src\main\liberty\config\jvm.options.
[INFO] CWWKM2185I: The liberty-maven-plugin configuration parameter "appsDirectory" value defaults to "apps".
[INFO] Application configuration is found in server.xml : AcmeWebEjbEar.ear
[INFO] CWWKM2160I: Installing application AcmeWebEjbEar.ear.xml.
[INFO] Copying 6 files to C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\target\liberty\wlp\usr\servers\defaultServer
[INFO] CWWKM2144I: Update server configuration file server.xml from C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\src\main\liberty\config\server.xml.
[INFO] CWWKM2144I: Update server configuration file jvm.options from C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\src\main\liberty\config\jvm.options.
[INFO] Building container image...
[INFO] podman  build --pull -f c:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\target\.libertyDevc\tempContainerfile12322131777541751413 -t acmewebejbear-dev-mode c:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar
[ERROR] time="2023-10-25T11:24:53-07:00" level=error msg="1 error occurred:\n\t* archive/tar: write too long\n\n\n"
[ERROR] Error: Post "http://d/v4.7.0/libpod/build?dockerfile=%5B%22target%2F.libertyDevc%2FtempContainerfile12322131777541751413%22%5D&forcerm=1&httpproxy=1&identitylabel=1&idmappingoptions=%7B%22HostUIDMapping%22%3Atrue%2C%22HostGIDMapping%22%3Atrue%2C%22UIDMap%22%3A%5B%5D%2C%22GIDMap%22%3A%5B%5D%2C%22AutoUserNs%22%3Afalse%2C%22AutoUserNsOpts%22%3A%7B%22Size%22%3A0%2C%22InitialSize%22%3A0%2C%22PasswdFile%22%3A%22%22%2C%22GroupFile%22%3A%22%22%2C%22AdditionalUIDMappings%22%3Anull%2C%22AdditionalGIDMappings%22%3Anull%7D%7D&isolation=1&jobs=1&layers=1&networkmode=0&nsoptions=%5B%7B%22Name%22%3A%22user%22%2C%22Host%22%3Atrue%2C%22Path%22%3A%22%22%7D%5D&omithistory=0&output=acmewebejbear-dev-mode&outputformat=application%2Fvnd.oci.image.manifest.v1%2Bjson&pullpolicy=always&rm=1&shmsize=67108864&t=acmewebejbear-dev-mode": io: read/write on closed pipe
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  7.454 s
[INFO] Finished at: 2023-10-25T11:24:53-07:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal io.openliberty.tools:liberty-maven-plugin:3.10-SNAPSHOT:devc (default-cli) on project AcmeWebEjbEar: Error starting the server in dev mode.: Could not build container image using Containerfile: c:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\Dockerfile. Address the following container build error and then start dev mode again: time="2023-10-25T11:24:53-07:00" level=error msg="1 error occurred:\n\t* archive/tar: write too long\n\n\n" RC=125 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

[cherylking]

This issue looks very similar, but had no solution. It just went away eventually. When researching the error, I see mention of symlinks as a potential problem. Do you happen to have any symlinks on the test machine? @rumanaHaque

[rumanaHaque]

As shown in the stack trace above - I cannot run using this podman build command
podman build --pull -f c:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\target\.libertyDevc\tempContainerfile12322131777541751413 -t acmewebejbear-dev-mode c:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar

since this is a temp Containerfile that is created, and I don't have access to it later on.
However, if I run using this command (i.e the DockerFile that I have in my workspace), then the command runs successfully.

c:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar>podman  build --pull -f C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\Dockerfile -t acmewebejbear-dev-mode C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar
STEP 1/11: FROM icr.io/appcafe/open-liberty:beta
Trying to pull icr.io/appcafe/open-liberty:beta...
Getting image source signatures
Checking if image destination supports signatures
Copying blob sha256:0f609894b5a985d53df6c07048d33d9ef768964c89184d4557fbbadf
.
.
Server defaultServer stopped.
++ awk '/^Cache is [0-9.]*% .*full/ {print substr($3, 1, length($3)-1)}'
+ FULL=60
+ echo 'SCC layer is 60% full. Destroying layer.'
+ java -XX:+OriginalJDK8HeapSizeCompatibilityMode -Xshareclasses:name=openj9_system_scc,cacheDir=/opt/java/.scc,destroy
SCC layer is 60% full. Destroying layer.
JVMSHRC806I Compressed references persistent shared cache "openj9_system_scc" has been destroyed. Use option -Xnocompressedrefs if you want to destroy a non-compressed references cache.
+ true
+ SCC_SIZE=80
++ awk 'BEGIN {print int(80 * 60 / 100.0 + 0.5)}'
Re-creating layer with size 48m.
+ SCC_SIZE=48
+ '[' 48 -eq 0 ']'
+ SCC_SIZE=48m
+ echo 'Re-creating layer with size 48m.'
+ java -XX:+OriginalJDK8HeapSizeCompatibilityMode -Xshareclasses:name=openj9_system_scc,cacheDir=/opt/java/.scc,createLayer,groupAccess -Xscmx48m -version
openjdk version "17.0.8.1" 2023-08-24
IBM Semeru Runtime Open Edition 17.0.8.1 (build 17.0.8.1+1)
Eclipse OpenJ9 VM 17.0.8.1 (build openj9-0.40.0, JRE 17 Linux amd64-64-Bit Compressed References 20230824_549 (JIT enabled, AOT enabled)
OpenJ9   - d12d10c9e
OMR      - e80bff83b
JCL      - 8ecf238a124 based on jdk-17.0.8.1+1)
+ (( i=0 ))
+ (( i<1 ))
+ /opt/ol/wlp/bin/server start

Starting server defaultServer.
CWWKE0953W: This version of Open Liberty is an unsupported early release version.
Server defaultServer started with process ID 383.
+ /opt/ol/wlp/bin/server stop

Stopping server defaultServer.
Server defaultServer stopped.
+ (( i++ ))
+ (( i<1 ))
+ umask 0022
+ rm -rf /output/messaging /logs/ACME /logs/console.log /logs/ffdc /logs/messages_23.10.25_20.42.57.0.log /logs/messages.log /opt/ol/wlp/output/.classCache
+ chmod -R g+rwx /output/workarea
+ [[ -d /output/resources ]]
+ chmod -R g+rwx /output/resources
++ awk '/^Cache is [0-9.]*% .*full/ {print substr($3, 1, length($3)-1)}'
SCC layer is 100% full.
+ FULL=100
+ echo 'SCC layer is 100% full.'
COMMIT acmewebejbear-dev-mode
--> Pushing cache []:8974400c4c3c26aaed1e99ae919d57ac612f4176389563a051567f5fbc10537f
--> 1cb4bd93282
Successfully tagged localhost/acmewebejbear-dev-mode:latest
1cb4bd93282c61d4e4b05ef82d66427e694e4084a7a37a68ead9d6f8f663c630

[rumanaHaque]

Hi @cherylking - confirmed I am not using any Symlinks.

c:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar> cmd /E /C "prompt $T$$ & echo.%TIME%$ & dir /AL /S C:\ | find "SYMLINK" & for %Z in (.) do rem/ "
12:53:58.31$
05/08/2021  01:34 AM    <SYMLINKD>     All Users [C:\ProgramData]

12:57:18.20$ rem/

[rumanaHaque]

Here is the temp Containerfile that devc generates when I run the command mvn liberty:devc.

#ARG BASE_IMAGE=icr.io/appcafe/open-liberty:kernel-slim-java8-openj9-ubi
#ARG BASE_IMAGE=icr.io/appcafe/open-liberty:kernel-slim-java11-openj9-ubi
#ARG BASE_IMAGE=open-liberty:beta-java17
ARG BASE_IMAGE=icr.io/appcafe/open-liberty:beta


FROM $BASE_IMAGE
COPY  --chown=1001:0  src/main/liberty/config/server.xml /config/server.xml
COPY  --chown=1001:0  src/main/liberty/config/jvm.options /config/jvm.options
COPY  --chown=1001:0  src/main/liberty/config/ACME_Liberty_combined_docker.xml /config/ACME_Liberty_combined_docker.xml
user 1001
RUN mkdir /logs/ACME
RUN mkdir /logs/ACME/client
ARG VERBOSE=true
ARG FULL_IMAGE=false
ENV OPENJ9_SCC=false
RUN configure.sh

[cherylking]

I'm attaching a word doc that contains the very long error string parsed out into separate lines.

ERROR.docx

[cherylking]

Just adding here that this is a Windows only problem, and Matt is working on a PR currently that will probably fix this issue. I will post here when we have a snapshot driver of LMP to try.

[cherylking]

@rumanaHaque The 3.10-SNAPSHOT of LMP has been updated with this fix. Please let us know if the problem persists.

[rumanaHaque]

@cherylking @mattbsox
I just reran the mvn liberty:devc command from the command line, and it didn't get into the same error as I had earlier (with -U option to ensure the plugin was updated)
c:\eclipse-workspace\acme-ee10\acme-ee>mvn liberty:devc -U
and it went past the application cannot start error.

Here is the stack trace:

[INFO] Building container image...
[INFO] podman  build --pull -f C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\target\.libertyDevc\tempContainerfile17124709226244693125 -t acmewebejbear-dev-mode C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar
[INFO] STEP 1/11: FROM icr.io/appcafe/open-liberty:beta
[INFO] Trying to pull icr.io/appcafe/open-liberty:beta...
[INFO] Getting image source signatures
[INFO] Checking if image destination supports signatures
[INFO] Copying blob sha256:ddc62b849fb32477a4bf8cb15248ff5c19607d6b4348b361ee6c30fc6a5b96a7
[INFO] Copying blob sha256:77500ad95f2d45e8b81e00c32658d41a0ba2737490d4b637ee1740992be7908d
[INFO] Copying blob sha256:98b51776a780a526853b950d382e6571079435316546143571b47b263897edac
[INFO] Copying blob sha256:ad655a6d9ea3bfadd1318d968c608c4e57979db05970807698a64ee137b2e62f
[INFO] Copying blob sha256:38731a27f39662bcae9c868477f70d64ff281e81b32f2e4cb2540dac82102628
[INFO] Copying blob sha256:78eb0744fb9c4e21f125b698cff46f392b08378f70409e7019b920fc0ce57fa3
[INFO] Copying blob sha256:afbd7e0df1c99daec261e8c0ee5a37fcd944956bf08d052e8ce76cd93d1d80d5
[INFO] Copying blob sha256:10b866b88e718035641bc26b630f08c637f7de02d8d4b09a1675bcecbc28820f
[INFO] Copying blob sha256:6422702abcf9a650094eed2b5a918e8c68aab1dfe4fcf664eca35ead139fe1d4
[INFO] Copying blob sha256:182d1c30a4730c8ff7ca03d679de085f66dfb623b868e5035c81c5146c6440e4
[INFO] Copying blob sha256:09f434fabc3810df64a7b705af53bf9f1a05fa5e17e47eeb17855d4eea156c9d
[INFO] Copying blob sha256:26cec1b5bb50069e5fd3293f1b5318e9d88e4555807e44728ae4cfb25f2847ba
[INFO] Copying blob sha256:07240492ecb8ad3a822e39d51250e3736d9844d14ce40b7787e88a9d760f9be4
[INFO] Copying blob sha256:6902317e4d1e467a0c63dae9f89d80ed55d90f66d1bf37852c833723ab55e2f9
[INFO] Copying blob sha256:f32e20d8e7e409fbdb1e1ffa22f5b71c2251472863ffeb2581ca195b3ad448ee
[INFO] Copying blob sha256:86c9834405215507113f9b99dd568939231714453604b7693ec33e090362783e
[INFO] Copying blob sha256:940e50029a437c7ef64435c831e8947de2b5257177f2f39d5cf22a7a1eb9164e
[INFO] Copying config sha256:6b5c0afd9c28cdea8d3efd5bacbffdf0d6ed7c8379e98ebe9ab442876d6bb3ba
[INFO] Writing manifest to image destination
[INFO] Storing signatures
[INFO] STEP 2/11: COPY  --chown=1001:0  src/main/liberty/config/server.xml /config/server.xml
[INFO] --> Pushing cache []:a304a0749af743ce6fb4dc4cfca930e7bffcd20784757b383718be634eba65a0
[INFO] --> 7d287745283
[INFO] STEP 3/11: COPY  --chown=1001:0  src/main/liberty/config/jvm.options /config/jvm.options
[INFO] --> Pushing cache []:b647883e60373a2d28c7f1e23436a0ca22f68046c1bc42b16821a6133164c6ed
[INFO] --> 3e2392b6512
[INFO] STEP 4/11: COPY  --chown=1001:0  src/main/liberty/config/ACME_Liberty_combined_docker.xml /config/ACME_Liberty_combined_docker.xml
[INFO] --> Pushing cache []:61a4af49b91bacb7c50d88625c262dd00cbf31ee7ef4709806c4624bfc1b2a6c
[INFO] --> 19eed74e098
[INFO] STEP 5/11: user 1001
[INFO] --> Pushing cache []:bfb5b0cc3e8787df7e371d9c1b57f2900b5db7ea5f8d27f350914f383941dfbb
[INFO] --> 3c3ea8ed69b
[INFO] STEP 6/11: RUN mkdir /logs/ACME
[INFO] --> Pushing cache []:9bb4606a9b14a21a9c9552b9a9f2412b71b091a2f5e9b1924788ad77292fe496
[INFO] --> b43617ac645
[INFO] STEP 7/11: RUN mkdir /logs/ACME/client
[INFO] --> Pushing cache []:54a05de09f361f64d6224757a342edc20fb5791fdc56023c2579d6ad1cadf4cf
[INFO] --> 248a50ff5df
[INFO] STEP 8/11: ARG VERBOSE=true
[INFO] --> Pushing cache []:87cd2f7d06c5453f7cc4fa1e62ccc3f574a9147be3ced8e4536cd2b734996777
[INFO] --> 0309de22006
[INFO] STEP 9/11: ARG FULL_IMAGE=false
[INFO] --> Pushing cache []:25e53441f591ee4ea364c911b1e483dc8ad3fe04b012f4ff815bff589ed8b501
[INFO] --> f82c025a6bb
[INFO] STEP 10/11: ENV OPENJ9_SCC=false
[INFO] --> Pushing cache []:9c212b8f770338ebabe9892a65642054304d0990f0ad6854094c3d0e0fadbb2b
[INFO] --> f45ed2bfcc9
[INFO] STEP 11/11: RUN configure.sh
[INFO] + main
[INFO] + WLP_INSTALL_DIR=/opt/ol/wlp
[INFO] + SHARED_CONFIG_DIR=/opt/ol/wlp/usr/shared/config
[INFO] + SHARED_RESOURCE_DIR=/opt/ol/wlp/usr/shared/resources
[INFO] + SNIPPETS_SOURCE=/opt/ol/helpers/build/configuration_snippets
[INFO] + SNIPPETS_TARGET=/config/configDropins/overrides
[INFO] + SNIPPETS_TARGET_DEFAULTS=/config/configDropins/defaults
[INFO] + mkdir -p /config/configDropins/overrides
[INFO] + mkdir -p /config/configDropins/defaults
[INFO] + '[' '' == true ']'
[INFO] + '[' '' == true ']'
[INFO] + '[' '' == true ']'
[INFO] + '[' '' == client ']'
[INFO] + '[' '' == embedded ']'
[INFO] + [[ -n '' ]]
[INFO] + '[' '' == true ']'
[INFO] + '[' '' == true ']'
[INFO] + keystorePath=/config/configDropins/defaults/keystore.xml
[INFO] + '[' '' == true ']'
[INFO] + '[' '' == true ']'
[INFO] + '[' '' '!=' false ']'
[INFO] + '[' '' '!=' false ']'
[INFO] + '[' '!' -e /config/configDropins/defaults/keystore.xml ']'
[INFO] ++ openssl rand -base64 32
[INFO] + export KEYSTOREPWD=2uf12ZwlW3ITD10Z+cdBR5/EFEquCgvd0q6H9aI9y/w=
[INFO] + KEYSTOREPWD=2uf12ZwlW3ITD10Z+cdBR5/EFEquCgvd0q6H9aI9y/w=
[INFO] + sed 's|REPLACE|2uf12ZwlW3ITD10Z+cdBR5/EFEquCgvd0q6H9aI9y/w=|g' /opt/ol/helpers/build/configuration_snippets/keystore.xml
[INFO] + chmod g+w /config/configDropins/defaults/keystore.xml
[INFO] + [[ -n '' ]]
[INFO] + find /opt/ol/fixes -type f -name '*.jar' -print0
[INFO] + sort -z
[INFO] + xargs -0 -n 1 -r -I '{}' java -jar '{}' --installLocation /opt/ol/wlp
[INFO] + touch /config/server.xml
[INFO] + '[' false == true ']'
[INFO] COMMIT acmewebejbear-dev-mode
[INFO] --> Pushing cache []:ad6f24d586f4715ea7bd53142918ad5d898829e06417a03cf2475b4c6be61e2d
[INFO] --> 1f32bb135b5
[INFO] Successfully tagged localhost/acmewebejbear-dev-mode:latest
[INFO] 1f32bb135b579b50a41322c93627e53bb65af7958b6f81b61fdfd58224283bfe
[WARNING] The container build command took longer than 30 seconds. You may increase performance by adding unneeded files and directories such as any Liberty runtime directories to a .dockerignore file in C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar.
[INFO] Completed building container image.
[INFO] Starting container...
[INFO] podman run --rm -p 9080:9080 -p 9443:9443 -p 7777:7777 -e WLP_DEBUG_SUSPEND=n -e WLP_DEBUG_ADDRESS=7777 -e WLP_DEBUG_REMOTE=y -v C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\target\.libertyDevc\apps:/config/apps -v C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\target\.libertyDevc\dropins:/config/dropins -v C:\eclipse-workspace\acme-ee10\acme-ee:/devmode -v C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\target\liberty\wlp\usr\servers\defaultServer\logs:/logs -v C:\Users\Administrator\.m2\repository:/devmode-maven-cache -v C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar/src/main/liberty/config/server.xml:/config/server.xml -v C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar/src/main/liberty/config/jvm.options:/config/jvm.options -v C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar/src/main/liberty/config/ACME_Liberty_combined_docker.xml:/config/ACME_Liberty_combined_docker.xml --name liberty-dev acmewebejbear-dev-mode server debug defaultServer -- --io.openliberty.tools.projectRoot=/devmode
[INFO]
[INFO] Listening for transport dt_socket at address: 7777
[INFO] Launching defaultServer (Open Liberty 23.0.0.12-beta/wlp-1.0.83.cl231120231030-1102) on Eclipse OpenJ9 VM, version 17.0.8.1+1 (en_US)
[INFO] CWWKE0953W: This version of Open Liberty is an unsupported early release version.
[INFO]  Parameters: [--io.openliberty.tools.projectRoot=/devmode]
[INFO] [AUDIT   ] CWWKE0001I: The server defaultServer has been launched.
[INFO] CWWKM2010I: Searching for CWWKF0011I: in C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\target\liberty\wlp\usr\servers\defaultServer\logs\messages.log. This search will timeout after 90 seconds.
[INFO] [AUDIT   ] CWWKG0093A: Processing configuration drop-ins resource: /opt/ol/wlp/usr/servers/defaultServer/configDropins/defaults/keystore.xml
[INFO] [AUDIT   ] CWWKG0093A: Processing configuration drop-ins resource: /opt/ol/wlp/usr/servers/defaultServer/configDropins/defaults/open-default-port.xml
[INFO] [AUDIT   ] CWWKG0102I: Found conflicting settings for defaultHttpEndpoint instance of httpEndpoint configuration.
[INFO]   Property host has conflicting values:
[INFO]     Value * is set in file:/opt/ol/wlp/usr/servers/defaultServer/configDropins/defaults/open-default-port.xml.
[INFO]     Value mum1.fyre.ibm.com is set in file:/opt/ol/wlp/usr/servers/defaultServer/server.xml.
[INFO]   Property host will be set to mum1.fyre.ibm.com.
[INFO]
[INFO] [AUDIT   ] CWWKZ0058I: Monitoring dropins for applications.
[INFO] [AUDIT   ] CWWKS4104A: LTPA keys created in 1.679 seconds. LTPA key file: /opt/ol/wlp/output/defaultServer/resources/security/ltpa.keys
[INFO] [AUDIT   ] CWPKI0803A: SSL certificate created in 7.181 seconds. SSL key file: /opt/ol/wlp/output/defaultServer/resources/security/key.p12
[INFO] [AUDIT   ] CWWKI0001I: The CORBA name server is now available at corbaloc:iiop:localhost:2814/NameService.
[INFO] [AUDIT   ] CWWKT0016I: Web application available (default_host): http://mum1.fyre.ibm.com:9080/openapi/
[INFO] [AUDIT   ] CWWKT0016I: Web application available (default_host): http://mum1.fyre.ibm.com:9080/openapi/ui/
[INFO] [AUDIT   ] CWWKT0016I: Web application available (default_host): http://mum1.fyre.ibm.com:9080/jwt/
[INFO] [AUDIT   ] CWWKT0016I: Web application available (default_host): http://mum1.fyre.ibm.com:9080/health/
[INFO] [AUDIT   ] CWWKT0016I: Web application available (default_host): http://mum1.fyre.ibm.com:9080/metrics/
[INFO] [AUDIT   ] CWWKT0016I: Web application available (default_host): http://mum1.fyre.ibm.com:9080/ibm/api/
[INFO] CWWKM2011E: Timed out searching for CWWKF0011I: in C:\eclipse-workspace\acme-ee10\acme-ee\AcmeWebEjbEar\target\liberty\wlp\usr\servers\defaultServer\logs\messages.log.

I still get a diff error - but that is the application timing out.

[ERROR] Failed to execute goal io.openliberty.tools:liberty-maven-plugin:3.10-SNAPSHOT:devc (default-cli) on project AcmeWebEjbEar: Error starting the server in dev mode.: The server has not started within 90 seconds. Consider increasing the server start timeout if this continues to occur. For example, 'mvn liberty:dev -DserverStartTimeout=120' -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <args> -rf :AcmeWebEjbEar

But the error for this problem has been fixed in the latest release of the liberty maven plugin.