[BUG] Open search dashboard setup failing in local using MAC

[gltestenv]

Describe the bug

Using the developer guid, I am trying to configure the open search dashboard in my local but getting the error
https://github.com/opensearch-project/OpenSearch-Dashboards/blob/main/DEVELOPER_GUIDE.md#prerequisites
When running the command yarn opensearch snapshot getting below error.

yarn opensearch snapshot yarn run v1.22.19 $ scripts/use_node scripts/opensearch snapshot info Installing from snapshot │ info version: 3.0.0 │ info install path: /Users/xxxx/Documents/xxxxx/Code/OpenSerachCode/OpenSearch-Dashboards/.opensearch/3.0.0 │ info license: oss │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-SNAPSHOT/opensearch-min-3.0.0-SNAPSHOT-darwin-arm64-latest.tar.gz │ info Daily general-availability snapshot URL not found for current version, falling back to release-candidate snapshot URL. │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-rc5/opensearch-3.0.0-rc5-SNAPSHOT-darwin-arm64-latest.tar.gz │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-rc4/opensearch-3.0.0-rc4-SNAPSHOT-darwin-arm64-latest.tar.gz │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-rc3/opensearch-3.0.0-rc3-SNAPSHOT-darwin-arm64-latest.tar.gz │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-rc2/opensearch-3.0.0-rc2-SNAPSHOT-darwin-arm64-latest.tar.gz │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-rc1/opensearch-3.0.0-rc1-SNAPSHOT-darwin-arm64-latest.tar.gz │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-rc0/opensearch-3.0.0-rc0-SNAPSHOT-darwin-arm64-latest.tar.gz │ERROR Snapshots for 3.0.0 are not available error Command failed with exit code 1. info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

Please provide help on this. Thanks in advance

[ashwin-pc]

@kavilla This issue should work based on #2944. Do you know more?

[kavilla]

@kavilla This issue should work based on #2944. Do you know more?

Will need to check on my Mac, pontentially this could be an original time out with the bucket containing the artifacts needed to be updated.

Will still check, @gltestenv to be sure, would you be willing to share more information about your local machine. Are you running it through a VPN?

Are you able to download the snapshot link the error message first provides?

Thank you!

[ArielGMachado]

I am also currently having the same problem with my Mac with Apple Silicon processors.
Looks like the snapshot artifact recipe was updated by @kavilla at that time via #3537 to support Darwin, but probably tested for x64 architecture only. This assumption is because in the build CI Jenkins there are only MacOS x64 (not arm64 Apple Silicon) nodes available as workers https://build.ci.opensearch.org/computer/
So this Jenkins CI does not generates native arm64 binaries.
When running yarn opensearch snapshot it is trying to download an artifact for darwin-arm64 architecture opensearch-min-3.0.0-SNAPSHOT-darwin-arm64-latest.tar.gz as detected for our Apple Silicon processor, artifacts that naturally do not exist in this artifactory.

That explains why the link to download snapshot for Darwin arm64 fails : https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-SNAPSHOT/opensearch-min-3.0.0-SNAPSHOT-darwin-arm64-latest.tar.gz

But the link to download the snapshot for Darwin x64 works:
https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-SNAPSHOT/opensearch-min-3.0.0-SNAPSHOT-darwin-x64-latest.tar.gz

[MrSparc]

@kavilla in the meanwhile the CI build pipeline was updated to support aarch64 by opensearch-project/opensearch-build#4670
Snapshots for Apple Silicon architecture are being built and available for download (the link in the previous comment for darwin-arm64 already works now), so this issue can be closed as fixed:

 % yarn opensearch snapshot
yarn run v1.22.19
$ scripts/use_node scripts/opensearch snapshot
 info Installing from snapshot
   │ info version: 3.0.0
   │ info install path: /Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0
   │ info license: oss
   │ info Verifying snapshot URL at https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-SNAPSHOT/opensearch-min-3.0.0-SNAPSHOT-darwin-arm64-latest.tar.gz
   │ info downloading artifact from https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-SNAPSHOT/opensearch-min-3.0.0-SNAPSHOT-darwin-arm64-latest.tar.gz
   │ info downloading artifact checksum from https://artifacts.opensearch.org/snapshots/core/opensearch/3.0.0-SNAPSHOT/opensearch-min-3.0.0-SNAPSHOT-darwin-arm64-latest.tar.gz.sha512
   │ info checksum verified
   │ info extracting /Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/cache/opensearch-min-3.0.0-SNAPSHOT-darwin-arm64-latest.tar.gz
   │ info extracted to /Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0
   │ info created /Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0/OPENSEARCH_TMPDIR
 info Starting
   │ debg bin/opensearch 
   │ERROR WARNING: Using incubator modules: jdk.incubator.vector
   │      
   │ERROR WARNING: A terminally deprecated method in java.lang.System has been called
   │      WARNING: System::setSecurityManager has been called by 
   │ERROR org.opensearch.bootstrap.OpenSearch (file:/Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0/lib/opensearch-3.0.0-SNAPSHOT.jar)
   │      WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.OpenSearch
   │      WARNING: System::setSecurityManager will be removed in a future release
   │      
   │ERROR WARNING: A terminally deprecated method in java.lang.System has been called
   │      WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.Security (file:/Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0/lib/opensearch-3.0.0-SNAPSHOT.jar)
   │ERROR 
   │      WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.Security
   │      WARNING: System::setSecurityManager will be removed in a future release
   │      
   │ info [o.o.n.Node] [MBP-de-Ariel.Home] version[3.0.0-SNAPSHOT], pid[14744], build[tar/0cde7baf438e6ab994114b71dd9fadcacac4e443/2024-07-30T01:33:14.820725Z], OS[Mac OS X/14.5/aarch64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/21.0.4/21.0.4+7-LTS]
   │ info [o.o.n.Node] [MBP-de-Ariel.Home] JVM home [/Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0/jdk.app/Contents/Home], using bundled JDK/JRE [true]
   │ info [o.o.n.Node] [MBP-de-Ariel.Home] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.security.manager=allow, -Djava.locale.providers=SPI,CLDR, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/var/folders/kx/d_cwn3gn5ts90n6b_bn0fzgr0000gn/T/opensearch-2104154294385342477, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.security.manager=allow, --add-modules=jdk.incubator.vector, -Djava.util.concurrent.ForkJoinPool.common.threadFactory=org.opensearch.secure_sm.SecuredForkJoinWorkerThreadFactory, -Xms1g, -Xmx1g, -XX:MaxDirectMemorySize=536870912, -Dopensearch.path.home=/Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0, -Dopensearch.path.conf=/Users/xxxx/Developer/OpenSearch-Dashboards/.opensearch/3.0.0/config, -Dopensearch.distribution.type=tar, -Dopensearch.bundled_jdk=true]
   │ info [o.o.n.Node] [MBP-de-Ariel.Home] version [3.0.0-SNAPSHOT] is a pre-release version of OpenSearch and is not suitable for production
   │ info [o.a.l.i.v.PanamaVectorizationProvider] [MBP-de-Ariel.Home] Java vector incubator API enabled; uses preferredBitSize=128

[peterzhuamazon]

Seems like this is fixed now per @MrSparc comments.
Glad the new snapshots helped here.

Closing now. Thanks.