Standalone pkg

[DavidGOrtega]

mmagic dependency removed using a wasm version of libmagic.

• closes replace/remove mmmagic dependency #544
• closes CML binaries to improve the node dep #825

[DavidGOrtega]

@iterative/cml we are suffering an strange hiccup while testing doing npm i -g

  npm i -g
  cml --version
  cml runner --version
  cml publish --version
  cml pr --version
  shell: /usr/bin/bash -e {0}

added 1 package, and audited 3 packages in 2s

found 0 vulnerabilities
node:internal/modules/cjs/loader:936
  throw err;
  ^

Error: Cannot find module 'pseudoexec'
Require stack:
- /home/runner/work/cml/cml/bin/cml.js
    at Function.Module._resolveFilename (node:internal/modules/cjs/loader:933:15)
    at Function.Module._load (node:internal/modules/cjs/loader:778:27)
    at Module.require (node:internal/modules/cjs/loader:1005:19)
    at require (node:internal/modules/cjs/helpers:102:18)
    at Object.<anonymous> (/home/runner/work/cml/cml/bin/cml.js:4:24)
    at Module._compile (node:internal/modules/cjs/loader:1101:14)
    at Object.Module._extensions..js (node:internal/modules/cjs/loader:1153:10)
    at Module.load (node:internal/modules/cjs/loader:981:32)
    at Function.Module._load (node:internal/modules/cjs/loader:822:12)
    at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:81:12) {
  code: 'MODULE_NOT_FOUND',
  requireStack: [ '/home/runner/work/cml/cml/bin/cml.js' ]

[DavidGOrtega]

@casperdcl casperdcl force-pushed the standalone-pkg branch from f8236fa to 541009c 8 minutes ago

I tried the same in 4e802d1 @casperdcl

[casperdcl]

depends on #847 <- #845

resolved

[casperdcl]

GitLab failing with Error: Failed creating the machine: no Subnet found - maybe related to iterative/terraform-provider-iterative#323?

stderr

{"level":"error","message":"terraform -chdir=/home/runner apply -auto-approve
	
Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
 + create

Terraform will perform the following actions:

 # iterative_cml_runner.runner will be created
 + resource "iterative_cml_runner" "runner" {
 + cloud = "aws"
 + driver = "gitlab"
 + id = (known after apply)
 + idle_timeout = 300
 + image = (known after apply)
 + instance_hdd_size = 35
 + instance_ip = (known after apply)
 + instance_launch_time = (known after apply)
 + instance_type = "g4dn.xlarge"
 + labels = "cml-runner-gpu"
 + name = "cml-jy7luixvvc"
 + region = "us-west"
 + repo = "https://gitlab.com/iterative.ai/cml"
 + single = false
 + spot = true
 + spot_price = -1
 + ssh_public = (known after apply)
 + token = (sensitive value)
 }

Plan: 1 to add, 0 to change, 0 to destroy.
iterative_cml_runner.runner: Creating...
iterative_cml_runner.runner: Still creating... [10s elapsed]

	╷
│ Error: Failed creating the machine: no Subnet found
│ 
│  with iterative_cml_runner.runner,
│  on main.tf line 14, in resource "iterative_cml_runner" "runner":
│  14: resource "iterative_cml_runner" "runner" {
│ 
╵
","stack":"Error: terraform -chdir=/home/runner apply -auto-approve
	
Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
 + create

Terraform will perform the following actions:

 # iterative_cml_runner.runner will be created
 + resource "iterative_cml_runner" "runner" {
 + cloud = "aws"
 + driver = "gitlab"
 + id = (known after apply)
 + idle_timeout = 300
 + image = (known after apply)
 + instance_hdd_size = 35
 + instance_ip = (known after apply)
 + instance_launch_time = (known after apply)
 + instance_type = "g4dn.xlarge"
 + labels = "cml-runner-gpu"
 + name = "cml-jy7luixvvc"
 + region = "us-west"
 + repo = "https://gitlab.com/iterative.ai/cml"
 + single = false
 + spot = true
 + spot_price = -1
 + ssh_public = (known after apply)
 + token = (sensitive value)
 }

Plan: 1 to add, 0 to change, 0 to destroy.
iterative_cml_runner.runner: Creating...
iterative_cml_runner.runner: Still creating... [10s elapsed]

	╷
│ Error: Failed creating the machine: no Subnet found
│ 
│  with iterative_cml_runner.runner,
│  on main.tf line 14, in resource "iterative_cml_runner" "runner":
│  14: resource "iterative_cml_runner" "runner" {
│ 
╵

 at /usr/lib/node_modules/@dvcorg/cml/src/utils.js:14:27
 at ChildProcess.exithandler (node:child_process:404:5)
 at ChildProcess.emit (node:events:390:28)
 at maybeClose (node:internal/child_process:1064:16)
 at Process.ChildProcess._handle.onexit (node:internal/child_process:301:5)","status":"terminated"}

[dacbd]

🤔 shouldn't be, that tf template shouldn't have touched any of the additional code paths I added. Has there been any changes to the "default" vpc for this test AWS account?

[DavidGOrtega]

🤔 shouldn't be, that tf template shouldn't have touched any of the additional code paths I added. Has there been any changes to the "default" vpc for this test AWS account

None at all

[DavidGOrtega]

/tests

[dacbd]

/tests

cml runner vs cml-runner?

[DavidGOrtega]

@dacbd both works

[dacbd]

@dacbd both works

https://github.com/iterative/cml/runs/4551308053?check_suite_focus=true#step:7:40

[casperdcl]

Hoped it would be fixed by iterative/terraform-provider-iterative#336 <- iterative/terraform-provider-iterative#335 but still failing

[DavidGOrtega]

Hoped it would be fixed by iterative/terraform-provider-iterative#336 <- iterative/terraform-provider-iterative#335 but still failing

Terraform did not updated the registry at that time. Now works as expected