Cannot build xeus-python-demo #39
Comments
|
Thanks @martinRenou I tried adding name: build-env
channels:
- conda-forge
dependencies:
- python
- micromamba
- pip
- jupyter_server
- jupyterlite-core >=0.3.0,<0.4.0
- jupyterlite-xeus>=0.1.2,<0.2But still no change. Did I interpret jupyterlite/xeus#100 correctly? |
|
ah you also need to use |
|
Thanks again @martinRenou. I am still running into the same problem :( Here is the exact procedure followed for my most recent attempt:
Here are the contents of my name: build-env
channels:
- conda-forge
dependencies:
- python
- micromamba
- pip
- jupyter_server
- jupyterlite-core >=0.3.0,<0.4.0
- jupyterlite-xeus==0.2.0a0And here are the contents of my name: xeus-lite-wasm
channels:
- https://repo.mamba.pm/emscripten-forge
- conda-forge
dependencies:
- xeus-python
- numpyIs anything jumping out at you as blatantly incorrect? Thank you for any time you are able to spend reviewing this. Much appreciated. trace log(jupyterlite) connorferster@pop-os ~/code/jupyterlite-xeus jupyter lite build --XeusAddon.environment=environment.yml
[LiteBuildApp] WARNING | Config option `environment` not recognized by `XeusAddon`. Did you mean `environment_file`?
static:jupyter-lite.json
. pre_status:static:jupyter-lite.json
tarball: jupyterlite-app-0.3.0.tgz 13MB
output: /home/connorferster/code/jupyterlite-xeus/_output
lite dir: /home/connorferster/code/jupyterlite-xeus
apps:
sourcemaps: True
unused packages: True
archive:archive
contents:contents
icons:icons
lite:jupyter-lite.json
mimetypes:jupyter-lite.json
serve:contents
settings:overrides
translation:translation
. status:archive:archive
[LiteBuildApp] No archive (yet): jupyterlite-xeus-jupyterlite.tgz
. status:contents:contents
contents: 0 files
. status:icons:icons
favicon files: 0 files
. status:lite:jupyter-lite.json
[LiteBuildApp] jupyter-lite.(json|ipynb): 0 files
. status:mimetypes:jupyter-lite.json
filetypes: 26
. status:serve:contents
url: http://127.0.0.1:8000/
server: stdlib
headers:
. status:settings:overrides
overrides.json: 0
. status:translation:translation
translation files: 0 files
static:output_dir
-- pre_init:static:output_dir
static:unpack
. init:static:unpack
/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_core/addons/base.py:294: UserWarning: install libarchive-c for better performance when working with archives: No module named 'libarchive'
return has_optional_dependency(
federated_extensions:copy:ext:@jupyterlite/xeus
. pre_build:federated_extensions:copy:ext:@jupyterlite/xeus
/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_core/addons/icons.py:43: UserWarning: [lite] [icons] install `jupyter_server` to copy notebook favicons: No module named 'jupyter_server'
if not self.is_sys_prefix_ignored() and has_optional_dependency(
/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_core/addons/translation.py:88: UserWarning: [lite] [translation] install `jupyterlab_server` to load translations: No module named 'jupyterlab_server'
if not self.is_sys_prefix_ignored() and has_optional_dependency(
translation:copy
. build:translation:copy
federated_extensions:patch
federated_extensions:settings
Package Version Build Channel Size
Summary: Install: 29 packages Total download: 33MB ────────────────────────────────────────────────────────────────────────────────────────────────── six 14.3kB @ 42.8kB/s 0.3s >>>>>>>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<<<<<<<
environment variables: populated config files : /home/connorferster/miniforge3/.condarc An unexpected error has occurred. Conda has prepared the above report. Example: conda --no-plugins install Alternatively, you can set the CONDA_NO_PLUGINS environment variable on Example: CONDA_NO_PLUGINS=true conda install [LiteBuildApp] ERROR | [lite] [post_build] [jupyterlite-xeus] [ERR] Command '['/home/connorferster/miniforge3/condabin/mamba', 'install', '--yes', '--prefix', PosixPath('/tmp/tmpey81lpqk/env/envs/xeus-lite-wasm'), '-c', 'https://repo.mamba.pm/emscripten-forge', '-c', 'conda-forge', 'xeus-python', 'numpy']' returned non-zero exit status 1. |
Not sure the - pip:
- jupyterlite-xeus==0.2.0a0 |
|
FYI @connorferster this seems to be doing the trick: #40 Even with |
|
Thank you @jtpio and @martinRenou, I really appreciate your assistance. The issue is conda. Even though I am including Solution:
When I completely omit conda from the process then everything goes smoothly (as advertised). However, because I would prefer to use conda in my local environment, it seems I will have run the build process on a separate server (GitHub Actions, or otherwise) as you have demonstrated. I have raised this issue on the conda repo but have heard nothing back. So, if anyone is encountering this same issue and reading this, then you will need to create a computing environment where conda is completely absent in order to make the build work. |
|
Also, I just want to say: Jupyterlite, especially with the xeus kernel, is a game-changer for folks who cannot install Python on their work computers for various reasons. Thank you all so much for this incredible effort. I will be deploying a Jupyterlite site for people in my industry and I expect it to be popular. Thank you thank you thank you! |
|
Thanks @connorferster!
Which issue is it? There is also conda/conda#13962 which would likely fix this. |
|
I got hit by the same problem. I confirm that upgrading to conda 2.7.1 which contains conda/conda#13962 resolved the issue! Now we just have to wait for that version of conda to spread, including in miniconda/... distributions. |
|
@connorferster would you be able to try with the latest version of the template to see if #40 fixes the issue? |
Description
I am trying to build the xeus-python-demo locally but I am getting this strange error (extracted from much larger traceback, included below).
I tried building it last night with the same result. And, after I hit this error, whenever I ran other commands in conda, e.g.
conda create -n myenvname python=3.12, the commands would not run and I would get the same error! (Weird, yeah?)Because it seemed like my miniconda3 installation was now broken, I completely removed conda (and all of my many environments), and re-installed conda anew from miniforge3 (which I had been meaning to do that anyway).
I just tried cloning the repo again fresh and installing it locally into a fresh conda environment. As before, the kernel did not install after running
jupyter lite build. So I executedconda install xeus-pythonto install the xeus kernel into my conda environment. When I then ranjupyter lite buildagain, a completely different series of screens flashed by and then I got the same error as shown above (full stack trace below).Get this! Now, again, my conda installation seems to be broken because I can no longer run
conda create -n myenvname python=3.12without it ending in the same error.The conda-breaking part of this is probably an upstream issue as well but I could really use some guidance on what is happening here. How can I fix this? Are there any build steps I am missing?
Reproduce
conda create -n jupyterlite python=3.12conda activate jupyterlitegit clone https://github.com/jupyterlite/xeus-python-demo.gitcd xeus-python-democonda install jupyterlite-corejupyter lite build-> Successfully builds Jupyterlite but without kernelsconda install xeus-pythonjupyter lite buildCRASH
(See traceback below)
Expected behavior
Jupyterlite builds with xeus-python kernel and I am enjoying an excellent piece of new technology running in my browser! (Wow)
Context
0.3.0Traceback
(jupyterlite) connorferster@pop-os ~/code/jupyterlite-xeus-python main ± jupyter lite build static:jupyter-lite.json . pre_status:static:jupyter-lite.json tarball: jupyterlite-app-0.3.0.tgz 13MB output: /home/connorferster/code/jupyterlite-xeus-python/_output lite dir: /home/connorferster/code/jupyterlite-xeus-python apps: sourcemaps: True unused packages: True archive:archive contents:contents icons:icons lite:jupyter-lite.json mimetypes:jupyter-lite.json serve:contents settings:overrides translation:translation . status:archive:archive [LiteBuildApp] No archive (yet): jupyterlite-xeus-python-jupyterlite.tgz . status:contents:contents contents: 0 files . status:icons:icons favicon files: 0 files . status:lite:jupyter-lite.json [LiteBuildApp] jupyter-lite.(json|ipynb): 0 files . status:mimetypes:jupyter-lite.json filetypes: 26 . status:serve:contents url: http://127.0.0.1:8000/ server: tornado headers: . status:settings:overrides overrides.json: 0 . status:translation:translation translation files: 2 files static:output_dir -- pre_init:static:output_dir static:unpack -- init:static:unpack federated_extensions:copy:ext:jupyterlab_pygments federated_extensions:copy:ext:@jupyterlite/xeus . pre_build:federated_extensions:copy:ext:jupyterlab_pygments . pre_build:federated_extensions:copy:ext:@jupyterlite/xeus icons:copy /home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_core/addons/translation.py:88: UserWarning: [lite] [translation] install `jupyterlab_server` to load translations: No module named 'jupyterlab_server' if not self.is_sys_prefix_ignored() and has_optional_dependency( translation:copy . build:icons:copy -- build:translation:copy federated_extensions:patch federated_extensions:settingsLooking for: []
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
To activate this environment, use
To deactivate an active environment, use
Looking for: ['xeus-python', 'forallpeople', 'ipycanvas']
https://repo.mamba.pm/emscripten-forge/emscripte.. 0.9s
https://repo.mamba.pm/emscripten-forge/noarch (c.. Checked 0.3s
warning libmamba Could not parse mod/etag header
[+] 0.3s
conda-forge/emscripten-wasm32 ━━━━━━━╸━━━━━━━━━━ 0.0 B @ ??.?MB/s 0.3s
conda-forge/emscripten-wasm32 @ ??.?MB/s 404 failed 0.3s
https://repo.mamba.pm/emscripten-forge/emscripte.. @ 74.3kB/s 0.6s
https://repo.mamba.pm/emscripten-forge/noarch 1.9kB @ 2.3kB/s 0.8s
conda-forge/noarch 15.2MB @ 18.3MB/s 0.9s
Transaction
Prefix: /tmp/tmpwsk5p5rz/env/envs/xeus-python-kernel
Updating specs:
Package Version Build Channel Size
──────────────────────────────────────────────────────────────────────────────────────────────────
Install:
──────────────────────────────────────────────────────────────────────────────────────────────────
Summary:
Install: 36 packages
Total download: 33MB
──────────────────────────────────────────────────────────────────────────────────────────────────
backcall 13.7kB @ 169.7kB/s 0.1s
widgetsnbextension 1.1MB @ 5.1MB/s 0.1s
emscripten-abi 10.9kB @ 7.2kB/s 1.5s
forallpeople 35.9kB @ 21.5kB/s 0.2s
pyjs 4.0MB @ 1.3MB/s 3.1s
jupyterlab_widgets 186.5kB @ 56.9kB/s 0.1s
ipycanvas 57.1kB @ 17.1kB/s 0.1s
xeus-python-shell 6.7kB @ 2.0kB/s 0.1s
numpy 7.5MB @ 1.9MB/s 3.7s
xeus-python-shell-raw 11.7kB @ 3.0kB/s 0.1s
ipywidgets 113.8kB @ 28.4kB/s 0.1s
pillow 1.1MB @ 242.3kB/s 4.7s
python 13.2MB @ 2.5MB/s 5.3s
ipython 1.6MB @ 292.3kB/s 2.1s
xeus-python 3.8MB @ 319.8kB/s 10.3s
'emscripten' is not a valid Platform
>>>>>>>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<<<<<<<
$ /home/connorferster/miniforge3/condabin/mamba install --yes --prefix /tmp/tmpwsk5p5rz/env/envs/xeus-python-kernel -c https://repo.mamba.pm/emscripten-forge -c conda-forge xeus-python forallpeople ipycanvasenvironment variables:
CIO_TEST=
CONDARC=/tmp/tmpwsk5p5rz/env/envs/xeus-python-kernel/.condarc
CONDA_DEFAULT_ENV=jupyterlite
CONDA_EXE=/home/connorferster/miniforge3/bin/conda
CONDA_PREFIX=/home/connorferster/miniforge3/envs/jupyterlite
CONDA_PREFIX_1=/home/connorferster/miniforge3
CONDA_PROMPT_MODIFIER=(jupyterlite)
CONDA_PYTHON_EXE=/home/connorferster/miniforge3/bin/python
CONDA_ROOT=/home/connorferster/miniforge3
CONDA_SHLVL=2
CURL_CA_BUNDLE=
DEFAULTS_PATH=/usr/share/gconf/pop.default.path
LD_PRELOAD=
MANDATORY_PATH=/usr/share/gconf/pop.mandatory.path
PATH=/home/connorferster/miniforge3/envs/jupyterlite/bin:/home/connorferste
r/miniforge3/condabin:/home/connorferster/.nvm/versions/node/v22.2.0/b
in:/home/connorferster/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/
sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/lo
cal/go/bin:/home/connorferster/.repobee/bin:/opt/ParaView-
5.11/bin:/usr/local/go/bin
REQUESTS_CA_BUNDLE=
SSL_CERT_FILE=
WINDOWPATH=2
populated config files : /home/connorferster/miniforge3/.condarc
/tmp/tmpwsk5p5rz/env/envs/xeus-python-kernel/.condarc
conda version : 24.3.0
conda-build version : not installed
python version : 3.10.14.final.0
solver : libmamba (default)
virtual packages : __conda=24.3.0=0
base environment : /home/connorferster/miniforge3 (writable)
conda av data dir : /home/connorferster/miniforge3/etc/conda
conda av metadata url : None
channel URLs : https://repo.mamba.pm/emscripten-forge/emscripten-wasm32
https://repo.mamba.pm/emscripten-forge/noarch
https://conda.anaconda.org/conda-forge/emscripten-wasm32
https://conda.anaconda.org/conda-forge/noarch
package cache : /home/connorferster/miniforge3/pkgs
/home/connorferster/.conda/pkgs
envs directories : /home/connorferster/miniforge3/envs
/home/connorferster/.conda/envs
platform : emscripten-wasm32
user-agent : conda/24.3.0 requests/2.31.0 CPython/3.10.14 Linux/6.4.6-76060406-generic pop/22.04 glibc/2.35 solver/libmamba conda-libmamba-solver/24.1.0 libmambapy/1.5.8
UID:GID : 1000:1000
netrc file : /home/connorferster/.netrc
offline mode : False
An unexpected error has occurred. Conda has prepared the above report.
If you suspect this error is being caused by a malfunctioning plugin,
consider using the --no-plugins option to turn off plugins.
Example: conda --no-plugins install
Alternatively, you can set the CONDA_NO_PLUGINS environment variable on
the command line to run the command without plugins enabled.
Example: CONDA_NO_PLUGINS=true conda install
[LiteBuildApp] ERROR | [lite] [post_build] [jupyterlite-xeus] [ERR] Command '['/home/connorferster/miniforge3/condabin/mamba', 'install', '--yes', '--prefix', PosixPath('/tmp/tmpwsk5p5rz/env/envs/xeus-python-kernel'), '-c', 'https://repo.mamba.pm/emscripten-forge', '-c', 'conda-forge', 'xeus-python', 'forallpeople', 'ipycanvas']' returned non-zero exit status 1.
Traceback (most recent call last):
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/doit_cmd.py", line 294, in run
return command.parse_execute(args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/cmd_base.py", line 150, in parse_execute
return self.execute(params, args)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/cmd_base.py", line 570, in execute
return self._execute(**exec_params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/cmd_run.py", line 265, in _execute
return runner.run_all(self.control.task_dispatcher())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/runner.py", line 254, in run_all
self.run_tasks(task_dispatcher)
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/runner.py", line 213, in run_tasks
node = task_dispatcher.generator.send(node)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/control.py", line 629, in _dispatcher_generator
next_step = node.step()
^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/control.py", line 336, in step
return next(self.generator)
^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/control.py", line 345, in _func
for value in decorated(*args, **kwargs):
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/control.py", line 473, in _add_task
new_tasks = generate_tasks(to_load, task_gen, ref.doc)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/loader.py", line 390, in generate_tasks
for task_dict, x_doc in flat_generator(gen_result, gen_doc):
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/doit/loader.py", line 27, in flat_generator
for item in gen:
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_core/manager.py", line 138, in _delayed_gather
yield from _gather()
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_core/manager.py", line 131, in _gather
raise error
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_core/manager.py", line 123, in _gather
for task in getattr(addon, attr)(self):
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_xeus/add_on.py", line 124, in post_build
self.create_prefix()
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_xeus/add_on.py", line 148, in create_prefix
create_conda_env_from_env_file(root_prefix, yaml_content, env_file.parent)
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_xeus/create_conda_env.py", line 53, in create_conda_env_from_env_file
create_conda_env_from_specs(
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_xeus/create_conda_env.py", line 69, in create_conda_env_from_specs
_create_conda_env_from_specs_impl(
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_xeus/create_conda_env.py", line 126, in _create_conda_env_from_specs_impl
return _create_env_with_config(MAMBA_COMMAND, prefix_path, specs, channels_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/site-packages/jupyterlite_xeus/create_conda_env.py", line 144, in _create_env_with_config
subprocess_run(
File "/home/connorferster/miniforge3/envs/jupyterlite/lib/python3.12/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/home/connorferster/miniforge3/condabin/mamba', 'install', '--yes', '--prefix', PosixPath('/tmp/tmpwsk5p5rz/env/envs/xeus-python-kernel'), '-c', 'https://repo.mamba.pm/emscripten-forge', '-c', 'conda-forge', 'xeus-python', 'forallpeople', 'ipycanvas']' returned non-zero exit status 1.
The text was updated successfully, but these errors were encountered: