anaconda upload silently fails #501

stas00 · 2018-09-26T17:59:29Z

Hi,

I'm experiencing weird issues with anaconda upload silently failing.

built a package:

conda skeleton pypi fastprogress
conda-build fastprogress

all was successful (this is just a pure python one-file module).

tried to upload:

anaconda upload fastprogress-0.1.5-py36_0.tar.bz2
Using Anaconda API: https://api.anaconda.org
Using "stason" as upload username
Processing 'fastprogress-0.1.5-py36_0.tar.bz2'
Detecting file type...
File type is "conda"
Extracting conda package attributes for upload
Creating package "fastprogress"

that's it. Nothing happens, no error message, nothing gets uploaded. (nothing appears under https://anaconda.org/stason/repo)

Please note that another team member was able to successfully upload this same package from his setup, but it doesn't work on mine:

conda-build 3.15.1
conda 4.5.11
anaconda Command line client (version 1.7.2)
Python 3.6.6 :: Anaconda custom (64-bit)
ubuntu 18.04

Thank you.

The text was updated successfully, but these errors were encountered:

goanpeca · 2018-09-26T20:30:33Z

What version of anaconda client was your team member using?

stas00 · 2018-09-26T20:39:42Z

His is Command line client (version 1.6.14)

But I can't see how that information would help me, if the client is not behaving properly. Surely it should have said that there is some problem, yet it does nothing. Does it make sense?

Thank you.

stas00 · 2018-09-26T21:08:37Z

I did some more testing and was able to create (via conda skeleton pypi), build and upload other modules w/o any problems.

I also tested that this package fails with older anaconda client (1.6.5). So it must be something about the package.

You should be able to reproduce that on your side, since it was just the straightforward:

conda skeleton pypi fastprogress
conda-build fastprogress

goanpeca · 2018-09-26T21:28:36Z

@stas00 could you attach the package so I can take a look :-) ?

stas00 · 2018-09-26T21:44:00Z

it won't let me upload this type of file, here it is on dropbox

And thank you for your help, @goanpeca

stas00 · 2018-09-30T02:17:22Z

Were you able to get the package via dropbox, @goanpeca?

goanpeca · 2018-09-30T03:51:04Z

@stas00 I did, but I will take a look on monday!

stas00 · 2018-09-30T04:05:37Z

some additional info:

I'm able to upload this package under a different username -u fastai, a group, to which I'm allowed to upload to.
I'm able to upload other packages under my own username -u stason

mcg1969 · 2018-10-02T01:44:04Z

@goanpeca, @ericdill and I just discovered a silent failure wil occur in another instance as well: when using the --private flag on an organization (-u) that doesn't have private package privileges.

mcg1969 · 2018-10-02T01:44:32Z

So my guess is there is some sort of permissions failure that goes undetected by the client.

goanpeca · 2018-10-02T02:32:21Z

@mcg1969 thanks for the tip. I will add some testing

damianavila · 2018-10-29T23:23:14Z

I have seen the same... I tried with anaconda-client 1.5.x and then I saw the issue, the token was expired... somehow the latest anaconda-client version eats that info when it fails, I think.

goanpeca · 2018-10-29T23:37:44Z

@damianavila yes, the clien has been eating a lot of error messages lately, the exception handling needs to be fixed.

bryevdv · 2018-10-31T22:44:14Z

This same issue (evidently) just botched a bokeh release. Tried restarting, did not help.

hemenkapadia · 2018-11-02T22:59:20Z

I am also facing a similar issue while uploading package to anaconda cloud

hemen  ~/Downloads/h2oai_clinet  anaconda -v --show-traceback upload -u h2oai h2oai_client-1.4.0-py36_d83ac6f_45.tar.bz2 
Using Anaconda API: https://api.anaconda.org
[DEBUG] Found login token: /home/hemen/.config/binstar/https%3A%2F%2Fapi.anaconda.org.token
Using "h2oai" as upload username
Processing 'h2oai_client-1.4.0-py36_d83ac6f_45.tar.bz2'
Detecting file type...
[DEBUG] Testing if conda package ..
[DEBUG] This is a conda package
File type is "conda"
Extracting conda package attributes for upload
Creating package "h2oai_client"
Creating release "1.4.0"
Uploading file "h2oai/h2oai_client/1.4.0/noarch/h2oai_client-1.4.0-py36_d83ac6f_45.tar.bz2"
 hemen  ~/Downloads/h2oai_clinet  1  conda verify h2oai_client-1.4.0-py36_d83ac6f_45.tar.bz2 
Verifying h2oai_client-1.4.0-py36_d83ac6f_45.tar.bz2...
 hemen  ~/Downloads/h2oai_clinet  echo $?
0
 hemen  ~/Downloads/h2oai_clinet  conda -v
usage: conda [-h] [-V] command ...
conda: error: the following arguments are required: command
 hemen  ~/Downloads/h2oai_clinet  2  conda -V
conda 4.5.11
 hemen  ~/Downloads/h2oai_clinet  conda build -V
conda-build 3.16.2
 hemen  ~/Downloads/h2oai_clinet  anaconda -V
anaconda Command line client (version 1.7.2)
 hemen  ~/Downloads/h2oai_clinet 

The page at (https://anaconda.org/h2oai) lists that package h2oai_client was created. However https://anaconda.org/h2oai/h2oai_client indicates no files exist in the package.

Any help on how to resolve this issue would be greatly appreciated.

hemenkapadia · 2018-11-07T02:43:39Z

I would consider this as a regression for anaconda clinet. Downgrading the client to 1.5.5 seems to resolve the issue. Now i see the package released to anaconda.org ...

https://anaconda.org/h2oai/h2oai_client/files

bkreider · 2019-03-07T23:27:25Z

I think i have narrowed this down. If you do a echo $? anaconda-client properly shows an error code of 1, but no output.

In upload.py:245 it needs to catch the exception. This snippet shows catching the exception, logging it and re-raising it:

        try:
            logger.info("About to upload")
            upload_info = aserver_api.upload(username, package_name, version, file_attrs['basename'], fd,
                                             binstar_package_type, args.description,
                                             dependencies=file_attrs.get('dependencies'), attrs=file_attrs['attrs'],
                                             channels=args.labels, callback=upload_print_callback(args))
            logger.info("after upload")
        except errors.Conflict:
            logger.info("Inside Except")
            upload_info = {}
            if args.mode != 'skip':
                logger.info('Distribution already exists. Please use the -i/--interactive or --force or --skip options '
                            'or `anaconda remove %s/%s/%s/%s', username, package_name, version, file_attrs['basename'])
                raise
            else:
                logger.info('Distribution already exists. Skipping upload.\n')
        except Exception as e:
                logger.info('Uncaught exception: %s' %  (str(e),))
                raise

The output looks like this:

Using Anaconda API: https://api.anaconda.org
Using "...." as upload username
Processing '/home/travis/miniconda/conda-bld/linux-64/......tar.bz2'
Detecting file type...
File type is "conda"
Extracting conda package attributes for upload
Creating package "......"
Creating release "1.5.1"
Uploading file "...."
About to upload
Uncaught exception: (u'Authentication token has expired', 401)

bashtage · 2019-03-29T13:08:42Z

Just got caught by @bkreider same issue -- token expired overnight and uploads were silently failing. Would really help to get a better error.

mliu49 · 2019-06-14T23:59:51Z

Also ran into this issue. Travis build finished successfully but uploads were not showing up on anaconda.org.

Came across this and realized that the token had expired. Hopefully this can be fixed soon.

vfdev-5 · 2019-12-23T17:12:29Z

I have a similar issue to upload a package to the organization where I have rights to upload, my token is valid. CMD error is 1 and no error message.

Thanks to @bkreider and his snippet, I could get the exact error with exceeded storage size.

hmaarrfk · 2020-05-31T14:21:23Z

Definitely annoying to have silent failures on permissions.

Using your trick @bkreider I was able to pinpoint that I needed write access to the API in addition to:
"All operations on Conda Repositories"

Maybe this is just a private package issue?

mcg1969 · 2020-06-01T03:54:22Z

@bkreider let's huddle on this very soon and work on getting a point release out there.

ileasile · 2020-08-05T14:00:18Z

Hello @mcg1969, I started to get silent failures a few days ago, without any changes in environment or package itself (tried building from the same branch). Upload looks like this:

C:\Projects\kotlin-jupyter>anaconda upload -u jetbrains-dev artifacts/kotlin-jupyter-kernel-0.8.2.53.dev3-py_0.tar.bz2
Using Anaconda API: https://api.anaconda.org
Using "jetbrains-dev" as upload username
Processing 'artifacts/kotlin-jupyter-kernel-0.8.2.53.dev3-py_0.tar.bz2'
Detecting file type...
File type is "conda"
Extracting conda package attributes for upload
Creating package "kotlin-jupyter-kernel"
Creating release "0.8.2.53.dev3"
Uploading file "jetbrains-dev/kotlin-jupyter-kernel/0.8.2.53.dev3/noarch/kotlin-jupyter-kernel-0.8.2.53.dev3-py_0.tar.bz2"

Process returns 1 exit code and gives no info about errors. This issue is reproducible in several different environments (locally and on CI in Docker container). My anaconda-client version is 1.7.2.

Could you please help me with investigating?

ileasile · 2020-08-05T14:49:34Z

I figured it out using technique mentioned by @bkreider :

Storage requirements exceeded (3221225472 bytes). Payment is required to add a file. Please go to https://anaconda.org/binstar.settings/billing to update your plan

ndevenish · 2020-11-14T19:14:16Z

I just had this issue also, silent failure; added the code from @bkreider and got:

Uncaught exception: module 'base64' has no attribute 'encodestring'

piyueh · 2021-05-21T20:24:24Z

I'm also having Uncaught exception: module 'base64' has no attribute 'encodestring'. The traceback is hidden by default because sys.excepthook is overwritten at line 90 in cli.py. To see the error traceback, in addition to @bkreider 's trick, I also had to comment out line 90 in cli.py. Here's the traceback I got:

Uncaught exception: module 'base64' has no attribute 'encodestring'
Traceback (most recent call last):
  File "<prefix>/bin/anaconda", line 11, in <module>
    sys.exit(main())
  File "<prefix>/lib/python3.9/site-packages/binstar_client/scripts/cli.py", line 159, in main
    binstar_main(command_module, args, exit,
  File "<prefix>/lib/python3.9/site-packages/binstar_client/scripts/cli.py", line 139, in binstar_main
    return args.main(args)
  File "<prefix>/lib/python3.9/site-packages/binstar_client/commands/upload.py", line 340, in main
    package_info = upload_package(
  File "<prefix>/lib/python3.9/site-packages/binstar_client/commands/upload.py", line 236, in upload_package
    upload_info = aserver_api.upload(username, package_name, version, file_attrs['basename'], fd,
  File "<prefix>/lib/python3.9/site-packages/binstar_client/__init__.py", line 530, in upload
    _hexmd5, b64md5, size = compute_hash(fd, size=size)
  File "<prefix>/lib/python3.9/site-packages/binstar_client/utils/__init__.py", line 52, in compute_hash
    b64encode = getattr(base64, 'encodebytes', base64.encodestring)
AttributeError: module 'base64' has no attribute 'encodestring'

Python version 3.9.5, installed through conda. anaconda-client's version is 1.7.1 py39h06a4308_0.
Downgrade to Python 3.8, everything works fine then.

Viech · 2021-05-24T14:18:52Z

It's important to note that conda install anaconda-client will by default update Python, hence causing the hidden AttributeError: module 'base64' has no attribute 'encodestring' exception even if you are using, say, the conda/miniconda3 docker image that still ships Python 3.7.3 initially. You can avoid this by writing e.g. conda install python=3.8 anaconda-client.

If this does not help, see my comment in #564 on how to monkey-patch anaconda-client within a temporary conda environment using the patch proposed by @bkreider. This should give you an error message.

hemenkapadia mentioned this issue Nov 27, 2018

Anaconda client fails to upload released file to anconda cloud h2oai/poboys_conda_package_server#2

Closed

nathanwilk7 mentioned this issue Dec 6, 2018

Only avoid logging KeyboardInterrupt's #506

Closed

mjscosta pushed a commit to mjscosta/anaconda-client that referenced this issue Dec 11, 2018

fix for issue anaconda#501

eea8529

mjscosta mentioned this issue Dec 11, 2018

fix for issue #501 #507

Open

bkreider mentioned this issue Apr 10, 2019

anaconda upload fails silently if the user's storage limit is exceeded #516

Open

dzelge pushed a commit to dzelge/anaconda-client that referenced this issue Jul 11, 2019

fix for issue anaconda#501

2cb8d59

ezyang mentioned this issue Jan 13, 2020

0.3.2 point release. pytorch/audio#354

Merged

6 tasks

mithro mentioned this issue Jan 15, 2020

Anaconda doesn't failed on expired authentication token #536

Open

kowalewskijan referenced this issue in QuickLogic-Corp/ql_conda_eda Aug 14, 2020

travis: build yosys-plugins after yosys

70b24b9

ndevenish mentioned this issue Nov 14, 2020

Silent failure to upload on Python 3.9 #555

Closed

bkpoon mentioned this issue Jan 13, 2021

anaconda-client with Python 3.9 does not upload files to anaconda.org conda-forge/anaconda-client-feedstock#25

Closed

csukuangfj linked a pull request May 17, 2021 that will close this issue

Print informative error messages if upload fails. #564

Open

timosachsenberg mentioned this issue Feb 7, 2023

conda builds not working anymore OpenMS/OpenMS#6514

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

anaconda upload silently fails #501

anaconda upload silently fails #501

stas00 commented Sep 26, 2018

goanpeca commented Sep 26, 2018

stas00 commented Sep 26, 2018 •

edited

Loading

stas00 commented Sep 26, 2018 •

edited

Loading

goanpeca commented Sep 26, 2018

stas00 commented Sep 26, 2018 •

edited

Loading

stas00 commented Sep 30, 2018

goanpeca commented Sep 30, 2018

stas00 commented Sep 30, 2018 •

edited

Loading

mcg1969 commented Oct 2, 2018

mcg1969 commented Oct 2, 2018

goanpeca commented Oct 2, 2018

damianavila commented Oct 29, 2018 •

edited

Loading

goanpeca commented Oct 29, 2018

bryevdv commented Oct 31, 2018

hemenkapadia commented Nov 2, 2018

hemenkapadia commented Nov 7, 2018

bkreider commented Mar 7, 2019

bashtage commented Mar 29, 2019

mliu49 commented Jun 14, 2019

vfdev-5 commented Dec 23, 2019 •

edited

Loading

hmaarrfk commented May 31, 2020

mcg1969 commented Jun 1, 2020

ileasile commented Aug 5, 2020

ileasile commented Aug 5, 2020

ndevenish commented Nov 14, 2020

piyueh commented May 21, 2021 •

edited

Loading

Viech commented May 24, 2021

anaconda upload silently fails #501

anaconda upload silently fails #501

Comments

stas00 commented Sep 26, 2018

goanpeca commented Sep 26, 2018

stas00 commented Sep 26, 2018 • edited Loading

stas00 commented Sep 26, 2018 • edited Loading

goanpeca commented Sep 26, 2018

stas00 commented Sep 26, 2018 • edited Loading

stas00 commented Sep 30, 2018

goanpeca commented Sep 30, 2018

stas00 commented Sep 30, 2018 • edited Loading

mcg1969 commented Oct 2, 2018

mcg1969 commented Oct 2, 2018

goanpeca commented Oct 2, 2018

damianavila commented Oct 29, 2018 • edited Loading

goanpeca commented Oct 29, 2018

bryevdv commented Oct 31, 2018

hemenkapadia commented Nov 2, 2018

hemenkapadia commented Nov 7, 2018

bkreider commented Mar 7, 2019

bashtage commented Mar 29, 2019

mliu49 commented Jun 14, 2019

vfdev-5 commented Dec 23, 2019 • edited Loading

hmaarrfk commented May 31, 2020

mcg1969 commented Jun 1, 2020

ileasile commented Aug 5, 2020

ileasile commented Aug 5, 2020

ndevenish commented Nov 14, 2020

piyueh commented May 21, 2021 • edited Loading

Viech commented May 24, 2021

stas00 commented Sep 26, 2018 •

edited

Loading

stas00 commented Sep 26, 2018 •

edited

Loading

stas00 commented Sep 26, 2018 •

edited

Loading

stas00 commented Sep 30, 2018 •

edited

Loading

damianavila commented Oct 29, 2018 •

edited

Loading

vfdev-5 commented Dec 23, 2019 •

edited

Loading

piyueh commented May 21, 2021 •

edited

Loading