UnicodeEncodeError on latest docker debian image #176

slimm609 · 2018-03-17T23:11:58Z

Getting this error on the latest docker debian image with python-dev installed

     File "<string>", line 1, in <module>
     File "/tmp/pip-build-omJzX6/smart-open/setup.py", line 72, in <module>
       'Topic :: Database :: Front-Ends',
     File "/usr/local/lib/python2.7/dist-packages/setuptools/__init__.py", line 129, in setup
       return distutils.core.setup(**attrs)
     File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
       dist.run_commands()
     File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
       self.run_command(cmd)
     File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
       cmd_obj.run()
     File "/usr/local/lib/python2.7/dist-packages/setuptools/command/install.py", line 61, in run
       return orig.install.run(self)
     File "/usr/lib/python2.7/distutils/command/install.py", line 613, in run
       self.run_command(cmd_name)
     File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
       self.distribution.run_command(command)
     File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
       cmd_obj.run()
     File "/usr/local/lib/python2.7/dist-packages/setuptools/command/install_egg_info.py", line 34, in run
       self.run_command('egg_info')
     File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
       self.distribution.run_command(command)
     File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
       cmd_obj.run()
     File "/usr/local/lib/python2.7/dist-packages/setuptools/command/egg_info.py", line 271, in run
       writer(self, ep.name, os.path.join(self.egg_info, ep.name))
     File "/usr/local/lib/python2.7/dist-packages/setuptools/command/egg_info.py", line 604, in write_pkg_info
       metadata.write_pkg_info(cmd.egg_info)
     File "/usr/lib/python2.7/distutils/dist.py", line 1106, in write_pkg_info
       self.write_pkg_file(pkg_info)
     File "/usr/local/lib/python2.7/dist-packages/setuptools/dist.py", line 76, in write_pkg_file
       file.write('%s: %s\n' % (field, attr_val))
   UnicodeEncodeError: 'ascii' codec can't encode character u'\u0158' in position 14: ordinal not in range(128)

Command "/usr/bin/python -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-omJzX6/smart-open/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-CmK_oj-record/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /tmp/pip-build-omJzX6/smart-open/

The text was updated successfully, but these errors were encountered:

xCatG · 2018-03-18T01:28:57Z

I am seeing this with regular pip install smart-open as well... :-(

dannyOhNo · 2018-03-18T02:21:48Z

This isn't exclusive to Docker... able to reproduce on Python 2.7.10 via virtualenv...

virtualenv venv
. venv/bin/activate
python setup.py install

For reference...
uname -a

Darwin dannys-MBP 17.4.0 Darwin Kernel Version 17.4.0: Sun Dec 17 09:19:54 PST 2017; root:xnu-4570.41.2~1/RELEASE_X86_64 x86_64

mpenkov · 2018-03-18T02:32:38Z

Python 3.6.4 (default, Jan  6 2018, 11:51:59)
[GCC 4.2.1 Compatible Apple LLVM 9.0.0 (clang-900.0.39.2)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> print('\u0158')
Ř
>>>
$ grep -R "Ř" .
./issue152/so1.5.5/lib/python3.6/site-packages/smart_open-1.5.5.dist-info/DESCRIPTION.rst:Copyright (c) 2015-now `Radim Řehůřek <http://radimrehurek.com>`_.
./issue152/so1.5.5/lib/python3.6/site-packages/smart_open-1.5.5.dist-info/METADATA:Author: Radim Řehůřek
./issue152/so1.5.5/lib/python3.6/site-packages/smart_open-1.5.5.dist-info/METADATA:Copyright (c) 2015-now `Radim Řehůřek <http://radimrehurek.com>`_.
./issue152/so1.5.3/lib/python3.6/site-packages/smart_open-1.5.3.dist-info/DESCRIPTION.rst:Copyright (c) 2015-now `Radim Řehůřek <http://radimrehurek.com>`_.
./issue152/so1.5.3/lib/python3.6/site-packages/smart_open-1.5.3.dist-info/METADATA:Author: Radim Řehůřek
./issue152/so1.5.3/lib/python3.6/site-packages/smart_open-1.5.3.dist-info/METADATA:Copyright (c) 2015-now `Radim Řehůřek <http://radimrehurek.com>`_.
./issue152/so1.5.4/lib/python3.6/site-packages/smart_open-1.5.4.dist-info/DESCRIPTION.rst:Copyright (c) 2015-now `Radim Řehůřek <http://radimrehurek.com>`_.
./issue152/so1.5.4/lib/python3.6/site-packages/smart_open-1.5.4.dist-info/METADATA:Author: Radim Řehůřek
./issue152/so1.5.4/lib/python3.6/site-packages/smart_open-1.5.4.dist-info/METADATA:Copyright (c) 2015-now `Radim Řehůřek <http://radimrehurek.com>`_.
./LICENSE:Copyright (c) 2015 Radim Řehůřek
./smart_open.egg-info/PKG-INFO:Author: Radim Řehůřek
./smart_open.egg-info/PKG-INFO:        Copyright (c) 2015-now `Radim Řehůřek <http://radimrehurek.com>`_.
./setup.py:    author=u'Radim Řehůřek',
./setup.py:    maintainer=u'Radim Řehůřek',
./README.rst:Copyright (c) 2015-now `Radim Řehůřek <http://radimrehurek.com>`_.

Sounds like Python 2 is having problems encoding the package info. It's strange that this hasn't come up before...

slimm609 · 2018-03-18T02:37:19Z

not sure. sudo pip install on 2.7 works but pip install as a user does not work

mpenkov · 2018-03-18T02:39:13Z

@slimm609 Could you update setup.py with the following changes and let me know if the problem persists?

index 319b558..6e59568 100644
--- a/setup.py
+++ b/setup.py
@@ -31,9 +31,9 @@ setup(
     packages=find_packages(),
     package_data={"smart_open.tests": ["test_data/*gz"]},

-    author=u'Radim Řehůřek',
+    author=u'Radim Řehůřek'.encode('utf-8'),
     author_email='me@radimrehurek.com',
-    maintainer=u'Radim Řehůřek',
+    maintainer=u'Radim Řehůřek'.encode('utf-8'),
     maintainer_email='me@radimrehurek.com',

     url='https://github.com/piskvorky/smart_open',```

dannyOhNo · 2018-03-18T02:43:09Z

Issue resolved: #177

cc @mpenkov

slimm609 · 2018-03-18T02:52:37Z

#177 does fix the issue

dannyOhNo · 2018-03-18T03:05:58Z

Seems to be an issue with python 3.3.6.. trying to resolve now

mpenkov · 2018-03-18T03:33:25Z

@baldwindc @slimm609 I think it's preferable to work around this issue without butchering the author's name. Is encoding it to UTF-8 not sufficient?

menshikh-iv · 2018-03-18T06:40:34Z

Thanks fresh setuptools==39.0.0 for this problem, they released new version yesterday https://pypi.python.org/pypi/setuptools

schlueter · 2018-03-18T07:45:47Z

Good find @menshikh-iv. Based on that hint, I found that the last few versions (all released this weekend) suffer this issue. I had to go back to setuptools==38.6.1, which was added to the changelog 2 days ago. That works perfectly though, just:

pip install -U setuptools==38.6.1
pip install smart_open

menshikh-iv · 2018-03-18T07:49:05Z

Connected with pypa/setuptools#1297

menshikh-iv · 2018-03-18T10:28:47Z

@slimm609 @xCatG @baldwindc @schlueter fixed in #178, smart_open==1.5.7 (that contained this fix) already released https://pypi.python.org/pypi/smart_open.

schlueter · 2018-03-18T18:22:16Z

With the release of setuptools==39.0.1 today, smart_open==1.5.6 may be installed without issues. So if Radim Řehůřek would like to be referred to with his accents intact, that won't cause issues now.

pypa/setuptools#1300 was ultimately the fix to the problem.

menshikh-iv · 2018-03-18T23:14:05Z

@schlueter don't worry, I asked him before a change

* Support opening pathlib.Path * Edited opening pathlib.Path test which skips if not available * Added pathlib2 backport support including tests * Added pathlib2 to test_require for supporting pathlib backport * Fix author/maintainer fields in `setup.py`, avoid bug from `setuptools==39.0.0`. Fix #176 (#178) * fix author/maintainer fields * attemp to resolve problem with botocore * try other workaround for botocore * next attemp * bump version to 1.5.7 * bump changelos to 1.5.7 * Reduced code logic redundancy in pathlib.Path test

This was referenced Mar 18, 2018

Fix tests for EuclideanKeyedVectors.similarity_matrix. Fix #1961 piskvorky/gensim#1984

Merged

Fix author/maintainer fields in setup.py, avoid bug from setuptools==39.0.0. Fix #176 #178

Merged

menshikh-iv closed this as completed in 61f5d23 Mar 18, 2018

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

UnicodeEncodeError on latest docker debian image #176

UnicodeEncodeError on latest docker debian image #176

slimm609 commented Mar 17, 2018

xCatG commented Mar 18, 2018

dannyOhNo commented Mar 18, 2018 •

edited

Loading

mpenkov commented Mar 18, 2018

slimm609 commented Mar 18, 2018

mpenkov commented Mar 18, 2018

dannyOhNo commented Mar 18, 2018 •

edited

Loading

slimm609 commented Mar 18, 2018

dannyOhNo commented Mar 18, 2018

mpenkov commented Mar 18, 2018

menshikh-iv commented Mar 18, 2018

schlueter commented Mar 18, 2018 •

edited

Loading

menshikh-iv commented Mar 18, 2018

menshikh-iv commented Mar 18, 2018 •

edited

Loading

schlueter commented Mar 18, 2018 •

edited

Loading

menshikh-iv commented Mar 18, 2018

UnicodeEncodeError on latest docker debian image #176

UnicodeEncodeError on latest docker debian image #176

Comments

slimm609 commented Mar 17, 2018

xCatG commented Mar 18, 2018

dannyOhNo commented Mar 18, 2018 • edited Loading

mpenkov commented Mar 18, 2018

slimm609 commented Mar 18, 2018

mpenkov commented Mar 18, 2018

dannyOhNo commented Mar 18, 2018 • edited Loading

slimm609 commented Mar 18, 2018

dannyOhNo commented Mar 18, 2018

mpenkov commented Mar 18, 2018

menshikh-iv commented Mar 18, 2018

schlueter commented Mar 18, 2018 • edited Loading

menshikh-iv commented Mar 18, 2018

menshikh-iv commented Mar 18, 2018 • edited Loading

schlueter commented Mar 18, 2018 • edited Loading

menshikh-iv commented Mar 18, 2018

dannyOhNo commented Mar 18, 2018 •

edited

Loading

dannyOhNo commented Mar 18, 2018 •

edited

Loading

schlueter commented Mar 18, 2018 •

edited

Loading

menshikh-iv commented Mar 18, 2018 •

edited

Loading

schlueter commented Mar 18, 2018 •

edited

Loading