Can't seemed to install this package on Python v3.8.2

[shchye95]

Hi guys,

I am currently working on a project using Python v3.8.2. We are also trying to leverage on editdistance for one of our features, but can't seemed to install the package and keep getting this error message during installation.

Failed to build editdistance
Installing collected packages: editdistance
    Running setup.py install for editdistance ... error
    ERROR: Command errored out with exit status 1:
     command: /Users/soonhang.chye/Desktop/rmtools/rmtoolsv3_venv/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/d1/51ns2n717hjb9gjy5d0yk289m4m6q4/T/pip-install-xtrjpzm2/editdistance_58c9e7c4d93f42fb8d63f2d7665b0040/setup.py'"'"'; __file__='"'"'/private/var/folders/d1/51ns2n717hjb9gjy5d0yk289m4m6q4/T/pip-install-xtrjpzm2/editdistance_58c9e7c4d93f42fb8d63f2d7665b0040/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/d1/51ns2n717hjb9gjy5d0yk289m4m6q4/T/pip-record-y40rdlwv/install-record.txt --single-version-externally-managed --compile --install-headers /Users/soonhang.chye/Desktop/rmtools/rmtoolsv3_venv/include/site/python3.8/editdistance
         cwd: /private/var/folders/d1/51ns2n717hjb9gjy5d0yk289m4m6q4/T/pip-install-xtrjpzm2/editdistance_58c9e7c4d93f42fb8d63f2d7665b0040/
    Complete output (116 lines):
    running install
    running build
    running build_py
    creating build
    creating build/lib.macosx-10.14.6-x86_64-3.8
    creating build/lib.macosx-10.14.6-x86_64-3.8/editdistance
    copying editdistance/__init__.py -> build/lib.macosx-10.14.6-x86_64-3.8/editdistance
    copying editdistance/_editdistance.h -> build/lib.macosx-10.14.6-x86_64-3.8/editdistance
    copying editdistance/def.h -> build/lib.macosx-10.14.6-x86_64-3.8/editdistance
    running build_ext
    building 'editdistance.bycython' extension
    creating build/temp.macosx-10.14.6-x86_64-3.8
    creating build/temp.macosx-10.14.6-x86_64-3.8/editdistance
    clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -iwithsysroot/System/Library/Frameworks/System.framework/PrivateHeaders -iwithsysroot/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.8/Headers -arch arm64 -arch x86_64 -I./editdistance -I/Users/soonhang.chye/Desktop/rmtools/rmtoolsv3_venv/include -I/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/include/python3.8 -c editdistance/_editdistance.cpp -o build/temp.macosx-10.14.6-x86_64-3.8/editdistance/_editdistance.o
    In file included from editdistance/_editdistance.cpp:16:
    In file included from /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/cstdlib:85:
    In file included from /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/stdlib.h:97:
    In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/stdlib.h:62:
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/cdefs.h:807:2: error: Unsupported architecture
    #error Unsupported architecture
     ^
    In file included from editdistance/_editdistance.cpp:16:
    In file included from /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/cstdlib:85:
    In file included from /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/stdlib.h:97:
    In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/stdlib.h:64:
    In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/_types.h:27:
    In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:33:
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/machine/_types.h:34:2: error: architecture not supported
    #error architecture not supported
     ^
    In file included from editdistance/_editdistance.cpp:16:
    In file included from /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/cstdlib:85:
    In file included from /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/stdlib.h:97:
    In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/stdlib.h:64:
    In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/_types.h:27:
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:55:9: error: unknown type name '__int64_t'
    typedef __int64_t       __darwin_blkcnt_t;      /* total blocks */
            ^
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:56:9: error: unknown type name '__int32_t'; did you mean '__int128_t'?
    typedef __int32_t       __darwin_blksize_t;     /* preferred block size */
            ^
    note: '__int128_t' declared here
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:57:9: error: unknown type name '__int32_t'; did you mean '__int128_t'?
    typedef __int32_t       __darwin_dev_t;         /* dev_t */
            ^
    note: '__int128_t' declared here
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:60:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
    typedef __uint32_t      __darwin_gid_t;         /* [???] process and group IDs */
            ^
    note: '__uint128_t' declared here
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:61:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
    typedef __uint32_t      __darwin_id_t;          /* [XSI] pid_t, uid_t, or gid_t*/
            ^
    note: '__uint128_t' declared here
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:62:9: error: unknown type name '__uint64_t'
    typedef __uint64_t      __darwin_ino64_t;       /* [???] Used for 64 bit inodes */
            ^
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:68:9: error: unknown type name '__darwin_natural_t'
    typedef __darwin_natural_t __darwin_mach_port_name_t; /* Used by mach */
            ^
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:70:9: error: unknown type name '__uint16_t'; did you mean '__uint128_t'?
    typedef __uint16_t      __darwin_mode_t;        /* [???] Some file attributes */
            ^
    note: '__uint128_t' declared here
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:71:9: error: unknown type name '__int64_t'
    typedef __int64_t       __darwin_off_t;         /* [???] Used for file sizes */
            ^
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:72:9: error: unknown type name '__int32_t'; did you mean '__int128_t'?
    typedef __int32_t       __darwin_pid_t;         /* [???] process and group IDs */
            ^
    note: '__int128_t' declared here
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:73:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
    typedef __uint32_t      __darwin_sigset_t;      /* [???] signal set */
            ^
    note: '__uint128_t' declared here
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:74:9: error: unknown type name '__int32_t'; did you mean '__int128_t'?
    typedef __int32_t       __darwin_suseconds_t;   /* [???] microseconds */
            ^
    note: '__int128_t' declared here
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:75:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
    typedef __uint32_t      __darwin_uid_t;         /* [???] user IDs */
            ^
    note: '__uint128_t' declared here
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:76:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
    typedef __uint32_t      __darwin_useconds_t;    /* [???] microseconds */
            ^
    note: '__uint128_t' declared here
    In file included from editdistance/_editdistance.cpp:16:
    In file included from /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/cstdlib:85:
    In file included from /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/stdlib.h:97:
    In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/stdlib.h:64:
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/_types.h:43:9: error: unknown type name '__uint32_t'; did you mean '__uint128_t'?
    typedef __uint32_t      __darwin_wctype_t;
            ^
    note: '__uint128_t' declared here
    In file included from editdistance/_editdistance.cpp:16:
    In file included from /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/cstdlib:85:
    In file included from /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/stdlib.h:97:
    In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/stdlib.h:66:
    In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/wait.h:109:
    In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/signal.h:82:
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/machine/signal.h:34:2: error: architecture not supported
    #error architecture not supported
     ^
    In file included from editdistance/_editdistance.cpp:16:
    In file included from /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/cstdlib:85:
    In file included from /Library/Developer/CommandLineTools/usr/bin/../include/c++/v1/stdlib.h:97:
    In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/stdlib.h:66:
    In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/wait.h:109:
    In file included from /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/sys/signal.h:146:
    /Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/machine/_mcontext.h:31:2: error: architecture not supported
    #error architecture not supported
     ^
    fatal error: too many errors emitted, stopping now [-ferror-limit=]
    20 errors generated.
    error: command 'clang' failed with exit status 1
    ----------------------------------------
ERROR: Command errored out with exit status 1: /Users/soonhang.chye/Desktop/rmtools/rmtoolsv3_venv/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/d1/51ns2n717hjb9gjy5d0yk289m4m6q4/T/pip-install-xtrjpzm2/editdistance_58c9e7c4d93f42fb8d63f2d7665b0040/setup.py'"'"'; __file__='"'"'/private/var/folders/d1/51ns2n717hjb9gjy5d0yk289m4m6q4/T/pip-install-xtrjpzm2/editdistance_58c9e7c4d93f42fb8d63f2d7665b0040/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/d1/51ns2n717hjb9gjy5d0yk289m4m6q4/T/pip-record-y40rdlwv/install-record.txt --single-version-externally-managed --compile --install-headers /Users/soonhang.chye/Desktop/rmtools/rmtoolsv3_venv/include/site/python3.8/editdistance Check the logs for full command output.

Any ideas on how to resolve this issue without downgrading my Python version? Thanks in advance 🙏

[shchye95]

Oh found the solution to my problem, will just be sharing the resolution here for future references.

facebookresearch/detectron2#2288

[gitclem]

Hi guys,

I am currently working on a project using Python v3.8.2. We are also trying to leverage on editdistance for one of our features, but can't seemed to install the package and keep getting this error message during installation.

Any ideas on how to resolve this issue without downgrading my Python version? Thanks in advance 🙏

I've also struggled with this. This is not just a problem with the editdistance package. It affects many (all?) python packages that require compiles with gcc/g++.

Apple has made a hash out of its linux-like build environment... There are a number of broken pieces that I have found:

• gcc/g++ aliased to clang/clang++ (the two are not completely compatible)
• The python 3.x installed on the Mac was built with clang, so that the python build tools try to use clang/clang++ related command line arguments instead of gcc/g++
• etc.

It is very hard to unwind this....

At this point, I'm building a Ubuntu Docker environment to avoid this. I'm planning to running in a Ubuntu environment but it's very annoying.

Building and using in Python 2.7 environment seems like the simplest solution until this problem gets fixed.

[sylvinus]

Successfully built on 3.8.2 macOS with ARCHFLAGS="-arch x86_64" pip3 install --user g2p