Builtin Org mode (8.x) breaking Spacemacs Org mode (9.x) #8414

RockyRoad29 · 2017-02-20T19:35:48Z

Description

Builtin Org mode (8.x) breaking Spacemacs Org mode (9.x)

Some org packages are loaded from org-plus-contrib ,
which currently depends on org version 9.0.x ,
while some other are loaded from the built-in emacs,
which is usually 8.x .

This causes many incompatibilities due e.g. to changes
of variable to functions, like
org-link-types ( change ),
or org-babel-check-confirm-evaluate

Reproduction guide 🪲

Install a fresh spacemacs from git master branch (0.200.7)
Evaluate lisp expressions, e.g. in ielm or *scratch* in lisp interaction mode.

; These are ok:
(org-version)
"9.0.5"
(locate-library "org")
"/home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org.elc"

; These are not:
(find-lisp-object-file-name #'org-version t)
"/usr/share/emacs/25.1/lisp/org/org.el"
(functionp 'org-link-types)
nil
(find-lisp-object-file-name 'org-link-types 'defvar)
"/usr/share/emacs/25.1/lisp/org/org.el"
(functionp 'org-babel-check-confirm-evaluate)
nil

Yes, it looks like (org-version) is lying !!!

However, the responsability of loading the libs properly comes to Spacemacs
I think.

I think that #'find-lisp-object-file-name is what is used
in #'describe-function but it didn't work as expected for
functions from 'ob. Anyway there is some discrepancy around.

Observed behaviour: 👀 💔

Some actions in org-mode fail and you'd see messages like:

File mode specification error: (void-function org-link-types)


org-element--set-regexps: Symbol’s function definition is void: org-link-types

(see more on #8074') .

Sometimes, I managed to get rid of these org-link-types errors, but then (with some recompilation voodoo) I found that source block evaluation was failing (package ob : org-babel):

Evaluation of this emacs-lisp code block is disabled.

(see more on #7641)

Expected behaviour: ❤️ 😄

I'd expect that all org modules would be loaded from elpa
(or none at worst) to ensure version comptability between libraries.

(find-lisp-object-file-name #'org-version t)
"/home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org.elc"

(functionp 'org-link-types)
t
(find-lisp-object-file-name 'org-link-types 'defvar)
nil
(find-lisp-object-file-name 'org-link-types t)
"/home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org.elc"

(functionp 'org-babel-check-confirm-evaluate)
t

Details about org libraries

I wrote a few helpers to explore the loaded libraries and here are
some results:

* Live Packages Exploration

776 total modules currently loaded, 561 registered features


** 34 modules matching "/org" (4%)
  - /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-clock.elc
  - /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-capture.elc
  - /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-agenda.elc
  - /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-table.elc
  - /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/ob-octave.elc
  - /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-table.el
  - /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/ob-octave.el
  - /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-version.el
  - /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-loaddefs.el
  - /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-plus-contrib-autoloads.el
  - /home/mich/.emacs.d/elpa/org-bullets-20140918.1137/org-bullets-autoloads.el
  - /usr/share/emacs/25.1/lisp/org/org.elc
  - /usr/share/emacs/25.1/lisp/org/org-macro.elc
  - /usr/share/emacs/25.1/lisp/org/org-footnote.elc
  - /usr/share/emacs/25.1/lisp/org/org-pcomplete.elc
  - /usr/share/emacs/25.1/lisp/org/org-list.elc
  - /usr/share/emacs/25.1/lisp/org/org-faces.elc
  - /usr/share/emacs/25.1/lisp/org/org-entities.elc
  - /usr/share/emacs/25.1/lisp/org/org-version.el
  - /usr/share/emacs/25.1/lisp/org/ob-emacs-lisp.elc
  - /usr/share/emacs/25.1/lisp/org/ob.elc
  - /usr/share/emacs/25.1/lisp/org/ob-tangle.elc
  - /usr/share/emacs/25.1/lisp/org/ob-ref.elc
  - /usr/share/emacs/25.1/lisp/org/ob-lob.elc
  - /usr/share/emacs/25.1/lisp/org/ob-table.elc
  - /usr/share/emacs/25.1/lisp/org/ob-exp.elc
  - /usr/share/emacs/25.1/lisp/org/org-src.elc
  - /usr/share/emacs/25.1/lisp/org/ob-keys.elc
  - /usr/share/emacs/25.1/lisp/org/ob-comint.elc
  - /usr/share/emacs/25.1/lisp/org/ob-core.elc
  - /usr/share/emacs/25.1/lisp/org/ob-eval.elc
  - /usr/share/emacs/25.1/lisp/org/org-compat.elc
  - /usr/share/emacs/25.1/lisp/org/org-macs.elc
  - /usr/share/emacs/25.1/lisp/org/org-loaddefs.el

** 13 modules matching "/ob" (1%)
  - /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/ob-octave.elc
  - /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/ob-octave.el
  - /usr/share/emacs/25.1/lisp/org/ob-emacs-lisp.elc
  - /usr/share/emacs/25.1/lisp/org/ob.elc
  - /usr/share/emacs/25.1/lisp/org/ob-tangle.elc
  - /usr/share/emacs/25.1/lisp/org/ob-ref.elc
  - /usr/share/emacs/25.1/lisp/org/ob-lob.elc
  - /usr/share/emacs/25.1/lisp/org/ob-table.elc
  - /usr/share/emacs/25.1/lisp/org/ob-exp.elc
  - /usr/share/emacs/25.1/lisp/org/ob-keys.elc
  - /usr/share/emacs/25.1/lisp/org/ob-comint.elc
  - /usr/share/emacs/25.1/lisp/org/ob-core.elc
  - /usr/share/emacs/25.1/lisp/org/ob-eval.elc

** 18 features matching "org.*" (3%)
  - org-mime: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-mime.elc
  - org-clock: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-clock.elc
  - org-capture: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-capture.elc
  - org-agenda: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-agenda.elc
  - org-table: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-table.elc
  - org: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org.elc
  - org-macro: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-macro.elc
  - org-footnote: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-footnote.elc
  - org-pcomplete: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-pcomplete.elc
  - org-list: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-list.elc
  - org-faces: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-faces.elc
  - org-entities: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-entities.elc
  - org-version: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-version.el
  - org-src: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-src.elc
  - org-compat: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-compat.elc
  - org-macs: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-macs.elc
  - org-loaddefs: /home/mich/.emacs.d/elpa/org-plus-contrib-20170210/org-loaddefs.el
  - georgian: /usr/share/emacs/25.1/lisp/language/georgian.elc

System Info 💻

OS: gnu/linux
Emacs: 25.1.1
Spacemacs: 0.200.7
Spacemacs branch: master (rev. c2774bc)
Graphic display: t
Distribution: spacemacs
Editing style: vim
Completion: helm
Layers:

(helm emacs-lisp)

System configuration features: XPM JPEG TIFF GIF PNG RSVG IMAGEMAGICK SOUND GPM DBUS GCONF GSETTINGS NOTIFY ACL GNUTLS LIBXML2 FREETYPE M17N_FLT LIBOTF XFT ZLIB TOOLKIT_SCROLL_BARS GTK3 X11

The text was updated successfully, but these errors were encountered:

RockyRoad29 · 2017-02-21T18:41:19Z

After some spacemacs restarts, the results seem to improve. Would there be some kind of load-path optimization ?

But even when all org-packages are loaded from elpa, the org-babel evaluation disabled error persists.

Maybe the problem could be that org-plus-contrib, although it contains all and more libs than org,
doesn't always stay above other org-related packages, in load-path. Here's what I have at the moment:

** Load Paths entries matching /o*
  - /home/mich/.emacs.d/elpa/ox-pandoc-20161125.35
  - /home/mich/.emacs.d/elpa/orgit-20170118.1647
  - /home/mich/.emacs.d/elpa/org-projectile-20161205.1508
  - /home/mich/.emacs.d/elpa/org-present-20141109.1756
  - /home/mich/.emacs.d/elpa/org-pomodoro-20161119.226
  - /home/mich/.emacs.d/elpa/org-mime-20170218.501
  - /home/mich/.emacs.d/elpa/org-download-20170213.1151
  - /home/mich/.emacs.d/elpa/org-bullets-20140918.1137
  - /home/mich/.emacs.d/elpa/org-20170210
  - /home/mich/.emacs.d/elpa/open-junk-file-20161210.314
  - /home/mich/.emacs.d/elpa/ob-http-20170218.503
  - /home/mich/.emacs.d/layers/+emacs/org/local/evil-org/
  - /home/mich/.emacs.d/elpa/org-plus-contrib-20170210
  - /usr/share/emacs/25.1/lisp/org
  - /usr/share/emacs/25.1/lisp/obsolete

So org-plus-contrib arrives nearly last ! .

Although it seems that an effort is being made in configuration-layer//package-install-org (I had no time to dive into it), but maybe load-path gets messed afterward ?

\o/ SUCCESS with org-babel evaluation !!

after specific recompilation of org-plus-contrib/ob-core.el .
Batch recompilation skips too many files...

CestDiego · 2017-03-22T00:13:29Z

Thank you for your work on this :)

syl20bnr · 2017-04-17T23:46:19Z

@RockyRoad29 Your issue seems to be fixed, if so you can close this issue :-)

absolutejam · 2017-08-01T20:32:48Z

Is this supposed to be sorted now?

Had a couple of new spacemacs installs over the last month or so and still getting the built-in org mode loading (And thus, stuff breaking 😢)

absolutejam · 2017-08-01T20:48:40Z

My bad. After searching my .spacemacs over and over, I still missed a segment of org-related config that was loading too early!

RockyRoad29 · 2017-11-02T13:31:06Z

@syl20bnr Actually I had kind of fixed it for myself working on the dev branch, which let me forget about this issue. Today I attempted an upgrade from the spacemacs home buffer (forgot about the dev branch), and all org-mode went in a mess again. I tried again from a clean install of the master branch (- Emacs: 25.3.1 - Spacemacs: 0.200.10) but the problem is still there. Batch compilation doesn't really help. I feel there should be something to do about compilation order. But I don't have much time to put in that now.

ibizaman · 2018-01-10T18:19:56Z

I didn't find this information easily, so I'm posting it here since it's the second time I need to find it.

To fix this, because I'm using multiple branches (mostly because I didn't clean up after switching to the develop/ branch), I needed to, from the root of the spacemacs git repo:

find **/org* -name "*.elc" -delete

Then from emacs:

spacemacs/recompile-elpa

syl20bnr · 2018-01-21T17:21:48Z

Should be fixed in develop, please verify.

RockyRoad29 · 2018-01-22T10:19:13Z

Thank you @syl20bnr . I upgraded last night to commit 723604d . As I figured out last weeks, org babel errors can often be solved by calling e.g. (require 'ob-shell) for each language as needed. I had to do it again after the upgrade, which I performed outside of spacemacs with a git fetch and git pull. I didn't have to recompile elpa.

I enjoyed then the SPC f e D feature to update my dotfile.

RockyRoad29 · 2018-01-23T01:31:30Z

Since, I got annoyed with org-table bug
https://www.mail-archive.com/emacs-orgmode@gnu.org/msg116990.html
so I decided to update all packages... and problems arise everywhere again,
first with complaints about org-link-types, then with org-babel disabled.

I can see in many places this advice of removing *.elc* files to force
recompilation, but it tends to worsen things for me, while day to day usage
tend to smooth them... until next upgrade/update.

What does help:spacemacs/recompile-elpa actually do ?

  (byte-recompile-directory package-user-dir nil t)

Would there be a misunderstanding of help:byte-recompile-directory ?

(byte-recompile-directory DIRECTORY &optional ARG FORCE)

Is called with ARG=nil, which means that
.el files with missing .elc files will not be compiled.
FORCE is t, which means we'll
keep on compiling what is alread up-to-date .

I think it is ARG=0 and FORCE=nil we need.

Knowing that many problems arise from site emacs packages shadowing spacemacs
newer versions, I propose this little script which seems to solve many
org-mode issues for me.

  (let (
        (org-base-dir (file-name-directory (find-library-name "org")))
        )
    (if
         (string-match (concat (file-name-as-directory package-user-dir) "org-plus-contrib") (find-library-name "org"))
        (byte-recompile-directory org-base-dir 0 nil)
      (message "unexpected location for org package : %s" org-base-dir)
      )
    )

Deleting all .elc files seems to me as increasing the risk of getting packages
compiled with older site versions. The documentation about "Loading"
(info:elisp#Loading) is a bit tough too, but it may be worth reading carefully
to know about the priorities (by suffix / by date / by path) and dependency
management. I did not yet.

Hoping this can help.

github-actions · 2020-02-29T00:49:22Z

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Please let us know if this issue is still valid!

RockyRoad29 mentioned this issue Feb 20, 2017

Resolving org version conflicts: removed org-plus-contrib packages from org-layer #8399

Closed

bmag added - Bug tracker - Loading Org labels Mar 2, 2017

xelibrion mentioned this issue Mar 12, 2017

MELPA package requires Emacs 24 gregsexton/ob-ipython#103

Closed

mnick mentioned this issue Mar 25, 2017

Org-mode export problems. #6296

Closed

syl20bnr added the Fixed in develop label Jan 21, 2018

d12frosted mentioned this issue Oct 16, 2018

set load-prefer-newer to t #11460

Closed

RockyRoad29 mentioned this issue Dec 3, 2018

Recompiling Elpa: don't skip missing .elc files #11679

Merged

duianto mentioned this issue May 6, 2019

Emacs fails to start with error "Symbol's value as variable is void: \213" #11585

Closed

github-actions bot added the stale marked as a stale issue/pr (usually by a bot) label Feb 29, 2020

github-actions bot closed this as completed May 29, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Builtin Org mode (8.x) breaking Spacemacs Org mode (9.x) #8414

Builtin Org mode (8.x) breaking Spacemacs Org mode (9.x) #8414

RockyRoad29 commented Feb 20, 2017

RockyRoad29 commented Feb 21, 2017 •

edited

Loading

RockyRoad29 commented Feb 22, 2017 •

edited

Loading

RockyRoad29 commented Feb 23, 2017

CestDiego commented Mar 22, 2017

syl20bnr commented Apr 17, 2017

absolutejam commented Aug 1, 2017

absolutejam commented Aug 1, 2017

RockyRoad29 commented Nov 2, 2017

ibizaman commented Jan 10, 2018

syl20bnr commented Jan 21, 2018

RockyRoad29 commented Jan 22, 2018 •

edited

Loading

RockyRoad29 commented Jan 23, 2018

github-actions bot commented Feb 29, 2020

Builtin Org mode (8.x) breaking Spacemacs Org mode (9.x) #8414

Builtin Org mode (8.x) breaking Spacemacs Org mode (9.x) #8414

Comments

RockyRoad29 commented Feb 20, 2017

Description

Reproduction guide 🪲

Details about org libraries

System Info 💻

RockyRoad29 commented Feb 21, 2017 • edited Loading

RockyRoad29 commented Feb 22, 2017 • edited Loading

RockyRoad29 commented Feb 23, 2017

\o/ SUCCESS with org-babel evaluation !!

CestDiego commented Mar 22, 2017

syl20bnr commented Apr 17, 2017

absolutejam commented Aug 1, 2017

absolutejam commented Aug 1, 2017

RockyRoad29 commented Nov 2, 2017

ibizaman commented Jan 10, 2018

syl20bnr commented Jan 21, 2018

RockyRoad29 commented Jan 22, 2018 • edited Loading

RockyRoad29 commented Jan 23, 2018

github-actions bot commented Feb 29, 2020

RockyRoad29 commented Feb 21, 2017 •

edited

Loading

RockyRoad29 commented Feb 22, 2017 •

edited

Loading

RockyRoad29 commented Jan 22, 2018 •

edited

Loading