Transaction Error: Entity cannot be retracted

[den1k]

I have a strange case where an entity cannot be retracted. Working on a repro. Logging the error here for now in case it helps

(db/transact! [[:db/retractEntity 291]])
Execution error (NullPointerException) at datalevin.db/transact-retract-datom (db.cljc:868).
Cannot read field "e" because "d" is null
java.lang.NullPointerException: Cannot read field "e" because "d" is null
	at datalevin.db$transact_retract_datom.invokeStatic(db.cljc:868)
	at datalevin.db$transact_retract_datom.invoke(db.cljc:866)
	at clojure.lang.ArrayChunk.reduce(ArrayChunk.java:63)
	at clojure.core.protocols$fn__8244.invokeStatic(protocols.clj:136)
	at clojure.core.protocols$fn__8244.invoke(protocols.clj:124)
	at clojure.core.protocols$fn__8204$G__8199__8213.invoke(protocols.clj:19)
	at clojure.core.protocols$seq_reduce.invokeStatic(protocols.clj:31)
	at clojure.core.protocols$fn__8236.invokeStatic(protocols.clj:75)
	at clojure.core.protocols$fn__8236.invoke(protocols.clj:75)
	at clojure.core.protocols$fn__8178$G__8173__8191.invoke(protocols.clj:13)
	at clojure.core$reduce.invokeStatic(core.clj:6886)
	at clojure.core$reduce.invoke(core.clj:6868)
	at datalevin.db$local_transact_tx_data$fn__12742.invoke(db.cljc:1228)
	at datalevin.db$local_transact_tx_data.invokeStatic(db.cljc:996)
	at datalevin.db$local_transact_tx_data.invoke(db.cljc:980)
	at datalevin.db$transact_tx_data.invokeStatic(db.cljc:1286)
	at datalevin.db$transact_tx_data.invoke(db.cljc:1262)
	at datalevin.core$with.invokeStatic(core.cljc:366)
	at datalevin.core$with.invoke(core.cljc:360)
	at datalevin.core$with.invokeStatic(core.cljc:363)
	at datalevin.core$with.invoke(core.cljc:360)
	at datalevin.core$_transact_BANG_$fn__15726$fn__15735$helper15739__15740$helper15741__15742.invokePrim(core.cljc:621)
	at datalevin.core$_transact_BANG_$fn__15726$fn__15735$helper15739__15740$helper15741__15742.invoke(core.cljc)
	at datalevin.core$_transact_BANG_$fn__15726$fn__15735$helper15739__15740.invokePrim(core.cljc:619)
	at datalevin.core$_transact_BANG_$fn__15726$fn__15735$helper15739__15740.invoke(core.cljc)
	at datalevin.core$_transact_BANG_$fn__15726$fn__15735.invoke(core.cljc:619)
	at datalevin.core$_transact_BANG_$fn__15726.invoke(core.cljc:619)
	at datalevin.core$_transact_BANG_.invokeStatic(core.cljc:619)
	at datalevin.core$_transact_BANG_.invoke(core.cljc:618)
	at datalevin.core$transact_BANG_.invokeStatic(core.cljc:711)
	at datalevin.core$transact_BANG_.invoke(core.cljc:624)
	at datalevin.core$transact_BANG_.invokeStatic(core.cljc:709)
	at datalevin.core$transact_BANG_.invoke(core.cljc:624)
	at tesserae.db$eval51974$fn__51975$transact_BANG___51976.invoke(form-init17514198031870106473.clj:67)
	at tesserae.ui.sheet$eval138868.invokeStatic(sheet.cljc:496)
	at tesserae.ui.sheet$eval138868.invoke(sheet.cljc:496)
	at clojure.lang.Compiler.eval(Compiler.java:7194)
	at clojure.lang.Compiler.eval(Compiler.java:7149)
	at clojure.core$eval.invokeStatic(core.clj:3215)
	at clojure.core$eval.invoke(core.clj:3211)
	at nrepl.middleware.interruptible_eval$evaluate$fn__968$fn__969.invoke(interruptible_eval.clj:87)
	at clojure.lang.AFn.applyToHelper(AFn.java:152)
	at clojure.lang.AFn.applyTo(AFn.java:144)
	at clojure.core$apply.invokeStatic(core.clj:667)
	at clojure.core$with_bindings_STAR_.invokeStatic(core.clj:1990)
	at clojure.core$with_bindings_STAR_.doInvoke(core.clj:1990)
	at clojure.lang.RestFn.invoke(RestFn.java:425)
	at nrepl.middleware.interruptible_eval$evaluate$fn__968.invoke(interruptible_eval.clj:87)
	at clojure.main$repl$read_eval_print__9206$fn__9209.invoke(main.clj:437)
	at clojure.main$repl$read_eval_print__9206.invoke(main.clj:437)
	at clojure.main$repl$fn__9215.invoke(main.clj:458)
	at clojure.main$repl.invokeStatic(main.clj:458)
	at clojure.main$repl.doInvoke(main.clj:368)
	at clojure.lang.RestFn.invoke(RestFn.java:1523)
	at nrepl.middleware.interruptible_eval$evaluate.invokeStatic(interruptible_eval.clj:84)
	at nrepl.middleware.interruptible_eval$evaluate.invoke(interruptible_eval.clj:56)
	at nrepl.middleware.interruptible_eval$interruptible_eval$fn__999$fn__1003.invoke(interruptible_eval.clj:152)
	at clojure.lang.AFn.run(AFn.java:22)
	at nrepl.middleware.session$session_exec$main_loop__1067$fn__1071.invoke(session.clj:202)
	at nrepl.middleware.session$session_exec$main_loop__1067.invoke(session.clj:201)
	at clojure.lang.AFn.run(AFn.java:22)
	at java.base/java.lang.Thread.run(Thread.java:833)

The entity also has a nil key and value when touched:

=>
{nil nil, <--
 :sheet/_cells 272,
 :cell/y 8,
 :db/id 291,
 :cell/pos [2 8],
 :db/updated-at 1683480182912,
 :cell/x 2,
 :cell/exception? false,
 :db/created-at 1683479011501}

[huahaiy]

Were you able to reproduce?

[den1k]

I was not able to. Tried to rebuild the db using the new re-index function but that errored and wiped the DB. It was just a dev DB so that was okay but I lost the faulty data that somehow caused the error.

[huahaiy]

OK, looks like we need to create a backup db before re-indexing.

[huahaiy]

0.9.0 will use a safer default write option :nometasync, so only the last transaction may be lost, but the DB will not be corrupted.

[den1k]

Have a similar error where it seems that data that failed to deserialize blocks a retract.

(db/transact! [[:db/retractEntity 214]])

Error handling response - class java.lang.RuntimeException: No reader function for tag datalevin/Indexable

[den1k]

possibly a regression: #208

[den1k]

I have not been able to come up with a repro yet.