--embed-resources producing invalid data URI

[nikonakoneko]

Explain the problem.
I have a SVG file that seems to be wrongly encoded with --embed-resources

pandoc --from markdown --embed-resources --standalone test.md -o test.html

![test](input-example.abnf.svg)

input-example.abnf.svg

output: test.html

Pandoc version?
pandoc 2.19.1
Compiled with pandoc-types 1.22.2.1, texmath 0.12.5.2, skylighting 0.13,
citeproc 0.8.0.1, ipynb 0.2, hslua 2.2.1
Scripting engine: Lua 5.4

Gentoo Linux

[jgm]

Possibly relevant changelog item:

  * Use base64 package instead of base64-bytestring. It is supposed to be
    faster and more standards-compliant.

We need to look into this further, thank you for reporting. Have you tried with pandoc 2.19?

[jgm]

Follow-up: can you explain why you think it is wrongly encoded? When I open test.html with my browser, the images look correct.

[jgm]

Oh, interesting. It renders fine in Safari, but not in Firefox or Chrome.
Chrome console says: net::ERR_INVALID_URL

According to base64.guru, the issue seems to be the - characters before newlines.

[jgm]

The problem is that I used the functions that generate base64url encoding, which is slightly different from standard base64. I will revert this.

[nikonakoneko]

I downgraded to 2.19. But with that version there is still an issue with the PDF output not showing that SVG.

[jgm]

The PDF issue is something else. Probably the issue is that you don't have the software pandoc uses to convert svg to png for use in LaTeX. You should see a warning message about this.

[nikonakoneko]

Is that librsvg? I have it. I don't see any warning, only an info:
[INFO] Loaded input-example.abnf.svg from input-example.abnf.svg

with --verbose

[INFO] Loaded input-example.abnf.svg from input-example.abnf.svg
[makePDF] temp dir:
/tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017
[makePDF] Command line:
pdflatex "-halt-on-error" "-interaction" "nonstopmode" "-output-directory" "/tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017" "/tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017/input.tex"

[makePDF] Relevant environment variables:
("TEXINPUTS","/tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017:")
("TEXMFOUTPUT","/tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017")
("SHELL","/bin/zsh")
("PWD","/home/andrea/src/kernel-panic/standards/posix/regex")
("HOME","/home/andrea")
("LANG","en_US.UTF8")
("TMPDIR","/tmp/.private/andrea")
("PATH","/home/andrea/.local/share/zinit/polaris/bin:/home/andrea/.local/src/literate/bin/:/home/andrea/.local/prefix/mosh/bin:/home/andrea/.poetry/bin:/home/andrea/.cargo/bin:/home/andrea/.local/bin:/home/andrea/.local/bin:/home/andrea/.local/go/bin:/home/andrea/.local/creduce/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/bin:/usr/lib/llvm/14/bin:/usr/lib/llvm/13/bin:/usr/lib/llvm/12/bin")

[makePDF] Source:
% Options for packages loaded elsewhere
\PassOptionsToPackage{unicode}{hyperref}
\PassOptionsToPackage{hyphens}{url}
%
\documentclass[
]{article}
\usepackage{amsmath,amssymb}
\usepackage{lmodern}
\usepackage{iftex}
\ifPDFTeX
  \usepackage[T1]{fontenc}
  \usepackage[utf8]{inputenc}
  \usepackage{textcomp} % provide euro and other symbols
\else % if luatex or xetex
  \usepackage{unicode-math}
  \defaultfontfeatures{Scale=MatchLowercase}
  \defaultfontfeatures[\rmfamily]{Ligatures=TeX,Scale=1}
\fi
% Use upquote if available, for straight quotes in verbatim environments
\IfFileExists{upquote.sty}{\usepackage{upquote}}{}
\IfFileExists{microtype.sty}{% use microtype if available
  \usepackage[]{microtype}
  \UseMicrotypeSet[protrusion]{basicmath} % disable protrusion for tt fonts
}{}
\makeatletter
\@ifundefined{KOMAClassName}{% if non-KOMA class
  \IfFileExists{parskip.sty}{%
    \usepackage{parskip}
  }{% else
    \setlength{\parindent}{0pt}
    \setlength{\parskip}{6pt plus 2pt minus 1pt}}
}{% if KOMA class
  \KOMAoptions{parskip=half}}
\makeatother
\usepackage{xcolor}
\usepackage{graphicx}
\makeatletter
\def\maxwidth{\ifdim\Gin@nat@width>\linewidth\linewidth\else\Gin@nat@width\fi}
\def\maxheight{\ifdim\Gin@nat@height>\textheight\textheight\else\Gin@nat@height\fi}
\makeatother
% Scale images if necessary, so that they will not overflow the page
% margins by default, and it is still possible to overwrite the defaults
% using explicit options in \includegraphics[width, height, ...]{}
\setkeys{Gin}{width=\maxwidth,height=\maxheight,keepaspectratio}
% Set default figure placement to htbp
\makeatletter
\def\fps@figure{htbp}
\makeatother
\setlength{\emergencystretch}{3em} % prevent overfull lines
\providecommand{\tightlist}{%
  \setlength{\itemsep}{0pt}\setlength{\parskip}{0pt}}
\setcounter{secnumdepth}{-\maxdimen} % remove section numbering
\ifLuaTeX
  \usepackage{selnolig}  % disable illegal ligatures
\fi
\IfFileExists{bookmark.sty}{\usepackage{bookmark}}{\usepackage{hyperref}}
\IfFileExists{xurl.sty}{\usepackage{xurl}}{} % add URL line breaks if available
\urlstyle{same} % disable monospaced font for URLs
\hypersetup{
  hidelinks,
  pdfcreator={LaTeX via pandoc}}

\author{}
\date{}

\begin{document}

\hypertarget{posix-regex-ca}{%
\section{Expressions regulars de POSIX}\label{posix-regex-ca}}

Les expressions regulars comunament anomenades \emph{regex} o
\emph{regexp} són representacions de patrons de cerca de text. Apareixen
primer al món Unix per a fer servir amb les eines \texttt{awk},
\texttt{grep}, i \texttt{sed}. Més endavant, van ser ampliades i
normalitzades per POSIX. I més tard, auqesta norma va ser ampliada al
seu torn per al llenguatge \texttt{perl}. El cas de \texttt{vi} és
anterior a l’estandardització i per tant no corresponen totalment amb
les de POSIX. Tanmateix són totes força semblants. Aquí, veurem doncs la
sintaxi de les expressions POSIX bàsiques.

\hypertarget{metacaruxe0cters}{%
\subsection{Metacaràcters}\label{metacaruxe0cters}}

\begin{description}
\tightlist
\item[\texttt{\^{}}]
Correspon a la posició inicial de la cadena de caràcters. En el cas del
processament per línies, correspon al principi de la línia. Per exemple,
l’expressió \texttt{\^{}ar} trobaria la primar posició d’\texttt{arbre},
però no pas la de \texttt{barba}. Mentre que l’expressió \texttt{ar}
trobaria \_ar\_bre i també b\_ar\_ba.
\item[\texttt{\$}]
Correspon a la posició de fi de la cadena de caràcters. Per exemple
\texttt{ar\$} per a trobar la quinta posició de \texttt{foobar}.
\item[\texttt{.}]
correspon amb qualsevol caràcters, encara que moltes aplicacions
n’exclouen el salt de línia.
\item[\texttt{{[}} \emph{expr} \texttt{{]}}]
Expressió entre claudàtors: correspon amb un de qualsevol dels caràcters
d’\emph{expr}. Per exemple, \texttt{{[}abc{]}} trobaria la quarta
posició de la cadena \texttt{humana}, la primera de \texttt{capital}, i
cap d’\texttt{Heidegger}.
\item[\texttt{{[}\^{}} \emph{expr} \texttt{{]}}]
Negació d’expressió entre claudàtors: correspon a qualsevol caràcters
que no sigui del conjunt que representa \emph{expr}. Per exemple,
\texttt{{[}\^{}abc{]}} trobaria l’última posició d’\texttt{acabar}.
\item[\texttt{(} \emph{expr} \texttt{)}]
Un grup de captura.
\item[\texttt{\textbackslash{}}\emph{n}]
Correspon a la captura \emph{n}.
\item[\texttt{*}]
L’element anterior es repeteix zero o més vegades.
\item[\texttt{\{}m\texttt{,}n\texttt{\}}]
L’element anterior es repeteix com a minim \emph{m} voltes però no més
de \emph{n}
\end{description}

\hypertarget{exemples}{%
\subsection{Exemples}\label{exemples}}

Conciderem un programa que ha de processar una entrada de text línia per
línia. La sintaxi d’aquestes línies és la següent:

\begin{figure}
\centering
\includegraphics{/tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017/1115fb41c0096e58308c34b6368bf625d108f17b.pdf}
\caption{Diagrama de sintaxi de les línies}
\end{figure}

\hypertarget{vegueu-tambuxe9}{%
\subsection{Vegueu també}\label{vegueu-tambuxe9}}

\hypertarget{referuxe8ncies}{%
\subsection{Referències}\label{referuxe8ncies}}

\end{document}

[makePDF] Run #1
This is pdfTeX, Version 3.141592653-2.6-1.40.22 (TeX Live 2021 Gentoo Linux) (preloaded format=pdflatex)
 restricted \write18 enabled.
entering extended mode
(/tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017/input.tex
LaTeX2e <2020-10-01> patch level 4
L3 programming layer <2021-02-18>
(/usr/share/texmf-dist/tex/latex/base/article.cls
Document Class: article 2020/04/10 v1.4m Standard LaTeX document class
(/usr/share/texmf-dist/tex/latex/base/size10.clo))
(/usr/share/texmf-dist/tex/latex/amsmath/amsmath.sty
For additional information on amsmath, use the `?' option.
(/usr/share/texmf-dist/tex/latex/amsmath/amstext.sty
(/usr/share/texmf-dist/tex/latex/amsmath/amsgen.sty))
(/usr/share/texmf-dist/tex/latex/amsmath/amsbsy.sty)
(/usr/share/texmf-dist/tex/latex/amsmath/amsopn.sty))
(/usr/share/texmf-dist/tex/latex/amsfonts/amssymb.sty
(/usr/share/texmf-dist/tex/latex/amsfonts/amsfonts.sty))
(/usr/share/texmf-dist/tex/latex/lm/lmodern.sty)
(/usr/share/texmf-dist/tex/generic/iftex/iftex.sty)
(/usr/share/texmf-dist/tex/latex/base/fontenc.sty
(/usr/share/texmf-dist/tex/latex/lm/t1lmr.fd))
(/usr/share/texmf-dist/tex/latex/base/inputenc.sty)
(/usr/share/texmf-dist/tex/latex/base/textcomp.sty)
(/usr/share/texmf-dist/tex/latex/upquote/upquote.sty)
(/usr/share/texmf-dist/tex/latex/microtype/microtype.sty
(/usr/share/texmf-dist/tex/latex/graphics/keyval.sty)
(/usr/share/texmf-dist/tex/latex/microtype/microtype-pdftex.def)
(/usr/share/texmf-dist/tex/latex/microtype/microtype.cfg))
(/usr/share/texmf-dist/tex/latex/parskip/parskip.sty
(/usr/share/texmf-dist/tex/latex/kvoptions/kvoptions.sty
(/usr/share/texmf-dist/tex/generic/ltxcmds/ltxcmds.sty)
(/usr/share/texmf-dist/tex/generic/kvsetkeys/kvsetkeys.sty))
(/usr/share/texmf-dist/tex/latex/etoolbox/etoolbox.sty))
(/usr/share/texmf-dist/tex/latex/xcolor/xcolor.sty
(/usr/share/texmf-dist/tex/latex/graphics-cfg/color.cfg)
(/usr/share/texmf-dist/tex/latex/graphics-def/pdftex.def))
(/usr/share/texmf-dist/tex/latex/graphics/graphicx.sty
(/usr/share/texmf-dist/tex/latex/graphics/graphics.sty
(/usr/share/texmf-dist/tex/latex/graphics/trig.sty)
(/usr/share/texmf-dist/tex/latex/graphics-cfg/graphics.cfg)))
(/usr/share/texmf-dist/tex/latex/bookmark/bookmark.sty
(/usr/share/texmf-dist/tex/latex/hyperref/hyperref.sty
(/usr/share/texmf-dist/tex/generic/pdftexcmds/pdftexcmds.sty
(/usr/share/texmf-dist/tex/generic/infwarerr/infwarerr.sty))
(/usr/share/texmf-dist/tex/generic/kvdefinekeys/kvdefinekeys.sty)
(/usr/share/texmf-dist/tex/generic/pdfescape/pdfescape.sty)
(/usr/share/texmf-dist/tex/latex/hycolor/hycolor.sty)
(/usr/share/texmf-dist/tex/latex/letltxmacro/letltxmacro.sty)
(/usr/share/texmf-dist/tex/latex/auxhook/auxhook.sty)
(/usr/share/texmf-dist/tex/latex/hyperref/pd1enc.def)
(/usr/share/texmf-dist/tex/latex/hyperref/hyperref-langpatches.def)
(/usr/share/texmf-dist/tex/generic/intcalc/intcalc.sty)
(/usr/share/texmf-dist/tex/generic/etexcmds/etexcmds.sty)
(/usr/share/texmf-dist/tex/latex/hyperref/puenc.def)
(/usr/share/texmf-dist/tex/latex/url/url.sty)
(/usr/share/texmf-dist/tex/generic/bitset/bitset.sty
(/usr/share/texmf-dist/tex/generic/bigintcalc/bigintcalc.sty))
(/usr/share/texmf-dist/tex/latex/base/atbegshi-ltx.sty))
(/usr/share/texmf-dist/tex/latex/hyperref/hpdftex.def
(/usr/share/texmf-dist/tex/latex/base/atveryend-ltx.sty)
(/usr/share/texmf-dist/tex/latex/rerunfilecheck/rerunfilecheck.sty
(/usr/share/texmf-dist/tex/generic/uniquecounter/uniquecounter.sty)))
(/usr/share/texmf-dist/tex/latex/bookmark/bkm-pdftex.def))
(/usr/share/texmf-dist/tex/latex/xurl/xurl.sty)
(/usr/share/texmf-dist/tex/latex/l3backend/l3backend-pdftex.def)
No file input.aux.
(/usr/share/texmf-dist/tex/latex/microtype/mt-cmr.cfg)
(/usr/share/texmf-dist/tex/context/base/mkii/supp-pdf.mkii
[Loading MPS to PDF converter (version 2006.09.02).]
) (/usr/share/texmf-dist/tex/latex/epstopdf-pkg/epstopdf-base.sty
(/usr/share/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg))
(/usr/share/texmf-dist/tex/latex/hyperref/nameref.sty
(/usr/share/texmf-dist/tex/latex/refcount/refcount.sty)
(/usr/share/texmf-dist/tex/generic/gettitlestring/gettitlestring.sty))
(/usr/share/texmf-dist/tex/latex/lm/t1lmtt.fd)

LaTeX Warning: Float too large for page by 23.94511pt on input line 128.

[1{/var/lib/texmf/fonts/map/pdftex/updmap/pdftex.map}] [2 </tmp/.private/andrea
/tex2pdf.-9691cc0a34f4a017/1115fb41c0096e58308c34b6368bf625d108f17b.pdf>]
(/tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017/input.aux)

LaTeX Warning: Label(s) may have changed. Rerun to get cross-references right.

 ){/usr/share/texmf-dist/fonts/enc/dvips/lm/lm-ec.enc}</usr/share/texmf-dist/fo
nts/type1/public/lm/lmbx10.pfb></usr/share/texmf-dist/fonts/type1/public/lm/lmb
x12.pfb></usr/share/texmf-dist/fonts/type1/public/lm/lmbxi10.pfb></usr/share/te
xmf-dist/fonts/type1/public/lm/lmr10.pfb></usr/share/texmf-dist/fonts/type1/pub
lic/lm/lmri10.pfb></usr/share/texmf-dist/fonts/type1/public/lm/lmtk10.pfb></usr
/share/texmf-dist/fonts/type1/public/lm/lmtt10.pfb>
Output written on /tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017/input.pdf (2 p
ages, 169752 bytes).
Transcript written on /tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017/input.log.


[makePDF] Run #2
This is pdfTeX, Version 3.141592653-2.6-1.40.22 (TeX Live 2021 Gentoo Linux) (preloaded format=pdflatex)
 restricted \write18 enabled.
entering extended mode
(/tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017/input.tex
LaTeX2e <2020-10-01> patch level 4
L3 programming layer <2021-02-18>
(/usr/share/texmf-dist/tex/latex/base/article.cls
Document Class: article 2020/04/10 v1.4m Standard LaTeX document class
(/usr/share/texmf-dist/tex/latex/base/size10.clo))
(/usr/share/texmf-dist/tex/latex/amsmath/amsmath.sty
For additional information on amsmath, use the `?' option.
(/usr/share/texmf-dist/tex/latex/amsmath/amstext.sty
(/usr/share/texmf-dist/tex/latex/amsmath/amsgen.sty))
(/usr/share/texmf-dist/tex/latex/amsmath/amsbsy.sty)
(/usr/share/texmf-dist/tex/latex/amsmath/amsopn.sty))
(/usr/share/texmf-dist/tex/latex/amsfonts/amssymb.sty
(/usr/share/texmf-dist/tex/latex/amsfonts/amsfonts.sty))
(/usr/share/texmf-dist/tex/latex/lm/lmodern.sty)
(/usr/share/texmf-dist/tex/generic/iftex/iftex.sty)
(/usr/share/texmf-dist/tex/latex/base/fontenc.sty
(/usr/share/texmf-dist/tex/latex/lm/t1lmr.fd))
(/usr/share/texmf-dist/tex/latex/base/inputenc.sty)
(/usr/share/texmf-dist/tex/latex/base/textcomp.sty)
(/usr/share/texmf-dist/tex/latex/upquote/upquote.sty)
(/usr/share/texmf-dist/tex/latex/microtype/microtype.sty
(/usr/share/texmf-dist/tex/latex/graphics/keyval.sty)
(/usr/share/texmf-dist/tex/latex/microtype/microtype-pdftex.def)
(/usr/share/texmf-dist/tex/latex/microtype/microtype.cfg))
(/usr/share/texmf-dist/tex/latex/parskip/parskip.sty
(/usr/share/texmf-dist/tex/latex/kvoptions/kvoptions.sty
(/usr/share/texmf-dist/tex/generic/ltxcmds/ltxcmds.sty)
(/usr/share/texmf-dist/tex/generic/kvsetkeys/kvsetkeys.sty))
(/usr/share/texmf-dist/tex/latex/etoolbox/etoolbox.sty))
(/usr/share/texmf-dist/tex/latex/xcolor/xcolor.sty
(/usr/share/texmf-dist/tex/latex/graphics-cfg/color.cfg)
(/usr/share/texmf-dist/tex/latex/graphics-def/pdftex.def))
(/usr/share/texmf-dist/tex/latex/graphics/graphicx.sty
(/usr/share/texmf-dist/tex/latex/graphics/graphics.sty
(/usr/share/texmf-dist/tex/latex/graphics/trig.sty)
(/usr/share/texmf-dist/tex/latex/graphics-cfg/graphics.cfg)))
(/usr/share/texmf-dist/tex/latex/bookmark/bookmark.sty
(/usr/share/texmf-dist/tex/latex/hyperref/hyperref.sty
(/usr/share/texmf-dist/tex/generic/pdftexcmds/pdftexcmds.sty
(/usr/share/texmf-dist/tex/generic/infwarerr/infwarerr.sty))
(/usr/share/texmf-dist/tex/generic/kvdefinekeys/kvdefinekeys.sty)
(/usr/share/texmf-dist/tex/generic/pdfescape/pdfescape.sty)
(/usr/share/texmf-dist/tex/latex/hycolor/hycolor.sty)
(/usr/share/texmf-dist/tex/latex/letltxmacro/letltxmacro.sty)
(/usr/share/texmf-dist/tex/latex/auxhook/auxhook.sty)
(/usr/share/texmf-dist/tex/latex/hyperref/pd1enc.def)
(/usr/share/texmf-dist/tex/latex/hyperref/hyperref-langpatches.def)
(/usr/share/texmf-dist/tex/generic/intcalc/intcalc.sty)
(/usr/share/texmf-dist/tex/generic/etexcmds/etexcmds.sty)
(/usr/share/texmf-dist/tex/latex/hyperref/puenc.def)
(/usr/share/texmf-dist/tex/latex/url/url.sty)
(/usr/share/texmf-dist/tex/generic/bitset/bitset.sty
(/usr/share/texmf-dist/tex/generic/bigintcalc/bigintcalc.sty))
(/usr/share/texmf-dist/tex/latex/base/atbegshi-ltx.sty))
(/usr/share/texmf-dist/tex/latex/hyperref/hpdftex.def
(/usr/share/texmf-dist/tex/latex/base/atveryend-ltx.sty)
(/usr/share/texmf-dist/tex/latex/rerunfilecheck/rerunfilecheck.sty
(/usr/share/texmf-dist/tex/generic/uniquecounter/uniquecounter.sty)))
(/usr/share/texmf-dist/tex/latex/bookmark/bkm-pdftex.def))
(/usr/share/texmf-dist/tex/latex/xurl/xurl.sty)
(/usr/share/texmf-dist/tex/latex/l3backend/l3backend-pdftex.def)
(/tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017/input.aux)
(/usr/share/texmf-dist/tex/latex/microtype/mt-cmr.cfg)
(/usr/share/texmf-dist/tex/context/base/mkii/supp-pdf.mkii
[Loading MPS to PDF converter (version 2006.09.02).]
) (/usr/share/texmf-dist/tex/latex/epstopdf-pkg/epstopdf-base.sty
(/usr/share/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg))
(/usr/share/texmf-dist/tex/latex/hyperref/nameref.sty
(/usr/share/texmf-dist/tex/latex/refcount/refcount.sty)
(/usr/share/texmf-dist/tex/generic/gettitlestring/gettitlestring.sty))
(/usr/share/texmf-dist/tex/latex/lm/t1lmtt.fd)

LaTeX Warning: Float too large for page by 23.94511pt on input line 128.

[1{/var/lib/texmf/fonts/map/pdftex/updmap/pdftex.map}] [2 </tmp/.private/andrea
/tex2pdf.-9691cc0a34f4a017/1115fb41c0096e58308c34b6368bf625d108f17b.pdf>]
(/tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017/input.aux) ){/usr/share/texmf-d
ist/fonts/enc/dvips/lm/lm-ec.enc}</usr/share/texmf-dist/fonts/type1/public/lm/l
mbx10.pfb></usr/share/texmf-dist/fonts/type1/public/lm/lmbx12.pfb></usr/share/t
exmf-dist/fonts/type1/public/lm/lmbxi10.pfb></usr/share/texmf-dist/fonts/type1/
public/lm/lmr10.pfb></usr/share/texmf-dist/fonts/type1/public/lm/lmri10.pfb></u
sr/share/texmf-dist/fonts/type1/public/lm/lmtk10.pfb></usr/share/texmf-dist/fon
ts/type1/public/lm/lmtt10.pfb>
Output written on /tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017/input.pdf (2 p
ages, 169752 bytes).
Transcript written on /tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017/input.log.

[jgm]

I'm not sure. Your document contains

\includegraphics{/tmp/.private/andrea/tex2pdf.-9691cc0a34f4a017/1115fb41c0096e58308c34b6368bf625d108f17b.pdf}

which suggests that pandoc has converted the svg to pdf and is including that. If you can link to a full zip with everything needed for the conversion, I could try it out.

[nikonakoneko]

Mea culpa. I must have done something wrong at first try, because the graphic is indeed included now