Failed to initialize parser: Failed to read pdf: Failed to read xref table: Expected xref to start with 'xref' #16

dv47 · 2019-09-11T18:53:51Z

Certain formats of PDF documents do not contain the xref table which is causing the parsing error.
Attaching the pdf so you can duplicate the error.
example_012a.pdf

phpdave11 · 2019-09-11T20:07:16Z

Thank you for the bug report and sample PDF.

From the PDF specification:

Beginning with PDF 1.5, cross-reference information may be stored in a cross-reference stream instead of in a cross-reference table.

I will add support for reading cross-reference information from cross-reference streams.

tylerzika · 2019-09-17T16:26:52Z

@phpdave11 any idea when this support will be added?

phpdave11 · 2019-09-17T21:39:50Z

@tylerzika I will hopefully get to it by the end of the month. I'm just now reading up on how xref streams ought to be parsed. If you're able add support for this sooner, feel free to submit a pull request.

tylerzika · 2019-11-03T01:55:27Z

@phpdave11 any updates on this? I'll see if I can contribute..

phpdave11 · 2019-11-03T03:21:20Z

@tylerzika I started work on it in the xref-stream-support branch, but I haven’t been able to work on it lately.

sankethpb · 2019-12-16T17:45:27Z

@phpdave11 could you please let us know when this would be available?

Thank you very much in advance

sankethpb · 2019-12-21T09:15:10Z

@phpdave11 Sorry for asking again, your help would be very much appreciated.

Thank you

tylerzika · 2020-02-04T02:24:21Z

@phpdave11 can you share the documentation you would use to fix this issue? I'm clueless on how I would solve it, but I'd like to contribute and try.

phpdave11 · 2020-02-11T00:14:32Z

This is fixed in gofpdi v1.0.9.

phpdave11 · 2020-02-11T00:48:37Z

I've updated the gofpdi dependency in my fork of gofpdf - jung-kurt/gofpdf is no longer maintained.

tylerzika · 2020-02-11T03:37:44Z

@phpdave11 I think there is a compiling error. My import statement:

import (
	"crypto/sha1"
	"crypto/subtle"
	"encoding/base64"
	"encoding/json"
	"fmt"
	"github.com/phpdave11/gofpdf"
	"github.com/phpdave11/gofpdf/contrib/gofpdi"
	fpdi "github.com/phpdave11/gofpdi"
	"io/ioutil"
	"log"
	"net/http"
	"os"
	"strings"
	"time"
	"unicode/utf8"
)

Then I get this error:

tylerzika · 2020-02-11T03:42:17Z

@phpdave11 it looks like you change some of the functions and their parameters?

phpdave11 · 2020-02-11T15:15:09Z

@tylerzika The external functions and parameters have not changed. I'm not seeing any compiler errors. Try updating the code with go get ./... - I just pushed a few changes.

tylerzika · 2020-02-12T03:35:48Z

@phpdave11 when I do go get github.com/phpdave11/gofpdf/contrib/gofpdi I get the following error:

# github.com/phpdave11/gofpdf/contrib/gofpdi
../phpdave11/gofpdf/contrib/gofpdi/gofpdi.go:54:8: i.fpdi.SetSourceStream undefined (type *gofpdi.Importer has
 no field or method SetSourceStream)

tylerzika · 2020-02-12T03:37:15Z

@phpdave11

Tylers-MacBook-Pro-2:label-api tyler$ go get ./...
# github.com/phpdave11/gofpdf/contrib/gofpdi
../phpdave11/gofpdf/contrib/gofpdi/gofpdi.go:54:8: i.fpdi.SetSourceStream undefined (type *gofpdi.Importer has no field or method SetSourceStream)

phpdave11 · 2020-02-12T13:42:22Z

@tylerzika can you share your go.mod and go.sum files?

rorycl · 2020-02-12T19:56:15Z

Please see issue #23 against v1.0.9

tylerzika · 2020-02-14T04:10:43Z

@phpdave11

go.mod

module github.com/phpdave11/gofpdi

go 1.12

go.mod

module github.com/jung-kurt/gofpdf

go 1.12

require (
	github.com/boombuler/barcode v1.0.0
	github.com/phpdave11/gofpdi v1.0.9
	github.com/ruudk/golang-pdf417 v0.0.0-20181029194003-1af4ab5afa58
	golang.org/x/image v0.0.0-20190910094157-69e4b8554b2a
)

replace gofpdf => ./

go.sum

github.com/boombuler/barcode v1.0.0 h1:s1TvRnXwL2xJRaccrdcBQMZxq6X7DvsMogtmJeHDdrc=
github.com/boombuler/barcode v1.0.0/go.mod h1:paBWMcWSl3LHKBqUq+rly7CNSldXjb2rDl3JlRe0mD8=
github.com/davecgh/go-spew v1.1.0 h1:ZDRjVQ15GmhC3fiQ8ni8+OwkZQO4DARzQgrnXU1Liz8=
github.com/davecgh/go-spew v1.1.0/go.mod h1:J7Y8YcW2NihsgmVo/mv3lAwl/skON4iLHjSsI+c5H38=
github.com/jung-kurt/gofpdf v1.0.0/go.mod h1:7Id9E/uU8ce6rXgefFLlgrJj/GYY22cpxn+r32jIOes=
github.com/phpdave11/gofpdi v1.0.7 h1:k2oy4yhkQopCK+qW8KjCla0iU2RpDow+QUDmH9DDt44=
github.com/phpdave11/gofpdi v1.0.7/go.mod h1:vBmVV0Do6hSBHC8uKUQ71JGW+ZGQq74llk/7bXwjDoI=
github.com/phpdave11/gofpdi v1.0.9/go.mod h1:r/fO8a9KSCrpwwTaqEx3amFJ6IHjfvAq7w1GP0XYRcg=
github.com/pkg/errors v0.8.1 h1:iURUrRGxPUNPdy5/HRSm+Yj6okJ6UtLINN0Q9M4+h3I=
github.com/pkg/errors v0.8.1/go.mod h1:bwawxfHBFNV+L2hUp1rHADufV3IMtnDRdf1r5NINEl0=
github.com/pmezard/go-difflib v1.0.0 h1:4DBwDE0NGyQoBHbLQYPwSUPoCMWR5BEzIk/f1lZbAQM=
github.com/pmezard/go-difflib v1.0.0/go.mod h1:iKH77koFhYxTK1pcRnkKkqfTogsbg7gZNVY4sRDYZ/4=
github.com/ruudk/golang-pdf417 v0.0.0-20181029194003-1af4ab5afa58 h1:nlG4Wa5+minh3S9LVFtNoY+GVRiudA2e3EVfcCi3RCA=
github.com/ruudk/golang-pdf417 v0.0.0-20181029194003-1af4ab5afa58/go.mod h1:6lfFZQK844Gfx8o5WFuvpxWRwnSoipWe/p622j1v06w=
github.com/stretchr/testify v1.2.2 h1:bSDNvY7ZPG5RlJ8otE/7V6gMiyenm9RtJ7IUVIAoJ1w=
github.com/stretchr/testify v1.2.2/go.mod h1:a8OnRcib4nhh0OaRAV+Yts87kKdq0PP7pXfy6kDkUVs=
golang.org/x/image v0.0.0-20190902063713-cb417be4ba39 h1:4dQcAORh9oYBwVSBVIkP489LUPC+f1HBkTYXgmqfR+o=
golang.org/x/image v0.0.0-20190902063713-cb417be4ba39/go.mod h1:FeLwcggjj3mMvU+oOTbSwawSJRM1uh48EjtB4UJZlP0=
golang.org/x/image v0.0.0-20190910094157-69e4b8554b2a h1:gHevYm0pO4QUbwy8Dmdr01R5r1BuKtfYqRqF0h/Cbh0=
golang.org/x/image v0.0.0-20190910094157-69e4b8554b2a/go.mod h1:FeLwcggjj3mMvU+oOTbSwawSJRM1uh48EjtB4UJZlP0=
golang.org/x/text v0.3.0/go.mod h1:NqM8EUOU14njkJ3fqMW+pc6Ldnwhi/IjpwHt7yyuwOQ=

tylerzika · 2020-02-17T17:20:34Z

@phpdave11 I deleted the src files and did a go get to download them again. The error went away. But I'm still getting this error:

http: panic serving [::1]:54121: Failed to initialize parser: Fai
led to read pdf: Failed to read xref table: Unsupported field size in cross-reference
 stream dictionary - only tested with /W [1 2 1]
goroutine 5 [running]:

phpdave11 · 2020-02-20T19:15:38Z

@tylerzika this has been fixed in gofpdi v1.0.11.

Originally posted by @phpdave11 in #25 (comment)

tylerzika · 2020-02-21T02:54:07Z

@phpdave11 this update is fantastic! It's working well with a lot of my company's pdfs we are importing. There is one that is still having problems. It's successfully importing a pdf, but one of the pdf's pages is almost completely blank. At the top of the second page, all of the pdf's image appears to be squashed at the top. It's attached. We had to blot out some person information, so I hope you can experience what we've seen from the original.
7007327.pdf

0x-1 · 2020-02-27T12:41:10Z

With v1.0.11:

Failed to initialize parser: Failed to read pdf: Failed to read xref table: Failed to read prev xref: Unsupported /DecodeParms - only tested with /Columns 4 /Predictor 12

phpdave11 · 2020-02-27T21:13:43Z

@phpdave11 this update is fantastic! It's working well with a lot of my company's pdfs we are importing. There is one that is still having problems. It's successfully importing a pdf, but one of the pdf's pages is almost completely blank. At the top of the second page, all of the pdf's image appears to be squashed at the top. It's attached. We had to blot out some person information, so I hope you can experience what we've seen from the original.
7007327.pdf

@tylerzika I'm able to reproduce this issue. I will open a separate issue for this problem.

phpdave11 · 2020-02-27T21:20:04Z

With v1.0.11:

Failed to initialize parser: Failed to read pdf: Failed to read xref table: Failed to read prev xref: Unsupported /DecodeParms - only tested with /Columns 4 /Predictor 12

@0x-1 would you mind posting the PDF that causes this error in a new issue?

0x-1 · 2020-02-27T22:32:43Z

Sure thing. Thanks for the patch so far.

rajat-sr · 2020-12-28T19:40:30Z

I'm getting the same error as @0x-1

Failed to initialize parser: Failed to read pdf: Failed to read xref table: Failed to read prev xref: Unsupported /DecodeParms - only tested with /Columns 4 /Predictor 12

Does anyone have a solution to this?

rorycl · 2020-12-28T20:06:07Z

The only solution I have found that is relatively fool-proof is to re-save the pdf using pdftk first. For example pdftk infile cat output outfile && mv outfile infile Then gofpdi is able to read the pdf xref table in most situations.

…

On 28/12/20, Rajat ***@***.***) wrote: I'm getting the same error as @0x-1 ``` Failed to initialize parser: Failed to read pdf: Failed to read xref table: Failed to read prev xref: Unsupported /DecodeParms - only tested with /Columns 4 /Predictor 12 ``` Does anyone have a solution to this?

rajat-sr · 2020-12-30T01:36:07Z

Thanks @rorycl

wangsirun · 2021-08-02T10:40:37Z

now this qustion util exist。

aohanhongzhi · 2022-03-08T14:03:11Z

now this qustion util exist。

GOROOT=/opt/eric/go #gosetup
GOPATH=/home/iris/Project/Go #gosetup
/opt/eric/go/bin/go build -o /tmp/GoLand/___1go_build_go_study_m_pdf__1_ -gcflags all=-N -l /home/iris/Project/Go/go-study/pdf/import_pdf_writer.go #gosetup
/opt/eric/GoLand-2020.1/plugins/go/lib/dlv/linux/dlv --listen=127.0.0.1:43965 --headless=true --api-version=2 --check-go-version=false --only-same-user=false exec /tmp/GoLand/___1go_build_go_study_m_pdf__1_ --
API server listening at: 127.0.0.1:43965
panic: Failed to initialize parser: Failed to read pdf: Failed to read xref table: Unsupported /DecodeParms - only tested with /Columns <= 4 and /Predictor <= 12

goroutine 1 [running]:
github.com/phpdave11/gofpdi.(*Importer).SetSourceFile(0xc000074040, {0x5afc03, 0x35})
        /home/iris/Project/Go/pkg/mod/github.com/phpdave11/gofpdi@v1.0.13/importer.go:71 +0x3c5
github.com/signintech/gopdf.(*GoPdf).ImportPage(0xc00010c000, {0x5afc03, 0x35}, 0x1, {0x5a6c12, 0x9})
        /home/iris/Project/Go/pkg/mod/github.com/signintech/gopdf@v0.10.8/gopdf.go:1033 +0x7c
main.main()
        /home/iris/Project/Go/go-study/pdf/import_pdf_writer.go:25 +0x385

Debugger finished with the exit code 0

rorycl · 2022-03-08T14:48:16Z

Please see my comments above about using pdftk to fix xref tables.

I haven't tried it yet, but I wonder if using the pdfcpu module might work. Check out the watermark method at https://pdfcpu.io/core/watermark. If the cli tool works the API version https://pkg.go.dev/github.com/pdfcpu/pdfcpu/pkg/api#AddPDFWatermarksFile is probably what you want.

lsymy · 2022-04-27T01:55:41Z

Save my day, thanks@rorycl

rorycl · 2022-04-27T06:12:04Z

That's great to hear @lsymy. Do you have an implementation example to share?

Cheers,
Rory

0x-1 · 2022-06-22T14:22:29Z

pdfcpu doesn't seem to like this one too. Tired it with api.Optimize(in, out, default) causing this error.

edit: Disabled validation, doesn't error but the resulting byte slice doesn't seem to be openable when processing the file afterwards.

Can confirm that unipdf can fix the file like pdftk too. But this one always has a watermark @ saving w/o subscription.
pdftk is the way to go here if it's free in basic features like open/save once before processing.

rorycl · 2023-02-18T15:33:10Z

@phpdave11 : any news on a possible fix for this?

Most of the time gofpdi works great, but the xref table problem causing a panic is affecting the users of rm2pdf; see rorycl/rm2pdf#4.

Using pdftk to rebuild the pdf fixes the issue in most cases. I guess pdftk rebuilds the xref table.

Thanks for any response.

This was referenced Sep 11, 2019

PDF file without xref table. #14

Closed

combine existing pdf to pdf generate by gofpdf into single pdf jung-kurt/gofpdf#258

Closed

This was referenced Jan 18, 2020

Pdf rendering of rM handwritten notes juruen/rmapi#41

Open

Build/Test not running rorycl/rm2pdf#1

Closed

Cannot import page from original PDF rorycl/rm2pdf#2

Closed

phpdave11 mentioned this issue Feb 27, 2020

Corrupted imported image #29

Open

phpdave11 closed this as completed May 17, 2020

quanquan616 mentioned this issue Dec 4, 2020

Failed to read pdf: Failed to read xref table phpdave11/gofpdf#8

Open

0x-1 mentioned this issue Jun 22, 2022

Failed to read xref table: Failed to read prev xref: Unsupported /DecodeParms #36

Open

Failed to initialize parser: Failed to read pdf: Failed to read xref table: Expected xref to start with 'xref' #16

Failed to initialize parser: Failed to read pdf: Failed to read xref table: Expected xref to start with 'xref' #16

Comments

dv47 commented Sep 11, 2019

phpdave11 commented Sep 11, 2019

tylerzika commented Sep 17, 2019

phpdave11 commented Sep 17, 2019

tylerzika commented Nov 3, 2019

phpdave11 commented Nov 3, 2019

sankethpb commented Dec 16, 2019

sankethpb commented Dec 21, 2019

tylerzika commented Feb 4, 2020

phpdave11 commented Feb 11, 2020

phpdave11 commented Feb 11, 2020

tylerzika commented Feb 11, 2020 • edited Loading

tylerzika commented Feb 11, 2020

phpdave11 commented Feb 11, 2020

tylerzika commented Feb 12, 2020

tylerzika commented Feb 12, 2020

phpdave11 commented Feb 12, 2020

rorycl commented Feb 12, 2020

tylerzika commented Feb 14, 2020

tylerzika commented Feb 17, 2020 • edited Loading

phpdave11 commented Feb 20, 2020

tylerzika commented Feb 21, 2020 • edited Loading

0x-1 commented Feb 27, 2020

phpdave11 commented Feb 27, 2020 • edited Loading

phpdave11 commented Feb 27, 2020

0x-1 commented Feb 27, 2020

rajat-sr commented Dec 28, 2020

rorycl commented Dec 28, 2020 via email

rajat-sr commented Dec 30, 2020

wangsirun commented Aug 2, 2021

aohanhongzhi commented Mar 8, 2022 • edited Loading

rorycl commented Mar 8, 2022 • edited Loading

lsymy commented Apr 27, 2022

rorycl commented Apr 27, 2022

0x-1 commented Jun 22, 2022 • edited Loading

rorycl commented Feb 18, 2023

tylerzika commented Feb 11, 2020 •

edited

Loading

tylerzika commented Feb 17, 2020 •

edited

Loading

tylerzika commented Feb 21, 2020 •

edited

Loading

phpdave11 commented Feb 27, 2020 •

edited

Loading

aohanhongzhi commented Mar 8, 2022 •

edited

Loading

rorycl commented Mar 8, 2022 •

edited

Loading

0x-1 commented Jun 22, 2022 •

edited

Loading