Symfony\Component\Process\Exception\ProcessTimedOutException on PDF generation #169

sn0opr · 2015-07-14T12:45:18Z

I'm using Laravel Snappy package, and I think the problem is from Snappy itself.
In my localhost (Windows 7 32bit) wkhtmltopdf 0.12.2.3 (with patched qt) everything is working fine.
In the deployment machine (Windows Server 2012 R2 64bit) wkhtmltopdf 0.12.2.4 64bit, it takes about 60 seconds without any response or error... Good news I'm using Bugsnag service to track bugs and errors, and this is what I get:
Symfony\Component\Process\Exception\ProcessTimedOutExceptionGET /gca/public/demandes-achat/1138/pdf The process "C:\xampp\htdocs\gca/wkhtmltopdf/bin/wkhtmltopdf.exe --lowquality "C:\Windows\TEMP\knp_snappy55a4f9ff7f5862.10272127.html" "C:\Windows\TEMP\knp_snappy55a4f9ff7fab55.21457299.pdf"" exceeded the timeout of 60 seconds.
But when I tested to generate pdf from a website like google, it works fine !, with a plain html it wroks fine too.
I'm getting crazy here because it's working on my dev machine Win 7 and my computer Win 8.1 with difference wkhtmltopdf version for sure...

Btw, I'm using Bootstrap.min.css and Fontawesome.css

Please help me it's urgent.

The text was updated successfully, but these errors were encountered:

akovalyov · 2015-07-14T12:57:09Z

@sn0opr I have good news and bad news for you.
Good news is that we are here to help
Bad news is that we can not.
60 seconds is default timeout for Symfony/Process. Your error means that in 60 seconds there was no response from wkhtmltopdf. In this case the only thing is possible - networking issues. Generating pdf from local html or google website will work since it is loaded fastly. Please, check the url which you are trying to fetch. And remember that not only the html itself should be loaded in 60 seconds but all the resources which that html contains.
If you just want to increase the timeout - you can set it here -

snappy/src/Knp/Snappy/AbstractGenerator.php

Line 102 in 3aaabad

* Sets the timeout. Be aware that option only works with symfony

. If you want to do that - please, consider that you use the latest snappy version.
Cheers.

docteurklein · 2015-07-14T13:01:31Z

@sn0opr My guess is that it comes from wkhtmltopdf, not snappy.
You should try to execute the exact same command that the application generates (look at the logs or var_dump it in AbstratGenerator), and try to execute it in a shell, on the production server.

sn0opr · 2015-07-14T14:19:06Z

@akovalyov Hi, thank you for the fast reply.

1 - I'm generating pdf from local resources
2 - I'm only loading 3 css files (bootstrap.min.css, fontawesome.min.css and a small css file that made for my pdf pages)
3 - @docteurklein I tried the wkhtmltopdf.exe program using the command line and it works like expected, I uses the same html page and It converts in about 2 seconds not more.

4 - I removed the css files from the <head> to try if the resources are making the issue, and yeah It worked, but without any css file.. Now I'm confused..., how it works with command line without any issue but not with the Snappy class.

5 - I tried the Symfony class Symfony\Component\Process\Process and run the command myself ```, same thing, it's not working in Windows Server 2012 but it works in Win 7 and Win 8! :

$binary = \Config::get('snappy.pdf.binary');
    $process = new Symfony\Component\Process\Process($binary.' '.url('demandes-achat/1024/pdf').' test.pdf');
    $process->run(function ($type, $buffer) {
        if (\Symfony\Component\Process\Process::ERR === $type) {
            echo 'ERR > '.$buffer;
        } else {
            echo 'OUT > '.$buffer;
        }
    });

The Win Server machine is 12GB of RAM and Xenon Processor

docteurklein · 2015-07-14T14:24:28Z

Interesting: So it's definitly a problem with the Process execution. You can try to find existing issues on https://github.com/symfony/symfony/issues?q=is%3Aopen+is%3Aissue+label%3AProcess

akovalyov · 2015-07-14T14:29:47Z

@sn0opr have you tried to execute wkhtmltopdf command manually in Windows cmd?

sn0opr · 2015-07-14T14:48:45Z

@akovalyov Like I said, yes I did and it's works perfectly, I changed my pdf script from returning pdf file with Snappy to returning html file and tested with command line, it dose the job in a very small time. here is the output:

PS C:\xampp\htdocs\gca\wkhtmltopdf\bin> .\wkhtmltopdf.exe http://localhost/gca/public/demandes-achat/1138/pdf processs.pdf
Loading pages (1/6)
Counting pages (2/6)
Resolving links (4/6)
Loading headers and footers (5/6)
Printing pages (6/6)
Done

docteurklein · 2015-07-14T14:56:28Z

@sn0opr you can try to narrow the problem:

try with php -a:

proc_open($cmd,
    array(
        array("pipe","r"),
        array("pipe","w"),
        array("pipe","w")
    ),
$pipes);

sn0opr · 2015-07-14T15:05:08Z

@docteurklein thank you for trying to help me,
I just tried with the native php exec() method and It worked like expected!!!
So the problem is from the Symfony\Component\Process\Process class !

//var_dump(exec($binary.' http://localhost/gca/public/demandes-achat/1138/pdf rihane.pdf'));
//exec method works fine and outputs the file like expected
    proc_open($binary.' http://localhost/gca/public/demandes-achat/1138/pdf rihane.pdf',
    array(
        array("pipe","r"),
        array("pipe","w"),
        array("pipe","w")
    ),$pipes);
    var_dump($pipes);

result:
array(3) { [0]=> resource(86) of type (Unknown) [1]=> resource(87) of type (Unknown) [2]=> resource(88) of type (Unknown) }

docteurklein · 2015-07-14T15:10:31Z

for proc open, you should use:

var_dump(array_map('stream_get_contents', $pipes));

Also, proc_open doesn't return anything, but you can still look at the file rihane.pdf and see if it worked.

docteurklein · 2015-07-14T15:12:57Z

So, if proc_open fails, then it's a problem with php's http://php.net/proc_open.
You can try to search for solutions there.

docteurklein · 2015-07-14T15:13:40Z

For example: http://php.net/manual/en/function.proc-open.php#97012

sn0opr · 2015-07-14T21:21:35Z

@docteurklein sorry for the late, I tested with array_map function and I got an error:

$binary = \Config::get('snappy.pdf.binary');
    proc_open($binary.' http://localhost/gca/public/demandes-achat/1138/pdf xxx.pdf',
    array(
        array("pipe","r"),
        array("pipe","w"),
        array("pipe","w")
    ),$pipes);
    var_dump(array_map('stream_get_contents', $pipes));

Output :

stream_get_contents(): 86 is not a valid stream resource

I forgot to say that the pdf file is generated successfully with ```proc_open```

sn0opr · 2015-07-15T11:41:50Z

@docteurklein @akovalyov , I just found a solution.
I got to the source code of Snappy package and found in the AbstractGenerator::executeCommand() method that you use your own Process class if Symfony Process class dosen't exist, so I just remove this condition and used Snappy's Process class, and it worked like a charm!:

protected function executeCommand($command)
    {
        /*if (class_exists('Symfony\Component\Process\Process')) {
            $process = new \Symfony\Component\Process\Process($command, NULL, $this->env);
            if ($this->timeout !== false) {
                $process->setTimeout($this->timeout);
            }
        } else {
            $process = new Process($command, $this->env);
        }*/

        $process = new Process($command, $this->env);
        $process->run();

        return array(
            $process->getExitCode(),
            $process->getOutput(),
            $process->getErrorOutput(),
        );
    }

Can you please provide an option to use Symfony's Process class or the default one ?.
Thank you for the support

docteurklein · 2015-07-15T11:55:16Z

see #166

akovalyov · 2015-07-15T12:07:41Z

@sn0opr you can install it as dev-master if you use composer

osaris · 2015-08-17T15:45:25Z

I don't get the point, looks like @sn0opr say that it works with the Process class from snappy and you removed it in #166 to force usage of the one from Symfony ?

I have the same problem and using 0.4 and forcing snappy to use its own Process class works for me too. It's also a lot more faster (for the same HTML, something like 2 seconds between the button click and the PDF show with your Process class and more than 4 seconds with Symfony Process class).

akovalyov · 2015-08-17T15:56:22Z

@osaris thank for the feedback. Could you give a little bit more of details about the environment and the input options for Snappy? For how many iterations have you launched it?
I will setup a test env later this week on Linux to see an compare the execution time.

@jeremyb do you still have Windows env to test the Snappy performance with Symfony/Process? :)

osaris · 2015-08-17T18:53:17Z

@akovalyov on my dev machine (OSX), on 5 runs with the same HTML to convert to PDF the time is very similar.

On our production environment (Windows 2008 R2, Apache 2.4, PHP 5.6.10, Laravel 5.1), I need to remove the css link to have it working with Symfony2 Process (it's ok with Snappy Process class), but the results are very different, on 10 runs with Snappy Process class, average speed is 561ms to get the PDF, with Symfony2 Process class it's 2.61 seconds !!

Despite the performance issue, my main problem is that I can't use css link If I use the Symfony2 Process class but it's ok with Snappy Process class.

pilot · 2015-08-17T19:29:01Z

+1 to have abiltiy to chose type of processor, symfony or native

sn0opr · 2015-08-19T11:12:49Z

+1

docteurklein · 2015-08-19T11:27:01Z

Interesting. We removed the embedded Process class because iti didn't work well on many setups.
And I really think we should leverage a well tested library like Symfony's Process, even tho it seems to not work in some cases.

The best would be to concentrate on fixing it, not snappy.

osaris · 2015-08-19T11:45:36Z

@docteurklein make sense for me, the related issue on symfony part seems to be this one : symfony/symfony#15278

docteurklein · 2015-08-19T11:57:38Z

BTW, you could try to put enhanceWindowsCompatibility to false, just to try.

osaris · 2015-08-19T20:52:20Z

@docteurklein can I change this setting in my snappy configuration file or somewhere else in my app ?

akovalyov · 2015-08-19T21:44:39Z

@osaris @docteurklein is talking about https://github.com/symfony/symfony/blob/5f36605e0e2264a1f52a8caa4bbe35a6f4ece8b4/src/Symfony/Component/Process/Process.php#L1174.

You can also try to experiment with bypass_shell: false and supress_errors: true (you can set it via https://github.com/symfony/symfony/blob/5f36605e0e2264a1f52a8caa4bbe35a6f4ece8b4/src/Symfony/Component/Process/Process.php#L1148)

osaris · 2015-08-22T13:44:02Z

Sorry for the delay.

enhanceWindowsCompatibility don't change anything. Same for bypass_shell and suppress_errors.

WouterSioen · 2015-11-13T09:21:34Z

I have the same issue with the process component (see symfony/symfony#15278 (comment))

It would be awesome to be able to choose the old Snappy Process class instead of the Symfony Component.

WouterSioen · 2015-11-13T10:08:26Z

I only have this issue when I pass on my PHPSESSID cookie to the process.

$snappy->setOption(
    'cookie',
    [ 'PHPSESSID' => $this->request->cookies->get('PHPSESSID') ]
);

The generated pdf is correct though. It's just the Symfony Process that isn't stopping with this option.
I guess this means that it's a wkhtmltopdf issue?

I don't yet know why the Symfony Process fails on it though.

WouterSioen · 2015-11-13T10:23:55Z

Hmm, it seems like the script is in fact hanging, since the pdf is only written after the timeout has been reached (and the script is thus terminated using a termsign 15.

The pdf looks correct though, and the exact same command runs perfectly on the CLI.

I've now worked around it using

use Symfony\Component\Process\Exception\ProcessTimedOutException;

$snappy->setTimeout(3);
try {
    $snappy->generate($input, $output);
} catch (ProcessTimedOutException $e) {
    // do nothing, the pdf is probably generated
}

It's not that clean, because other reasons the process timed out aren't handled anymore, but it works for now (if the pdf is generated in 3 seconds)

osaris · 2016-01-27T11:12:42Z

FYI, my problem was that some external links (CSS etc) weren't accessibles from the server that is running wkhtmltopdf (DNS misconfiguration). wkhtmltopdf is really slow to give up on missing ressources so the generation time was over 30 sec.

I fixed the problem by using realpath() to use local path for these ressources.

barryvdh · 2016-11-28T09:09:37Z

Again returning to this issue, I suddenly only get timeouts (existing project), but the files are generated.

Replacing the Symfony Process in the AbstractGenerator fixed it, so not sure why the Symfony Process is not responding..

protected function executeCommand($command)
    {
        exec($command, $output, $status);

        return array($status, $output, $status == 0 ? '' : $output);
    }

CharlyPoppins · 2017-06-06T13:26:18Z

On our dedicated the timeout issue was solved by disabling ipv6.

akerouanton · 2017-09-13T08:54:27Z

I close this issue because it is pretty old now and the only updates in the past year is about networking issues leading to timeouts. If you still face a similar problem please open a new issue.

akovalyov closed this as completed Jul 14, 2015

sn0opr mentioned this issue Jul 14, 2015

Symfony\Component\Process\Process Bug in Windows Server symfony/symfony#15278

Closed

akovalyov reopened this Aug 19, 2015

akerouanton closed this as completed Sep 13, 2017

Vercryger mentioned this issue Dec 14, 2017

Timeout exceeded exception #292

Closed

alexpozzi mentioned this issue Jul 10, 2020

PDF Generation exceeded the timeout of 60 seconds #399

Closed

SilverBull mentioned this issue Aug 31, 2021

Symfony\Component\Process\Exception\ProcessTimedOutException on PDF generation #430

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Symfony\Component\Process\Exception\ProcessTimedOutException on PDF generation #169

Symfony\Component\Process\Exception\ProcessTimedOutException on PDF generation #169

sn0opr commented Jul 14, 2015

akovalyov commented Jul 14, 2015

docteurklein commented Jul 14, 2015

sn0opr commented Jul 14, 2015

docteurklein commented Jul 14, 2015

akovalyov commented Jul 14, 2015

sn0opr commented Jul 14, 2015

docteurklein commented Jul 14, 2015

sn0opr commented Jul 14, 2015

docteurklein commented Jul 14, 2015

docteurklein commented Jul 14, 2015

docteurklein commented Jul 14, 2015

sn0opr commented Jul 14, 2015

sn0opr commented Jul 15, 2015

docteurklein commented Jul 15, 2015

akovalyov commented Jul 15, 2015

osaris commented Aug 17, 2015

akovalyov commented Aug 17, 2015

osaris commented Aug 17, 2015

pilot commented Aug 17, 2015

sn0opr commented Aug 19, 2015

docteurklein commented Aug 19, 2015

osaris commented Aug 19, 2015

docteurklein commented Aug 19, 2015

osaris commented Aug 19, 2015

akovalyov commented Aug 19, 2015

osaris commented Aug 22, 2015

WouterSioen commented Nov 13, 2015

WouterSioen commented Nov 13, 2015

WouterSioen commented Nov 13, 2015

osaris commented Jan 27, 2016

barryvdh commented Nov 28, 2016

CharlyPoppins commented Jun 6, 2017

akerouanton commented Sep 13, 2017

Symfony\Component\Process\Exception\ProcessTimedOutException on PDF generation #169

Symfony\Component\Process\Exception\ProcessTimedOutException on PDF generation #169

Comments

sn0opr commented Jul 14, 2015

akovalyov commented Jul 14, 2015

docteurklein commented Jul 14, 2015

sn0opr commented Jul 14, 2015

docteurklein commented Jul 14, 2015

akovalyov commented Jul 14, 2015

sn0opr commented Jul 14, 2015

docteurklein commented Jul 14, 2015

sn0opr commented Jul 14, 2015

docteurklein commented Jul 14, 2015

docteurklein commented Jul 14, 2015

docteurklein commented Jul 14, 2015

sn0opr commented Jul 14, 2015

sn0opr commented Jul 15, 2015

docteurklein commented Jul 15, 2015

akovalyov commented Jul 15, 2015

osaris commented Aug 17, 2015

akovalyov commented Aug 17, 2015

osaris commented Aug 17, 2015

pilot commented Aug 17, 2015

sn0opr commented Aug 19, 2015

docteurklein commented Aug 19, 2015

osaris commented Aug 19, 2015

docteurklein commented Aug 19, 2015

osaris commented Aug 19, 2015

akovalyov commented Aug 19, 2015

osaris commented Aug 22, 2015

WouterSioen commented Nov 13, 2015

WouterSioen commented Nov 13, 2015

WouterSioen commented Nov 13, 2015

osaris commented Jan 27, 2016

barryvdh commented Nov 28, 2016

CharlyPoppins commented Jun 6, 2017

akerouanton commented Sep 13, 2017