You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Ensure you use `puppeteer` not `puppeteer-core` in your build configuration.
503
-
</Note>
501
+
Follow [this example](/examples/puppeteer) to get setup with Trigger.dev and Puppeteer in your project.
504
502
505
503
#### ffmpeg
506
504
@@ -534,6 +532,8 @@ export default defineConfig({
534
532
535
533
This extension will also add the `FFMPEG_PATH` and `FFPROBE_PATH` to your environment variables, making it easy to use popular ffmpeg libraries like `fluent-ffmpeg`.
536
534
535
+
Follow [this example](/examples/ffmpeg-video-processing) to get setup with Trigger.dev and FFmpeg in your project.
536
+
537
537
#### esbuild plugins
538
538
539
539
You can easily add existing or custom esbuild plugins to your build process using the `esbuildPlugin` extension:
2.[Generate a PDF from a web page](/examples/puppeteer#generate-a-pdf-from-a-web-page)
16
-
3.[Scrape content from a web page](/examples/puppeteer#scrape-data-from-a-website)
16
+
3.[Scrape content from a web page](/examples/puppeteer#scrape-content-from-a-web-page)
17
17
18
-
<ScrapingWarning/>
18
+
<ScrapingWarning/>
19
19
20
20
## Build configurations
21
21
@@ -34,9 +34,11 @@ export default defineConfig({
34
34
});
35
35
```
36
36
37
+
Learn more about [build configurations](/config/config-file#build-configuration) including setting default retry settings, customizing the build environment, and more.
38
+
37
39
## Set an environment variable
38
40
39
-
Add the following environment variable in your Trigger.dev dashboard on the Environment Variables page:
41
+
Set the following environment variable in your [Trigger.dev dashboard](/deploy-environment-variables) or [using the SDK](/deploy-environment-variables#in-your-code):
In this example we use Puppeteer to log out the title of a web page, in this case Google.
51
+
In this example we use [Puppeteer](https://pptr.dev/) to log out the title of a web page, in this case from the [Trigger.dev](https://trigger.dev) landing page.
There's no payload required for this task so you can just click "Run test" from the Test page in the dashboard.
77
+
There's no payload required for this task so you can just click "Run test" from the Test page in the dashboard. Learn more about testing tasks [here](/run-tests).
76
78
77
79
## Generate a PDF from a web page
78
80
79
81
### Overview
80
82
81
-
In this example we use Puppeteer to generate a PDF from a web page and upload it to Cloudflare R2.
83
+
In this example we use [Puppeteer](https://pptr.dev/) to generate a PDF from the [Trigger.dev](https://trigger.dev) landing page and upload it to [Cloudflare R2](https://developers.cloudflare.com/r2/).
There's no payload required for this task so you can just click "Run test" from the Test page in the dashboard.
140
+
There's no payload required for this task so you can just click "Run test" from the Test page in the dashboard. Learn more about testing tasks [here](/run-tests).
139
141
140
142
## Scrape content from a web page
141
143
142
144
### Overview
143
145
144
-
In this example we use Puppeteer with a BrowserBase proxy to scrape the GitHub stars count from the [Trigger.dev](https://trigger.dev) landing page and log it out.
146
+
In this example we use [Puppeteer](https://pptr.dev/) with a [BrowserBase](https://www.browserbase.com/) proxy to scrape the GitHub stars count from the [Trigger.dev](https://trigger.dev) landing page and log it out. See [this list](/examples/puppeteer#proxying) for more proxying services we recommend.
145
147
146
-
<ScrapingWarning />
148
+
<Warning>
149
+
**WEB SCRAPING:** When web scraping, you MUST use a proxy to comply with our terms of service. Direct scraping of third-party websites without the site owner's permission using Trigger.dev Cloud is prohibited and will result in account suspension.
There's no payload required for this task so you can just click "Run test" from the Test page in the dashboard.
202
+
There's no payload required for this task so you can just click "Run test" from the Test page in the dashboard. Learn more about testing tasks [here](/run-tests).
**WEB SCRAPING WARNING:** Direct scraping of third-party websites without explicit permission using Trigger.dev Cloud is strictly prohibited and will result in immediate account suspension. If web scraping is necessary for your project, you MUST use a proxy service to comply with our terms of service.
2
+
**WEB SCRAPING:**When web scraping, you MUST use a proxy to comply with our terms of service. Direct scraping of third-party websites without the site owner's permission using Trigger.dev Cloud is prohibited and will result in account suspension. See [this example](/examples/puppeteer#scrape-content-from-a-web-page) using a proxy.
0 commit comments