Skip to content

Commit

Permalink
Add a step so that the meta-info on the website (last scrape date and…
Browse files Browse the repository at this point in the history
… how many pages were scraped) is available
  • Loading branch information
kordwarshuis committed Jul 23, 2024
1 parent 5d9a4e3 commit 51cfc33
Showing 1 changed file with 17 additions and 1 deletion.
18 changes: 17 additions & 1 deletion search-index-typesense/import.sh
Original file line number Diff line number Diff line change
Expand Up @@ -101,4 +101,20 @@ import_jsonl_files_to_search_index() {
}

# Start importing the files
import_jsonl_files_to_search_index $output_dir $log_dir
import_jsonl_files_to_search_index $output_dir $log_dir

# After importing the data into Typesense, the meta info
# (when was de last scrape and how many pages were scraped)
# must be pushed into the repository so it will be displayed
# on the website.
# ==> Add and commit /output/indexed-in-KERISSE.html
# with the message "Update content"
# Github Actions will then `npm run build` and push the changes to the website.
git add ./search-index-typesense/search-index-entries
git commit -m "Update content"
git push origin main





0 comments on commit 51cfc33

Please sign in to comment.