Skip to content

Commit

Permalink
Use curl insecure mode
Browse files Browse the repository at this point in the history
  • Loading branch information
Guts committed Nov 12, 2021
1 parent 5edb86e commit 580ac95
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion scripts/1_scraper.sh
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ IFS="," read -a ARRAY_URL <<< $SOURCE_URL
for val in ${ARRAY_URL[@]}; do
echo "Téléchargement de la page : $val"
# télécharge la page HTML (stream), extrait les liens et le stockent dans un fichier texte
curl "$val" | \
curl -k "$val" | \
grep -oE '\b(https?|ftp|file)://[-A-Za-z0-9+&@# /%?=~_|!:,.;]*[-A-Za-z0-9+&@# /%=~_|]' >> "$OUTPUT_FILE"

done

0 comments on commit 580ac95

Please sign in to comment.