made jsonl writes use gzip compression.

[mdellabitta]

Important

Adds gzip compression to JSONL file writes in JsonlExecutor.scala.

• Behavior:
  • Adds gzip compression to JSONL file writes in JsonlExecutor.scala by setting option("compression", "gzip") in indexRecords.write.text(outputPath).
• Misc:
  • No other changes or refactoring in the code.

^{This description was created by for 5a5ac38. It will automatically update as commits are pushed.}

[ellipsis-dev]

👍 Looks good to me! Reviewed everything up to 5a5ac38 in 14 seconds

More details

• Looked at 13 lines of code in 1 files
• Skipped 0 files when reviewing.
• Skipped posting 1 drafted comments based on config settings.

1. src/main/scala/dpla/ingestion3/executors/JsonlExecutor.scala:67

• Draft comment:
  Ensure that downstream processes can handle gzip-compressed files, as this change affects the output format.
• Reason this comment was not posted:
  Confidence changes required: 50%
  The change to use gzip compression is appropriate, but it's important to ensure that the downstream processes can handle gzip-compressed files.

Workflow ID: wflow_bCU816p6Gb7SCmBv

---

You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.