diff --git a/r/NEWS.md b/r/NEWS.md index 90a9bba79d0b9..89e990ca2e246 100644 --- a/r/NEWS.md +++ b/r/NEWS.md @@ -27,6 +27,7 @@ * Added `decimal128()` (~~identical to `decimal()`~~) as the name is more explicit and updated docs to encourage its use. * Source builds now by default use `pkg-config` to search for system dependencies (such as `libz`) and link to them if present. To retain the previous behaviour of downloading and building all dependencies, set `ARROW_DEPENDENCY_SOURCE=BUNDLED`. +* Opening datasets now use async scanner by default which resolves a deadlock issues related to reading in large multi-CSV datasets # arrow 6.0.1 diff --git a/r/R/dataset-scan.R b/r/R/dataset-scan.R index 03c926fb43793..b7f58bfa4bd0b 100644 --- a/r/R/dataset-scan.R +++ b/r/R/dataset-scan.R @@ -34,7 +34,7 @@ #' to keep all rows. #' * `use_threads`: logical: should scanning use multithreading? Default `TRUE` #' * `use_async`: logical: should the async scanner (performs better on -#' high-latency/highly parallel filesystems like S3) be used? Default `FALSE` +#' high-latency/highly parallel filesystems like S3) be used? Default `TRUE` #' * `...`: Additional arguments, currently ignored #' @section Methods: #' `ScannerBuilder` has the following methods: @@ -73,7 +73,7 @@ Scanner$create <- function(dataset, projection = NULL, filter = TRUE, use_threads = option_use_threads(), - use_async = getOption("arrow.use_async", FALSE), + use_async = getOption("arrow.use_async", TRUE), batch_size = NULL, fragment_scan_options = NULL, ...) { diff --git a/r/man/Scanner.Rd b/r/man/Scanner.Rd index db6488f50127e..45184e321136a 100644 --- a/r/man/Scanner.Rd +++ b/r/man/Scanner.Rd @@ -22,7 +22,7 @@ named list of expressions to keep all rows. \item \code{use_threads}: logical: should scanning use multithreading? Default \code{TRUE} \item \code{use_async}: logical: should the async scanner (performs better on -high-latency/highly parallel filesystems like S3) be used? Default \code{FALSE} +high-latency/highly parallel filesystems like S3) be used? Default \code{TRUE} \item \code{...}: Additional arguments, currently ignored } }