[R] Can't install `adbcflightsql` from CRAN

[maxfirman]

What happened?

I attempted to install adbcflightsql and got the following error:

> install.packages("adbcflightsql")
Installing package into ‘/home/linuxbrew/.linuxbrew/lib/R/4.3/site-library’
(as ‘lib’ is unspecified)
Warning message:
package ‘adbcflightsql’ is not available for this version of R

A version of this package for your version of R might be available elsewhere,
see the ideas at
https://cran.r-project.org/doc/manuals/r-patched/R-admin.html#Installing-packages 

How can we reproduce the bug?

Try to install adbcflightsql

Environment/Setup

I've tested on an Ubuntu22 and a Fedora39 machine. I get the same error on both. I haven't tested on a Windows or MAC.

[eitsupi]

I think the adbcflightsql package is not released on CRAN.
You may install from GitHub.

[maxfirman]

Thanks @eitsupi. I think you are correct that the package is not published to CRAN. However the docs here suggest that it is.

It would be great if this package was published to CRAN. Its not always possible to install from GitHub behind corporate proxies.

[aiguofer]

Ran into the same issue, docs say that you can install from CRAN but that seems incorrect. If the driver manager is available (https://cran.r-project.org/web/packages/adbcdrivermanager/) it seems that the individual drivers should as well.

I tried building with pak but I get the following error:

→ Will install 1 package.
→ Will download 1 package with unknown size.
+ adbcflightsql   0.13.0.9000 👷🏻‍♂️🔧 ⬇ (GitHub: 4a0ebcd)
ℹ Getting 1 pkg with unknown size
✔ Got adbcflightsql 0.13.0.9000 (source) (5.58 MB)
ℹ Packaging adbcflightsql 0.13.0.9000
✔ Packaged adbcflightsql 0.13.0.9000 (1.6s)
ℹ Building adbcflightsql 0.13.0.9000
✖ Failed to build adbcflightsql 0.13.0.9000 (1.5s)
Error:
! error in pak subprocess
Caused by error in `stop_task_build(state, worker)`:
! Failed to build source package adbcflightsql.
---
Standard output:
[1] TRUE
Vendoring files from arrow-adbc/go/adbc to src/go/adbc:
- ../../go/adbc/adbc.go  ->  src/go/adbc/adbc.go
- ../../go/adbc/driver/bigquery/bigquery_database.go  ->  src/go/adbc/driver/bigquery/bigquery_database.go
- ../../go/adbc/driver/bigquery/connection.go  ->  src/go/adbc/driver/bigquery/connection.go
- ../../go/adbc/driver/bigquery/driver_test.go  ->  src/go/adbc/driver/bigquery/driver_test.go
- ../../go/adbc/driver/bigquery/driver.go  ->  src/go/adbc/driver/bigquery/driver.go
- ../../go/adbc/driver/bigquery/record_reader.go  ->  src/go/adbc/driver/bigquery/record_reader.go
- ../../go/adbc/driver/bigquery/statement.go  ->  src/go/adbc/driver/bigquery/statement.go
- ../../go/adbc/driver/flightsql/cmd/testserver/main.go  ->  src/go/adbc/driver/flightsql/cmd/testserver/main.go
- ../../go/adbc/driver/flightsql/flightsql_adbc_server_test.go  ->  src/go/adbc/driver/flightsql/flightsql_adbc_server_test.go
- ../../go/adbc/driver/flightsql/flightsql_adbc_test.go  ->  src/go/adbc/driver/flightsql/flightsql_adbc_test.go
- ../../go/adbc/driver/flightsql/flightsql_connection.go  ->  src/go/adbc/driver/flightsql/flightsql_connection.go
- ../../go/adbc/driver/flightsql/flightsql_database.go  ->  src/go/adbc/driver/flightsql/flightsql_database.go
- ../../go/adbc/driver/flightsql/flightsql_driver.go  ->  src/go/adbc/driver/flightsql/flightsql_driver.go
- ../../go/adbc/driver/flightsql/flightsql_statement.go  ->  src/go/adbc/driver/flightsql/flightsql_statement.go
- ../../go/adbc/driver/flightsql/logging.go  ->  src/go/adbc/driver/flightsql/logging.go
- ../../go/adbc/driver/flightsql/record_reader_test.go  ->  src/go/adbc/driver/flightsql/record_reader_test.go
- ../../go/adbc/driver/flightsql/record_reader.go  ->  src/go/adbc/driver/flightsql/record_reader.go
- ../../go/adbc/driver/flightsql/timeouts.go  ->  src/go/adbc/driver/flightsql/timeouts.go
- ../../go/adbc/driver/flightsql/utils.go  ->  src/go/adbc/driver/flightsql/utils.go
- ../../go/adbc/driver/internal/driverbase/connection.go  ->  src/go/adbc/driver/internal/driverbase/connection.go
- ../../go/adbc/driver/internal/driverbase/database.go  ->  src/go/adbc/driver/internal/driverbase/database.go
- ../../go/adbc/driver/internal/driverbase/driver_info_test.go  ->  src/go/adbc/driver/internal/driverbase/driver_info_test.go
- ../../go/adbc/driver/internal/driverbase/driver_info.go  ->  src/go/adbc/driver/internal/driverbase/driver_info.go
- ../../go/adbc/driver/internal/driverbase/driver_test.go  ->  src/go/adbc/driver/internal/driverbase/driver_test.go
- ../../go/adbc/driver/internal/driverbase/driver.go  ->  src/go/adbc/driver/internal/driverbase/driver.go
- ../../go/adbc/driver/internal/driverbase/error.go  ->  src/go/adbc/driver/internal/driverbase/error.go
- ../../go/adbc/driver/internal/driverbase/logging.go  ->  src/go/adbc/driver/internal/driverbase/logging.go
- ../../go/adbc/driver/internal/shared_utils.go  ->  src/go/adbc/driver/internal/shared_utils.go
- ../../go/adbc/driver/panicdummy/panicdummy_adbc.go  ->  src/go/adbc/driver/panicdummy/panicdummy_adbc.go
- ../../go/adbc/driver/snowflake/binding.go  ->  src/go/adbc/driver/snowflake/binding.go
- ../../go/adbc/driver/snowflake/bulk_ingestion_test.go  ->  src/go/adbc/driver/snowflake/bulk_ingestion_test.go
- ../../go/adbc/driver/snowflake/bulk_ingestion.go  ->  src/go/adbc/driver/snowflake/bulk_ingestion.go
- ../../go/adbc/driver/snowflake/concat_reader.go  ->  src/go/adbc/driver/snowflake/concat_reader.go
- ../../go/adbc/driver/snowflake/connection.go  ->  src/go/adbc/driver/snowflake/connection.go
- ../../go/adbc/driver/snowflake/driver_test.go  ->  src/go/adbc/driver/snowflake/driver_test.go
- ../../go/adbc/driver/snowflake/driver.go  ->  src/go/adbc/driver/snowflake/driver.go
- ../../go/adbc/driver/snowflake/record_reader.go  ->  src/go/adbc/driver/snowflake/record_reader.go
- ../../go/adbc/driver/snowflake/snowflake_database.go  ->  src/go/adbc/driver/snowflake/snowflake_database.go
- ../../go/adbc/driver/snowflake/statement.go  ->  src/go/adbc/driver/snowflake/statement.go
- ../../go/adbc/drivermgr/arrow-adbc/adbc_driver_manager.h  ->  src/go/adbc/drivermgr/arrow-adbc/adbc_driver_manager.h
- ../../go/adbc/drivermgr/arrow-adbc/adbc.h  ->  src/go/adbc/drivermgr/arrow-adbc/adbc.h
- ../../go/adbc/drivermgr/doc.go  ->  src/go/adbc/drivermgr/doc.go
- ../../go/adbc/drivermgr/wrapper_sqlite_test.go  ->  src/go/adbc/drivermgr/wrapper_sqlite_test.go
- ../../go/adbc/drivermgr/wrapper.go  ->  src/go/adbc/drivermgr/wrapper.go
- ../../go/adbc/ext.go  ->  src/go/adbc/ext.go
- ../../go/adbc/go.mod  ->  src/go/adbc/go.mod
- ../../go/adbc/go.sum  ->  src/go/adbc/go.sum
- ../../go/adbc/infocode_string.go  ->  src/go/adbc/infocode_string.go
- ../../go/adbc/LICENSE.txt  ->  src/go/adbc/LICENSE.txt
- ../../go/adbc/pkg/bigquery/driver.go  ->  src/go/adbc/pkg/bigquery/driver.go
- ../../go/adbc/pkg/bigquery/utils.c  ->  src/go/adbc/pkg/bigquery/utils.c
- ../../go/adbc/pkg/bigquery/utils.h  ->  src/go/adbc/pkg/bigquery/utils.h
- ../../go/adbc/pkg/doc.go  ->  src/go/adbc/pkg/doc.go
- ../../go/adbc/pkg/flightsql/driver.go  ->  src/go/adbc/pkg/flightsql/driver.go
- ../../go/adbc/pkg/flightsql/utils.c  ->  src/go/adbc/pkg/flightsql/utils.c
- ../../go/adbc/pkg/flightsql/utils.h  ->  src/go/adbc/pkg/flightsql/utils.h
- ../../go/adbc/pkg/gen/main.go  ->  src/go/adbc/pkg/gen/main.go
- ../../go/adbc/pkg/panicdummy/driver.go  ->  src/go/adbc/pkg/panicdummy/driver.go
- ../../go/adbc/pkg/panicdummy/utils.c  ->  src/go/adbc/pkg/panicdummy/utils.c
- ../../go/adbc/pkg/panicdummy/utils.h  ->  src/go/adbc/pkg/panicdummy/utils.h
- ../../go/adbc/pkg/snowflake/driver.go  ->  src/go/adbc/pkg/snowflake/driver.go
- ../../go/adbc/pkg/snowflake/utils.c  ->  src/go/adbc/pkg/snowflake/utils.c
- ../../go/adbc/pkg/snowflake/utils.h  ->  src/go/adbc/pkg/snowflake/utils.h
- ../../go/adbc/sqldriver/doc.go  ->  src/go/adbc/sqldriver/doc.go
- ../../go/adbc/sqldriver/driver_internals_test.go  ->  src/go/adbc/sqldriver/driver_internals_test.go
- ../../go/adbc/sqldriver/driver_test.go  ->  src/go/adbc/sqldriver/driver_test.go
- ../../go/adbc/sqldriver/driver.go  ->  src/go/adbc/sqldriver/driver.go
- ../../go/adbc/sqldriver/flightsql/flightsql_test.go  ->  src/go/adbc/sqldriver/flightsql/flightsql_test.go
- ../../go/adbc/sqldriver/flightsql/flightsql.go  ->  src/go/adbc/sqldriver/flightsql/flightsql.go
- ../../go/adbc/standard_schemas.go  ->  src/go/adbc/standard_schemas.go
- ../../go/adbc/status_string.go  ->  src/go/adbc/status_string.go
- ../../go/adbc/tools.go  ->  src/go/adbc/tools.go
- ../../go/adbc/utils/utils.go  ->  src/go/adbc/utils/utils.go
- ../../go/adbc/validation/validation.go  ->  src/go/adbc/validation/validation.go
All files successfully copied to src/go/adbc
---
Standard error:
Running bootstrap.R...
---
Backtrace:
1. pak::pak("apache/arrow-adbc/r/adbcflightsql")
2. pak::pkg_install(pkg, ...)
3. pak:::remote(function(...) get("pkg_install_do_plan", asNamespace("pak"))(...), …
4. err$throw(res$error)
---
Subprocess backtrace:
 1. base::withCallingHandlers(cli_message = function(msg) { …
 2. get("pkg_install_do_plan", asNamespace("pak"))(...)
 3. proposal$install()
 4. pkgdepends::install_package_plan(plan, lib = private$library, num_workers = nw, …
 5. base::withCallingHandlers({ …
 6. pkgdepends:::handle_events(state, events)
 7. pkgdepends:::handle_event(state, i)
 8. pkgdepends:::stop_task(state, worker)
 9. pkgdepends:::stop_task_build(state, worker)
10. base::throw(pkg_error("Failed to build source package {.pkg {pkg}}.", …
11. | base::signalCondition(cond)
12. global (function (e) …
Execution halted

[paleolimbot]

Ran into the same issue, docs say that you can install from CRAN but that seems incorrect

The issue with flightsql, snowflake, and (soon) BigQuery is that CRAN does not provide a Go compiler on Windows, so the utility of submitting it is limited. We don't have a way to build binaries ourselves at the moment, unfortunately.

I tried building with pak but I get the following error

It seems like the actual error is obscured here, but the most common error is that a Go compiler is not installed ( https://go.dev/dl/ or use a package manager like brew install go or apt-get install golang (double check those names!)

[aiguofer]

The issue with flightsql, snowflake, and (soon) BigQuery is that CRAN does not provide a Go compiler on Windows, so the utility of submitting it is limited. We don't have a way to build binaries ourselves at the moment, unfortunately.

ahh bummer :( might be worth updating the docs to remove this section:

You can install the released version of adbcflightsql from CRAN with:

install.packages("adbcflightsql")

It seems like the actual error is obscured here, but the most common error is that a Go compiler is not installed ( go.dev/dl or use a package manager like brew install go or apt-get install golang (double check those names!)

I already have Go installed so that's not my issue... any idea on how to debug? I'm not very familiar with R

[eitsupi]

How about installing from R-multiverse?
I have registered adbcflightsql and seems working fine (binary packages are available).
https://community.r-multiverse.org/adbcflightsql

cc @shikokuchuo

[eitsupi]

It seems like the actual error is obscured here, but the most common error is that a Go compiler is not installed ( go.dev/dl or use a package manager like brew install go or apt-get install golang (double check those names!)

I think pak is known to be unclear about error messages (r-lib/pak#266)
In my opinion, it is much safer for beginners to use install.packages and remotes package's functions.

For packages that cannot exist on CRAN, I think it is recommended to install them from R-multiverse with install.packages. Such as:
https://github.com/pola-rs/r-polars?tab=readme-ov-file#install

[aiguofer]

So i figured out my issue. I was using an older version of Go. Once I updated to latest, it compiled fine. That being said, I agree installing from R-multiverse is a much better experience!! thanks so much for setting that up

[eitsupi]

Thanks to @shikokuchuo, adbcsnowflake (and nanoarrow) can now also be installed from R-multiverse.

[shikokuchuo]

You're welcome! copying @wlandau @jeroen @maelle for their info.

[eitsupi]

Do you think it would be possible to update the README and rewrite the installation instructions from R-multiverse?

[paleolimbot]

Now that we've pretty much abandoned CRAN hopes for Go-based drivers, we could also automatically download + build using the latest Go version (which might take longer but would more reliably work). (In addition to R-multiverse instructions!). The next release will add a bigquery driver that is Go based as well so we should probably have better instructions about it given there are three of them now.