r/adbcsnowflake install failure

[andrewtaylor-appfolio]

R Version: 4.3.1
pkgbuild Version: > packageVersion("pkgbuild", pak:::private_lib_dir()) [1] ‘1.4.3’

Attempts to install adbcsnowflake using either install_github or pak::pak("apache/arrow-adbc/r/adbcsnowflake") are resulting in failures.

Install Github:

install_github("apache/arrow-adbc/r/adbcsnowflake")
Downloading GitHub repo apache/arrow-adbc@HEAD
Error: Failed to install 'adbcsnowflake' from GitHub:
arguments imply differing number of rows: 3, 20

Installing via pak:

> pak::pak("apache/arrow-adbc/r/adbcsnowflake")
! Using bundled GitHub PAT. Please add your own PAT using `gitcreds::gitcreds_set()`.
✔ Loading metadata database ... done                                          
                                                                              
→ Will install 1 package.
→ Will download 1 package with unknown size.
+ adbcsnowflake   0.9.0.9000 👷🏻‍♂️🔧 ⬇ (GitHub: 21fba98)
ℹ Getting 1 pkg with unknown size
✔ Cached copy of adbcsnowflake 0.9.0.9000 (source) is the latest build
✔ No downloads needed, all packages are cached
ℹ Building adbcsnowflake 0.9.0.9000
✖ Failed to build adbcsnowflake 0.9.0.9000                           
Error:                                                               
! error in pak subprocess
Caused by error in `stop_task_build(state, worker)`:
! Failed to build source package adbcsnowflake.
Type .Last.error to see the more details.
> .Last.error
<callr_error/rlib_error_3_0/rlib_error/error>
Error: 
! error in pak subprocess
Caused by error in `stop_task_build(state, worker)`:
! Failed to build source package adbcsnowflake.
---
Backtrace:
1. pak::pak("apache/arrow-adbc/r/adbcsnowflake")
2. pak::pkg_install(pkg, ...)
3. pak:::remote(function(...) get("pkg_install_do_plan", asNamespace("pak"))(...), …
4. err$throw(res$error)
---
Subprocess backtrace:
 1. base::withCallingHandlers(cli_message = function(msg) { …
 2. get("pkg_install_do_plan", asNamespace("pak"))(...)
 3. proposal$install()
 4. pkgdepends::install_package_plan(plan, lib = private$library, num_workers = nw, …
 5. base::withCallingHandlers({ …
 6. pkgdepends:::handle_events(state, events)
 7. pkgdepends:::handle_event(state, i)
 8. pkgdepends:::stop_task(state, worker)
 9. pkgdepends:::stop_task_build(state, worker)
10. base::throw(pkg_error("Failed to build source package {.pkg {pkg}}.", …
11. | base::signalCondition(cond)
12. global (function (e) …

Also tried the suggested:

install.packages("pkgbuild", pak:::private_lib_dir())
pak::cache_clean()

Please let me know if anything else is needed. Any direction would be helpful.

[zeroshade]

CC @paleolimbot

[paleolimbot]

I will dig into this more shortly, but the first thing I'm wondering if a go compiler is installed (i.e., can you type go version into a terminal?). An earlier version of the package downloaded its own copy of a Go compiler if it didn't find one and we should probably add that back in!

[andrewtaylor-appfolio]

Thanks for the response - I didn't know that was the case until I came across a similar issue 966, which led me to install it.

I installed go via Brew.

Version:

go version
go version go1.21.6 darwin/arm64

Location:

which go
/opt/homebrew/bin/go

[paleolimbot]

Got it! That should work.

A workaround would be to git clone https://github.com/apache/arrow-adbc.git && cd arrow-adbc/r/adbcsnowflake && R CMD INSTALL . If that doesn't work, it will probably at least display a more useful error message.

[andrewtaylor-appfolio]

Thank you. This is very helpful. Here's the detailed error message:

All files successfully copied to src/go/adbc
Trying 'go version' with GO_BIN at '/opt/homebrew/bin/go'
go version go1.21.6 darwin/arm64
Found vendored ADBC Snowflake driver
** libs
Warning: R include directory is empty -- perhaps need to install R-devel.rpm or similar
using C compiler: ‘Apple clang version 15.0.0 (clang-1500.1.0.2.5)’
using SDK: ‘MacOSX14.2.sdk’
clang -arch arm64 -I"/opt/homebrew/bin" -DNDEBUG -DADBC_EXPORT=""   -I/opt/R/arm64/include    -fPIC  -falign-functions=64 -Wall -g -O2  -c init.c -o init.o
init.c:19:10: fatal error: 'R.h' file not found
#include <R.h>
         ^~~~~
1 error generated.
make: *** [init.o] Error 1
ERROR: compilation failed for package ‘adbcsnowflake’
* removing ‘/Library/Frameworks/R.framework/Versions/4.3-arm64/Resources/library/adbcsnowflake’
 

R is running from the current directory:

ls -lth /usr/local/bin/R
lrwxr-xr-x  1 root  wheel    47B Feb  7 21:11 /usr/local/bin/R -> /Library/Frameworks/R.framework/Resources/bin/R

R include:

R.home('include')
[1] "/opt/homebrew/bin"

The current location of R.h is in:

ls /Library/Frameworks/R.framework/Resources/include/
R.h             R_ext           Rconfig.h       Rdefines.h      Rembedded.h     Rinterface.h    Rinternals.h    Rmath.h         Rversion.h      libintl.h

I'm assuming I'll need to set env variables to reference the correct include location for clang?

[andrewtaylor-appfolio]

It works now. For the future...

My R Include path was set incorrectly (user error here):

> R.home('include')
[1] "/opt/homebrew/bin"

I reassigned it to the following which fixed the issue.
/Library/Frameworks/R.framework/Resources/include/

This can be closed. Thank you for the help.

[paleolimbot]

Thanks for reporting anyway! That is indeed a very strange error. We're working on getting binaries published through CRAN or R-universe which should help make this easier in the future!