Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug report #915

Closed
ehudtr7 opened this issue Jun 19, 2022 · 1 comment · Fixed by #916
Closed

bug report #915

ehudtr7 opened this issue Jun 19, 2022 · 1 comment · Fixed by #916

Comments

@ehudtr7
Copy link

ehudtr7 commented Jun 19, 2022

We use dbplyr through sparklyr.
When we moved to dbplyr version 2.2.0 we got a failure during execution of a code which previously worked fine, while getting the following error message:
"Error in dbi_ensure_no_backtick(x) : Can't escape back tick from string"
It happens when we sprarklyr::collect a spark data frame after some dplyr::anti_join operation.
We workaround it by applying sprarklyr::collect to each of the two data frames and then do the dplyr::anti_join on the resulted R data frames, instead of anti_join the original spark data frames.

@mgirlich
Copy link
Collaborator

@ehudtr7 I have added a PR that fixes the semi_join() and anti_join() issues with Spark. Until the CRAN release of dbplyr you can install it via

remotes::install_github(
  "tidyverse/dbplyr",
  ref = "anti-join-sparklyr-issue"
)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants