Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] better rlike function supported #7901

Closed
nvliyuan opened this issue Mar 20, 2023 · 2 comments
Closed

[FEA] better rlike function supported #7901

nvliyuan opened this issue Mar 20, 2023 · 2 comments
Assignees
Labels
feature request New feature or request

Comments

@nvliyuan
Copy link
Collaborator

I wish we can support end of line/string anchor in rlike function:

from pyspark.sql.functions import col
data = [("1", "123"), 
        ("2", "456"),
        ("3", "789"),
        ("4", "abc")]
df = spark.createDataFrame(data=data, schema=["id", "value"])
result = df.filter(col("value").rlike("^[0-9]*$"))
result.show()

image

@nvliyuan nvliyuan added feature request New feature or request ? - Needs Triage Need team to review and classify labels Mar 20, 2023
@mattahrens mattahrens removed the ? - Needs Triage Need team to review and classify label Mar 21, 2023
@NVnavkumar NVnavkumar self-assigned this Mar 22, 2023
@NVnavkumar
Copy link
Collaborator

NVnavkumar commented Apr 8, 2023

See related issue #5659. It looks like this is case that is caught up in one of the false positive use cases described there.

Unit test directly referenced there: #5659 (comment)

@nvliyuan
Copy link
Collaborator Author

See related issue #5659. It looks like this is case that is caught up in one of the false positive use cases described there.

Unit test directly referenced there: #5659 (comment)

Thanks for reminding, close this issue since duplicate with #5659

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants