ydata-profiling not working in spark environment #1413
UweBretschneider
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi there,

I really like the product and I am eager to use it in a Spark environment. However, it neither seems to work in AWS Glue 4.0 nor in my local environment. I keep getting this error with any kind of dataset:
And here:

To reproduce, my local environment is based on this image:
jupyter/pyspark-notebook:spark-3.3.0
ydata_profiling==4.4.0
Do you have any idea what the root cause could be?
Beta Was this translation helpful? Give feedback.
All reactions