From 6f712cf031bf874590390a62611c4832c8c9e929 Mon Sep 17 00:00:00 2001 From: Luca Canali Date: Fri, 26 Apr 2024 20:48:50 +0200 Subject: [PATCH] Add link to the the blog entry on building a Spark perf lab --- README.md | 11 ++++++----- 1 file changed, 6 insertions(+), 5 deletions(-) diff --git a/README.md b/README.md index feac661..ca27ed3 100644 --- a/README.md +++ b/README.md @@ -42,11 +42,12 @@ and spark-shell/pyspark environments. ### Resources - - [TPCDS PySpark](https://github.com/LucaCanali/Miscellaneous/tree/master/Performance_Testing/TPCDS_PySpark) - A tool you can use run TPCDS with PySpark, instrumented with sparkMeasure - - [Spark monitoring dashboard](https://github.com/cerndb/spark-dashboard) - A custom monitoring pipeline and dashboard for Spark - - [Introductory course on Apache Spark](https://sparktraining.web.cern.ch/) - - [Flamegraphs for profiling Spark jobs](https://github.com/LucaCanali/Miscellaneous/blob/master/Spark_Notes/Tools_Spark_Pyroscope_FlameGraph.md) - - [Notes on Apache Spark](https://github.com/LucaCanali/Miscellaneous/tree/master/Spark_Notes) +- Blog on [building an Apache Spark Performance Lab](https://db-blog.web.cern.ch/node/195) +- [TPCDS PySpark](https://github.com/LucaCanali/Miscellaneous/tree/master/Performance_Testing/TPCDS_PySpark) - A tool you can use run TPCDS with PySpark, instrumented with sparkMeasure +- [Spark monitoring dashboard](https://github.com/cerndb/spark-dashboard) - A custom monitoring pipeline and dashboard for Spark +- [Introductory course on Apache Spark](https://sparktraining.web.cern.ch/) +- [Flamegraphs for profiling Spark jobs](https://github.com/LucaCanali/Miscellaneous/blob/master/Spark_Notes/Tools_Spark_Pyroscope_FlameGraph.md) +- [Notes on Apache Spark](https://github.com/LucaCanali/Miscellaneous/tree/master/Spark_Notes) Main author and contact: Luca.Canali@cern.ch