Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update release note for Spark 3.5.3 #560

Closed
wants to merge 4 commits into from
Closed

Update release note for Spark 3.5.3 #560

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
81b1925
Update latest to 3.5.3
itholic Sep 24, 2024
3193828
Update release note for Spark 3.5.3
itholic Sep 25, 2024
8013cab
Merge branch 'asf-site' of https://github.com/apache/spark-website in…
itholic Sep 25, 2024
93a0902
bundle exec jekyll build
itholic Sep 25, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 3 additions & 4 deletions releases/_posts/2024-09-24-spark-release-3-5-3.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,6 @@ Spark 3.5.3 is the third maintenance release containing security and correctness
- [[SPARK-46037]](https://issues.apache.org/jira/browse/SPARK-46037) - When Left Join build Left, ShuffledHashJoinExec may result in incorrect results
- [[SPARK-46632]](https://issues.apache.org/jira/browse/SPARK-46632) - EquivalentExpressions throw IllegalStateException
- [[SPARK-48965]](https://issues.apache.org/jira/browse/SPARK-48965) - toJSON produces wrong values if DecimalType information is lost in as[Product]
- [[SPARK-49030]](https://issues.apache.org/jira/browse/SPARK-49030) - Self join of a CTE seems non-deterministic
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

does it mean these tickets miss specify the fixed version?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, they are not included (or even not resolved) in 3.5.3, so I also updated "Fix Version/s" to 3.5.4:

Screenshot 2024-09-25 at 4 48 45 PM

- [[SPARK-49038]](https://issues.apache.org/jira/browse/SPARK-49038) - Spark UI is showing wrong timing metrics for min and median time.
- [[SPARK-49039]](https://issues.apache.org/jira/browse/SPARK-49039) - Reset checkbox when executor metrics are loaded in the Stages tab
- [[SPARK-49179]](https://issues.apache.org/jira/browse/SPARK-49179) - Fix v2 multi bucketed inner joins throw AssertionError
Expand All @@ -39,14 +38,14 @@ Spark 3.5.3 is the third maintenance release containing security and correctness
- [[SPARK-49476]](https://issues.apache.org/jira/browse/SPARK-49476) - Base64 nullability change
- [[SPARK-49480]](https://issues.apache.org/jira/browse/SPARK-49480) - NullPointerException from SparkThrowableHelper.isInternalError method
- [[SPARK-49509]](https://issues.apache.org/jira/browse/SPARK-49509) - Use Platform.allocateDirectBuffer instead of ByteBuffer.allocateDirect
- [[SPARK-49628]](https://issues.apache.org/jira/browse/SPARK-49628) - ConstantFolding should copy stateful expression before evaluating
- [[SPARK-49699]](https://issues.apache.org/jira/browse/SPARK-49699) - Disable PruneFilters for streaming workloads
- [[SPARK-49152]](https://issues.apache.org/jira/browse/SPARK-49152) - V2SessionCatalog should use V2Command
- [[SPARK-49211]](https://issues.apache.org/jira/browse/SPARK-49211) - V2 Catalog can also support built-in data sources
- [[SPARK-49246]](https://issues.apache.org/jira/browse/SPARK-49246) - TableCatalog#loadTable should indicate if it's for writing
- [[SPARK-49275]](https://issues.apache.org/jira/browse/SPARK-49275) - Fix return type nullness of the xpath expression
- [[SPARK-49408]](https://issues.apache.org/jira/browse/SPARK-49408) - Poor performance in ProjectingInternalRow
- [[SPARK-49520]](https://issues.apache.org/jira/browse/SPARK-49520) - ArrayRemove() Function Need Remove NULL Value

### Dependency changes

- [[SPARK-45590]](https://issues.apache.org/jira/browse/SPARK-45590) - okio-1.15.0 CVE-2023-3635

You can consult JIRA for the [detailed changes](https://s.apache.org/spark-3.5.3).
Expand Down
9 changes: 5 additions & 4 deletions site/releases/spark-release-3-5-3.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -168,7 +168,6 @@ <h3 id="notable-changes">Notable changes</h3>
<li><a href="https://issues.apache.org/jira/browse/SPARK-46037">[SPARK-46037]</a> - When Left Join build Left, ShuffledHashJoinExec may result in incorrect results</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-46632">[SPARK-46632]</a> - EquivalentExpressions throw IllegalStateException</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-48965">[SPARK-48965]</a> - toJSON produces wrong values if DecimalType information is lost in as[Product]</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-49030">[SPARK-49030]</a> - Self join of a CTE seems non-deterministic</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-49038">[SPARK-49038]</a> - Spark UI is showing wrong timing metrics for min and median time.</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-49039">[SPARK-49039]</a> - Reset checkbox when executor metrics are loaded in the Stages tab</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-49179">[SPARK-49179]</a> - Fix v2 multi bucketed inner joins throw AssertionError</li>
Expand All @@ -185,14 +184,16 @@ <h3 id="notable-changes">Notable changes</h3>
<li><a href="https://issues.apache.org/jira/browse/SPARK-49476">[SPARK-49476]</a> - Base64 nullability change</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-49480">[SPARK-49480]</a> - NullPointerException from SparkThrowableHelper.isInternalError method</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-49509">[SPARK-49509]</a> - Use Platform.allocateDirectBuffer instead of ByteBuffer.allocateDirect</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-49628">[SPARK-49628]</a> - ConstantFolding should copy stateful expression before evaluating</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-49699">[SPARK-49699]</a> - Disable PruneFilters for streaming workloads</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-49152">[SPARK-49152]</a> - V2SessionCatalog should use V2Command</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-49211">[SPARK-49211]</a> - V2 Catalog can also support built-in data sources</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-49246">[SPARK-49246]</a> - TableCatalog#loadTable should indicate if it&#8217;s for writing</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-49275">[SPARK-49275]</a> - Fix return type nullness of the xpath expression</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-49408">[SPARK-49408]</a> - Poor performance in ProjectingInternalRow</li>
<li><a href="https://issues.apache.org/jira/browse/SPARK-49520">[SPARK-49520]</a> - ArrayRemove() Function Need Remove NULL Value</li>
</ul>

<h3 id="dependency-changes">Dependency changes</h3>

<ul>
<li><a href="https://issues.apache.org/jira/browse/SPARK-45590">[SPARK-45590]</a> - okio-1.15.0 CVE-2023-3635</li>
</ul>

Expand Down
Loading