fix: check top level nullability during write

[ion-elgreco]

Description

Adds a check for top level column nullability whether the arrays in recordbatch contain nulls when they shouldn't.

Related Issue(s)

• closes Faulty behavior on nullable columns when using DeltaTable.merge #2991

Notes

This is probably required in nested fields as well, so something for a follow-up

[codecov]

Codecov Report

Attention: Patch coverage is 93.84615% with 4 lines in your changes missing coverage. Please review.

Project coverage is 72.75%. Comparing base (1083c8c) to head (7c7fef7).
Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
crates/core/src/delta_datafusion/mod.rs	93.84%	0 Missing and 4 partials ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3026      +/-   ##
==========================================
+ Coverage   72.72%   72.75%   +0.03%     
==========================================
  Files         128      128              
  Lines       41357    41422      +65     
  Branches    41357    41422      +65     
==========================================
+ Hits        30076    30136      +60     
  Misses       9338     9338              
- Partials     1943     1948       +5     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[hntd187]

LGTM

[rtyler]

I think a good future refactor would be to store a reference to the snapshot in the DeltaDataChecker and then just use that instead of copying the constraints, invariants, etc for doing checks