Improve error reporting when streaming snapshot ID is no longer available

[cccs-jc]

Feature Request / Improvement

When doing a spark readStream on a table where the snapshots have been removed. A streaming job might refer to an old snapshot ID which is no longer available. Under these conditions the current code throws a null pointer exception here

iceberg/spark/v3.3/spark/src/main/java/org/apache/iceberg/spark/source/SparkMicroBatchStream.java

Line 234 in e7df8c1

String op = snapshot.operation();

It would be better to throw an exception here when obtaining the snapshot from the table. If it returns null we could throw an exception saying snapshot ID 1234 could not be found in table.

iceberg/spark/v3.3/spark/src/main/java/org/apache/iceberg/spark/source/SparkMicroBatchStream.java

Line 215 in e7df8c1

if (!shouldProcess(table.snapshot(currentOffset.snapshotId()))) {

Query engine

None

[cccs-jc]

@singhpk234 does this seem like a good idea?

[amogh-jahagirdar]

I actually raised a PR for this a while back, I can follow up on this

[github-actions]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

[github-actions]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'