SparkValue converter Timestamp Issue

[kakavenkat]

Apache Iceberg version

1.7.1 (latest release)

Query engine

PrestoDB

Please describe the bug 🐞

While converting Spark data into Iceberg records, timestamps and dates are being converted into long values, which is confusing for users. This behavior makes it difficult to interpret the actual timestamp or date values in the records. Additionally, some engines, such as Presto, are unable to understand the timestamp value in long format, making it unreadable. Users expect these fields to retain their original formats or be represented in a more user-friendly way.

Steps to Reproduce:

1. Read a CSV data containing timestamp into a DataFrame and pass Row data into the SparkValueConverter convert method, then insert it into an Iceberg table.
2. Inspect the resulting Iceberg records.
3. Observe that timestamp and date fields are stored as long values.
4. Try to run the query from Presto engine. will get the timestamp issue.

Willingness to contribute

• I can contribute a fix for this bug independently
• I would be willing to contribute a fix for this bug with guidance from the Iceberg community
• I cannot contribute a fix for this bug at this time

[kakavenkat]

PR for this issue #11841