Datetime serialization error on ai.load_dataset()

[kmoppel]

What happened?

Seems to be dataset specific - most seem to work, but subsets from this one not for some reason: https://huggingface.co/datasets/autogluon/chronos_datasets
Loads ok via Python datasets.load_dataset("autogluon/chronos_datasets", "dominick")

Tried to meddle with "field_types" also but no luck. Happy with any workaround also.

pgai extension affected

0.8.0

pgai library affected

No response

PostgreSQL version used

17.2

What operating system did you use?

timescale/timescaledb-ha:pg17 i.e. 22.04

What installation method did you use?

Docker

What platform did you run on?

On prem/Self-hosted

Relevant log output and stack trace

SELECT ai.load_dataset( 'autogluon/chronos_datasets', 'dominick');
NOTICE:  creating table public.chronos_datasets_dominick
ERROR:  TypeError: Object of type datetime is not JSON serializable
CONTEXT:  Traceback (most recent call last):
  PL/Python function "load_dataset", line 35, in <module>
    return ai.load_dataset.load_dataset(
  PL/Python function "load_dataset", line 253, in load_dataset
  PL/Python function "load_dataset", line 254, in <listcomp>
  PL/Python function "load_dataset", line 230, in dumps
  PL/Python function "load_dataset", line 198, in encode
  PL/Python function "load_dataset", line 256, in iterencode
  PL/Python function "load_dataset", line 178, in default
PL/Python function "load_dataset"

How can we reproduce the bug?

SELECT ai.load_dataset( 'autogluon/chronos_datasets', 'dominick');

Are you going to work on the bugfix?

None