Support all column types in SignalSchema.from_column_types

[dreadatour]

Having registered dataset:

from datachain.lib.dc import DataChain 

DataChain.from_storage("s3://dql-50k-laion-files/").save("laion")

Making basic query on it:

from datachain.lib.dc import C, DataChain 

DataChain(name="laion").filter(C.file__path.glob("*.jpg"))

Fails with error:

Traceback (most recent call last):
  File "<string>", line 4, in <module>
  File "/Users/vlad/work/iterative/datachain/src/datachain/lib/dc.py", line 227, in __init__
    self.signals_schema |= SignalSchema.from_column_types(self.column_types)
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/vlad/work/iterative/datachain/src/datachain/lib/signal_schema.py", line 108, in from_column_types
    raise SignalSchemaError(
datachain.lib.signal_schema.SignalSchemaError: signal schema cannot be obtained for column 'sys__rand': unsupported type 'None'
Traceback (most recent call last):
  File "<string>", line 4, in <module>
  File "/Users/vlad/work/iterative/datachain/src/datachain/lib/dc.py", line 227, in __init__
    self.signals_schema |= SignalSchema.from_column_types(self.column_types)
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/vlad/work/iterative/datachain/src/datachain/lib/signal_schema.py", line 108, in from_column_types
    raise SignalSchemaError(
datachain.lib.signal_schema.SignalSchemaError: signal schema cannot be obtained for column 'sys__rand': unsupported type 'None'

This is because sys__rand column type is UInt64 (at least in SaaS), and this type is not exists in DATACHAIN_TO_TYPE, which leads to an error here: https://github.com/iterative/datachain/blob/main/src/datachain/lib/signal_schema.py#L107-L111

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 87.00%. Comparing base (06fdd8c) to head (5a9f335).
Report is 2 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #319      +/-   ##
==========================================
+ Coverage   86.94%   87.00%   +0.05%     
==========================================
  Files          90       90              
  Lines        9898     9901       +3     
  Branches     1995     1997       +2     
==========================================
+ Hits         8606     8614       +8     
+ Misses        944      939       -5     
  Partials      348      348              

Flag	Coverage Δ
datachain	86.93% <100.00%> (+0.05%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[mattseddon]

is there a regression test somewhere?

[cloudflare-workers-and-pages]

Deploying datachain-documentation with    Cloudflare Pages

Latest commit:	5a9f335
Status:	✅  Deploy successful!
Preview URL:	https://6f207fc6.datachain-documentation.pages.dev
Branch Preview URL:	https://support-all-column-types.datachain-documentation.pages.dev

View logs

[ilongin]

LGTM

[dreadatour]

is there a regression test somewhere?

Wasn't sure about this approach. Updated the PR with better code, added test, please, take a look 🙏

[dtulga]

LGTM, thanks!