WIP(schema-wasm): support schema split into multiple files #4787
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This commit implements multi-file schema handling in the Prisma Schema Language.
At a high level, instead of accepting a single string, `psl::validate_multi_file()` is an alternative to `psl::validate()` that accepts something morally equivalent to:
```json
{
"./prisma/schema/a.prisma": "datasource db { ... }",
"./prisma/schema/nested/b.prisma": "model Test { ... }"
}
```
There are tests for PSL validation with multiple schema files, but most of the rest of engines still consumes the single file version of `psl::validate()`. The implementation and the return type are shared between `psl::validate_multi_file()` and `psl::validate()`, so the change is completely transparent, other than the expectation of passing in a list of (file_name, file_contents) instead of a single string. The `psl::validate()` entry point should behave exactly the same as `psl::multi_schema()` with a single file named `schema.prisma`. In particular, it has the exact same return type.
Implementation
==============
This is achieved by extending `Span` to contain, in addition to a start and end offset, a `FileId`. The `FileId` is a unique identifier for a file and its parsed `SchemaAst` inside `ParserDatabase`. The identifier types for AST items in `ParserDatabase` are also extended to contain the `FileId`, so that they can be uniquely referred to in the context of the (multi-file) schema. After the analysis phase (the `parser_database` crate), consumers of the analyzed schema become multi-file aware completely transparently, no change is necessary in the other engines.
The only changes that will be required at scattered points across the codebase are the `psl::validate()` call sites that will need to receive a `Vec<Box<Path>, SourceFile>` instead of a single `SourceFile`. This PR does _not_ deal with that, but it makes where these call sites are obvious by what entry points they use: `psl::validate()`, `psl::parse_schema()` and the various `*_assert_single()` methods on `ParserDatabase`.
The PR contains tests confirming that schema analysis, validation and displaying diagnostics across multiple files works as expected.
Status of this PR
=================
This is going to be directly mergeable after review, and it will not affect the current schema handling behaviour when dealing with a single schema file.
Next steps
==========
- Replace all calls to `psl::validate()` with calls to `psl::validate_multi_file()`.
- The `*_assert_single()` calls should be progressively replaced with their multi-file counterparts across engines.
- The language server should start sending multiple files to prisma-schema-wasm in all calls. This is not in the spirit of the language server spec, but that is the most immediate solution. We'll have to make `range_to_span()` in `prisma-fmt` multi-schema aware by taking a FileId param.
Links
=====
Relevant issue: prisma/prisma#2377
Also see the [internal design doc](https://www.notion.so/prismaio/Multi-file-Schema-24d68fe8664048ad86252fe446caac24?d=68ef128f25974e619671a9855f65f44d#2889a038e68c4fe1ac9afe3cd34978bd).
SevInf
force-pushed
the
psl-multi-file-schema
branch
from
f34efb7
to
1e42d35
Compare
SevInf
force-pushed
the
feat/multi-schema-fmt
branch
from
883146e
to
0128219
Compare
WASM Query Engine file Size
|
CodSpeed Performance ReportMerging #4787 will improve performances by 5.67%Comparing Summary
Benchmarks breakdown
|
✅ WASM query-engine performance won't change substantially (0.996x)Full benchmark reportAfter changes in e32d0dd |
added 2 commits
April 2, 2024 15:22
|
Using
|
SevInf
commented
Apr 5, 2024
Co-authored-by: Serhii Tatarintsev <tatarintsev@prisma.io>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
getDMMFvalidategetConfigformat- partially done, multi-file input needs to be expsoed to wasmmergeSchemasCloses https://github.com/prisma/team-orm/issues/1038
/integration