-
Notifications
You must be signed in to change notification settings - Fork 12.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Proposal: Conditional Compilation #3538
Comments
I don't quite like that the proposal isn't addressing conditional imports. I think that is the core issue of having conditionals in the first place.
I'm not sure if I like the runtime property check. We are all developers and we know TypeScript is a compiled language. Why do we need to have a solution when we don't define any flag values? I would rather see it compile as if all conditionals where true then. I also like the design of conditional flags in C# and C++ because they look like "commented code". Which kind of infer that they only interfere on compile time and not during runtime. They are also simple to understand just like a simple if statement. I guess they are also simpler for the compiler, just let the scanner scan or skip characters depending on if the conditional are true or false. Instead of having a complex tree shaking that removes dead code. With your solution you are also using runtime statements |
I think that would be a different solution. That is mainly because it is not likely the same pattern can be used with imports without breaking the functionality. The way we addressed this in Dojo, which then worked for both runtime and build time, was to utilise the AMD loader plugin mechanism to evaluate the "magical" MID string expressed as a ternary expression to determine if a certain
Sometimes a developer will want their code to be emitted as isomorphic, especially if they want to distribute it as a library without the end user having to be aware of TypeScript. This is aligned to design goal "4. Emit clean, idiomatic, recognizable JavaScript code." as well as "7. Preserve runtime behavior of all JavaScript code." and "10. Be a cross-platform development tool." What the runtime code is, is up to the developer and whether it gets emitted or not is up to the developer.
Maybe you should come up with an alternative proposal. Also, it would seem that that is something that TypeScript has largely avoided, "compiler hints". I dislike "auto-magic" comments/compiler hints personally and seeing it avoided in TypeScript made me happy. You often end up with surprises and the TypeScript Design Goals also state that TypeScript should not "introduce behaviour that is likely to surprise users".
Not necessarily, you will still be modifying the AST if you expect things like intellisense to continue to work. Ignoring written code under certain conditions is never straight forward. I am not sure why you feel comments make this process any easier for the compiler.
Exactly, but only when supplied with compile time values. Why do you feel that is a bad thing? |
I would also like that TS supports conditional compilation, but more in the C++/C# way too.
With a C++/C# implementation:
Additionally, if TS would provide "macros" for the current filename and line number, I would be able to retrieve them relative to the TS source code, whereas today a stack trace reports line numbers relative to the generated JS file... Some points from your proposal:
|
@mhegazy said "Pre-processor directives (i.e.#ifdefs) are not desirable." I took him at his word. As far as your example, I am a bit lost on how the following would eliminate the function call? Doesn't it generate an assert as a noop anyways, just like you did in TypeScript?
Totally different topic... You do know about the sourceMap compiler option?
There is a big difference between build/compile time value and a runtime value. The intent of my proposal is to allow both, without changing the source code. You can provide all your "feature" logic in your code and then you can choose to have it compiled out, or resolved runtime. In theory, you would always want to have some runtime value. Other examples would be like if you where trying to shim things like Promises or Object.observe. You would write the code to handle both cases, with a clear feature/condition and then you can choose to have that resolved at runtime (and the whole set of code is emitted, including the resolution logic) or you could choose to have two builds, both optimised for the features being there or not.
Why I proposed it was because I felt it would lead to less surprises. Again, according to the TypeScript Design Goals, TypeScript should not "introduce behaviour that is likely to surprise users". By leveraging |
I just wanted to report my need for conditional compilation, which doesn't seem supported by your proposal. At the end I don't really care of the exact mechanism which might be implemented.
When
My goal is not to debug the code under a browser, but to create a mail with the exception stack trace when an uncaught exception occurs at client side.
OK, I misunderstood your example. In |
@stephanedr Just jumping in, the idea of giving the compiler hints using design-time decorators like |
Again, side topic... Mozilla's Source Map would allow you to determine the TypeScript original positions for the source and actually rewrite the stack trace. There are a few other more complete tools out there that leverage source-map and would do the heavy lifting for you. I suspect even with your macros, it would be hard to cover all the transforms that occur during transpilation, where this is more certain. |
@RichiCoder1, correct me if I'm wrong, but using decorators will only allow to empty the assert function. What I would like is to remove all the assert calls. @kitsonk, providing file name / line number should be quite easy for a compiler, as it already maintains them to report compilation errors. |
Regarding passing the flags to process, I have a suggestion inspired by some of the node.js based conventions (among which JSCS has aced in this aspect by incorporating every approach): Note: (in case of redefinitions / clashes) precedence order: descending
|
Webpack has this feature in the box https://webpack.github.io/docs/list-of-plugins.html#defineplugin new webpack.DefinePlugin({
VERSION: JSON.stringify("5fa3b9"),
BROWSER_SUPPORTS_HTML5: true,
TWO: "1+1",
"typeof window": JSON.stringify("object")
}) console.log("Running App version " + VERSION);
if(!BROWSER_SUPPORTS_HTML5) require("html5shiv"); |
Hi everyone, Conditional compilation is a must-have feature in Typescript. The idea of both runtime et precompilation time constants is also a very good idea. But I think we should use a C#/C++ syntax but adapted to JavaScript : Sample source#define HOST_NODE (typeof process == "object" && process.versions && process.versions.node && process.versions.v8))
#define COMPILE_OPTIONS ["some", "default", "options"]
#if HOST_NODE
console.log("I'm running in Node.JS");
#else
console.log("I'm running in browser");
#endif
#if COMPILE_OPTIONS.indexOf("default") !== -1
console.log("Default option is configured");
#endif Edit: Remove equals signs to keep C-style syntax as suggested by @stephanedr . Runtime compilationThis would then emit, assuming there is no compile time substitutional value available (and targeting ES6) as: const __tsc__HOST_NODE = (typeof process == "object" && process.versions && process.versions.node && process.versions.v8));
const __tsc__COMPILE_OPTIONS = ["some", "default", "options"];
if (__tsc__HOST_NODE) {
console.log("I'm running in Node.JS");
} else {
console.log("I'm running in browser");
}
if (__tsc__COMPILE_OPTIONS.indexOf("default") !== -1) {
console.log("Default option is configured");
} tsconfig.json configurationAssuming you define some constants in your {
"defines": {
"HOST_NODE": false,
"COMPILE_OPTIONS": ["some", "other", "options"]
}
} This would then emit as : console.log("I'm running in browser"); CLI configurationOr if you define contants in an other way by using CLI : $ tsc --define=HOST_NODE:true --define=COMPILE_OPTIONS:["some", "default", "options"] This would then emit as : console.log("I'm running in NodeJS");
console.log("Default option is configured"); Typings emitting and interpretationAssuming you have a module designed like this : #define HOST_NODE (typeof process == "object" && process.versions && process.versions.node && process.versions.v8))
#define COMPILE_OPTIONS ["some", "default", "options"]
export function commonFunction() { }
#if HOST_NODE
export function nodeSpecificFunction() { }
#endif
#if COMPILE_OPTIONS.indexOf("default") !== -1
export function dynamicOptionFunction() { }
#endif
export class MyClass {
common() { }
#if HOST_NODE
nodeSpecific() { }
#endif
} Edit: Remove equals signs to keep C-style syntax as suggested by @stephanedr . If no definitions are configured, it should be interpreted like this : export function commonFunction(): void;
export function nodeSpecificFunction?(): void;
export function dynamicOptionFunction?(): void;
export class MyClass {
common(): void;
nodeSpecific?(): void;
} Edit: Added Class case as suggested by @stephanedr . If you define some constants in your {
"defines": {
"HOST_NODE": false,
"COMPILE_OPTIONS": ["some", "default", "options"]
}
} Then, it should be interpreted like this : export function commonFunction(): void;
export function dynamicOptionFunction(): void;
export class MyClass {
common(): void;
} Edit: Added Class case as suggested by @stephanedr . It allows compiler and EDIs to ignore some parts of the code based on compiler configuration. Function-like syntaxBased on @stephanedr comments. Assuming following sample source #define DEBUG !!process.env.DEBUG
#if DEBUG
function _assert(cond: boolean): void {
if (!cond)
throw new AssertionError();
}
#define assert(cond: boolean): void _assert(cond)
#endif
type BasicConstructor = { new (...args: Object[]) => T };
#if DEBUG
function _cast<T>(type: BasicConstructor, object: Object): T {
#assert(object instanceof type);
return <T>object;
}
#define cast<T>(type: BasicConstructor, object: T) _cast(type, object)
#else
#define cast<T>(type: BasicConstructor, object: T) <T>object
#endif
class C {
f(a: number) {
#assert(a >= 0 && a <= 10);
let div = #cast(HTMLDivElement, document.getElementById(...));
}
} This would then emit, assuming there is no compile time substitutional value available (and targeting ES6) as: const __tsc__EMPTY = function () { return; };
const __tsc__DEBUG= !!process.env.DEBUG;
let __tsc__assert = __tsc__EMPTY;
if (__tsc__DEBUG) {
function _assert(cond) {
if (!cond)
throw new AssertionError();
}
__tsc__assert = function (cond) { return _assert(cond); };
}
let __tsc__cast = __tsc__EMPTY;
if (__tsc__DEBUG) {
function _cast(type, object) {
__tsc__assert(object instanceof type);
return object;
}
__tsc__cast = function (type, object) { return _cast(type, object); };
}
else {
__tsc__cast = function (type, object) { return object; };
}
class C {
f(a) {
__tsc__assert(a >= 0 && a <= 10);
let div = __tsc__cast(HTMLDivElement, document.getElementById(...));
}
} Assuming you define function _assert(cond) {
if (!cond)
throw new AssertionError();
}
function _cast(type, object) {
_assert(object instanceof type);
return object;
}
class C {
f(a) {
_assert(a >= 0 && a <= 10);
let div = _cast(HTMLDivElement, document.getElementById(...));
}
} Now, assuming you define class C {
f(a) {
let div = document.getElementById(...);
}
} ConclusionI think it allows a more granular conditional compilation by using the power of JavaScript. Moreover it clearly separates (in both code-style and evaluation) the compiler directives from your code, like it used to be on C-style compiled languages. What do you think ? |
@SomaticIT A few remarks: 1/ For people who know C/C# syntax, the "=" sign between the name and the value may be a bit disturbing. Why not keeping the C/C# syntax? 2/ It should allow something like:
(for sure, here DEBUG needs to evaluate to a constant to generate valid ES6 code). 3/ It should also support function-like syntax, e.g.:
The simplest to get
|
1/ I agree with you, I edited my comment to remove 2/ I also agree with you, I edited my comment to add this exemple in Typings emitting and interpretation part. 3/ I think this case is really interesting but I think we should improve compilation emitting and typings interpretation in this particular case. |
@SomaticIT
3b/ I'm not sure this can always be parsed, particularly with return union types (where the type ends? where the "body" starts?). 3c/ A same function-like define can be implemented several times (here 2, but might be more). Where should we put the JSDoc (avoiding duplication)? An alternate syntax might be:
Note that I'm not especially attached to a "#" syntax, so might also be:
|
Sorry I've used the C# decorator syntax. Let's use the TypeScript's one.
|
My project needs conditional compilation in order to support partial builds - when the user chooses that he wants to have a version of the library that only has components 1, 3, X... in it. While most of that can be supported by splitting the code into separate files, there are some cases when I need to define that certain class members are for one component only. For this I currently have a script that uses the compiler API and uses a regex to apply simple conditional text replacements in the source code. |
Some background: C/C++ and C# support preprocessors, Java doesn't. However, one can use the C++ preprocessor system in Java, see this post. I was somewhat curious about this feature in TS and I think there are valid cases where preprocessors could be used without abusing the TS/JS dev and build process. But I'm not convinced that this should be done during the TS compilation. Gulp offers some preprocessing right now, see preprocess or gulp-preprocess or Webpack's similar feature mentioned by @cevek. Here is a simple experimenting of mine to check out gulp-preprocess with TS. (Don't expect much.) This preprocessor seems to be kinda useful, not with all of the C++ preprocessor features though. Currently I see these major weaknesses of external preprocessors.
So I think that using preprocessors in a TS environment is a very special requirement (i.e. not general) that can be solved by using already existing tools. I recommend reconsidering this feature after at least a half or one year. There are more important and way more general feature requests now. |
I agree with @customautosys. As a reminder, I put again a link to my proposal: |
Would it not be better for this to be implemented as a form of triple-slash directive? This would be much like we have with references and the amd module stuff. Something like: doGeneralStuff()
/// <conditional platform="election" ...other props perhaps... >
electrionOnly()
/// </conditional>
/// <conditional platform="node" ...other props perhaps... >
nodeOnly()
/// </conditional>
doMoreGeneralStuff() This syntax wouldn't break parsers like eslint's typescript parser and countless other projects, it's already familiar to those who have used triple-slashes in typescript and have used xml or a like. I also like it allows for the use of more than one condition specified as a prop on the conditional node. How this ties into the tsconfig and what parts are dynamic I'll leave that to the better of the conversation here. Just an off the cuff thought I wanted to share and see what you all thought. |
This proposal has been long-standing (years). |
That's also OK. It doesn't really matter what the syntax is as long as there is a way to select / remove code at compile time based on a compile time constant / definition. Whether it's /// or #define / #if / #ifdef / #ifndef doesn't matter. |
@customautosys It does matter a little. If existing tokenizers can consume the code without exploding that is a win. Things like linters don't need to be aware of conditional behavior to do their job but they can't do it at all if they can't parse the code. There are many other kinds of tools that would run into similar problems I'm sure. |
I'm really not a fan of the |
Whenever TypeScript adds a new syntax feature, existing parsers need to be updated, that's just a fact of life. TypeScript adds new syntax fairly often, the most recent example is template string types in 4.1 |
I thought about it a bit more, and I've come around on the syntax. The triple slash stuff is currently used for js files where typescript syntax can not be used. |
I just re-read it and it seems the proposal does not support conditional compilation for imports. This makes it a lot less useful then. We should have a way to allow for conditional imports. |
There are already people doing something similar, but it's non-standardised and people are doing different things for webpack, vite etc. https://www.npmjs.com/package/ifdef-loader We need a standardised way to go about it so the code will not be brittle. Magic comments seem to be the way to go. Coming from a C++ environment, I think the #if / #else syntax is something a lot of people are familiar with. |
This seems like such a trivial thing to implement. The #ifdef/#if/#else/#elsif/#endif kind of syntax (or use @ instead of #) is fine. I really want to put #ifdef MIKE_REMOVED_THIS ... #endif around a big block of code to comment it out, and /* / doesn't work because there might be / style comments within the block. The MIKE_REMOVED_THIS is a way to blame MIKE for the elimination of the code - for other contributors to see. At the top of the file, I would put:
and comment out the undef to remove the code throughout the file where the #ifdef is used. If you have to provide #define and #undef, then so be it. It would be fine. You don't have to allow #define values to substitute within any of the TS code, just use it for #if conditionals. It really should be a feature of the compiler/language, not some hack using a rollup/webpack layer that may not be used at all (like a server-side program). |
What about something like Rust macros? It just runs a compile time and returns some code, which then replaces the macro. Which would be kinda overkill and too complex just for this issue, but macros would be nice anyway and it might actually be worth it. |
I think I can write exactly the same as I did for the macro idea. The current design goals of Typescript are:
As far as I can imagine: It is not even possible to create an ECMAScript proposal for that because there is no compilation in ES.
|
@HolgerJeromin Same can be said for this entire issue. Conditional compilation also doesn't align with ES because compilation isn't in ES. The only reason I said this is because clearly people don't think that's an issue here. |
That's taking the argument to its logical extreme. Strict typing isn't in ES either, do we then say types don't align with ES even though they're the raison d'être of Typescript? ES is not compiled but I think TS was designed to be compiled / transpiled since its inception. And that means that effectively zero runtime cost compile-time features like conditional compilation can be implemented in Typescript. The fact is that this has already been implemented in several plugins for various tool stacks in npm (e.g. https://www.npmjs.com/package/vite-plugin-conditional-compiler); this feature would just standardise the reality so that it will not be a mess. |
No. That was exactly my point (as it was for the macros suggestion).
There are 11 typescript goals. Not only my quoted 2. |
Wouldn't it be compliant with these 2: I don't think the aim of the proposal is to mimic other languages exactly? I think the main aim is to structure the inclusion of specific pieces of code at compile time which is really useful for large cross platform codebases e.g. when you need to import 1 platform specific module only for a certain platform. Sometimes dynamic imports are not suitable. |
There's another caveat, one that probably would be a death sentence to this proposal: these stated non-goals.
|
I don't see how those would spell a death sentence for this proposal. You could argue that this is out of scope and therefore 4 would rule it out, but there are already a bunch of competing third party solutions for this problem. It would be nice if something like this could be handled at the language level. That would remove the need for weird solutions and would make it easier to change build tools. If, for example, a codebase makes heavy use of something like webpack define plugin then it's difficult to switch to a different bundler unless there is a compatible solution available there. 5 and 6 don't seem relevant. Unless I'm missing something. The core of this proposal is conditional emit. i.e. I want to be able to set some flag internally or externally (via compiler flags, env vars, or some other mechanism) that controls which bits of code are emitted. It doesn't add any reliance on runtime type information nor add any extra runtime functionality. |
Magic comments would also work with js files without having to go through years of ES standard deliberation & runtime implementation. I'm facing the question of how to use conditional compilation to reduce browser payload size. There are several esbuild plugins. It would be great to know what the blessed syntax is so I can target it. I vote for magic comments because they can be done today. Magic comments can provide a prototype for additions to js & ts. I like how the preprocess library approaches this because it can be used for various file types, including css, shell, php, etc. Also, since the code to be added by the preprocessor is in comments, there will be less build issues for when not running the preprocessor. Perhaps there is potential standard approach for preprocessing any programming language which supports comments? |
I swear I think about this stuff every week. I've desperately wanted something like Rust or Haxe macros in TS since day 1. I do understand some of the arguments against though, it pains me to say. The biggest one for me is imagining the intersection of JS and TS libraries which is a hellish forest on average and can't possibly be improved by a bunch of library/project specific flags and compile time function evaluations. I imagine build times suffering for reasons that could be difficult to intuit, or hunting desperately for The Flag That Is Breaking The Build And How. The best argument for is that macros and conditional compilation is phenomenal and even hard to imagine working without if you own all or most of the code. Lots and lots of valid arguments against, in our case, and it sucks. If TS were to implement conditional compilation or macros I'd want it as a first class language feature with no magic comment ambiguity and code completion support, it just seems silly to compromise if you are going for it because you are worried about overly complicating the AST for instance (this is pretty rote text processing and shouldn't touch the AST other than choose what gets emitted into it). I'd look at the Haxe implementation. It is simple enough yet covers nearly every practical base and can be extended through exposing of compiler macros if the team were ever to desire such madness. |
I found a workaround for conditional The following code snip is as used in a project based on vue+vite. async function importModule(name: keyof AdminViews) {
if (import.meta.env?.DEV_MODE) {
return eval('import("./views/"+name+".vue")')
}
// in production mode, dynamically load it from a bundled javascript file
// ...
}
For a workaround, it's better than none. |
A few different aspects on this one Conditional compilation in value-space (statements and expressions) is pretty clearly out-of-scope in the modern understanding of TS; this is basically the same as "macros" which got closed a while back. Something like conditional code exists in NodeJS's "conditional exports" https://nodejs.org/api/packages.html#conditional-exports which let you expose different code depending on external factors. Something akin to conditional compilation in type space -- e.g. "this interface has this member if some condition is met" or "this variable exists if (some other condition is met)" - I would still consider to be tenable. There are multiple open problems that might be well-solved by a mechanism like this, but it's an extremely blunt tool that would certainly have a lot of side effects, like creating difficulties in validating whether a .d.ts file is even valid, avoiding circularities, and keeping features like "rename" functional in code that is conditioned out. I would consider this to be a "we have tried literally everything else" sort of solution to problems like webworker vs dom environment code living in the same compilation unit. So overall this is either out of scope / some other tool's job, or better phrased as an extremely minimal proposal for something in type space. |
Proposal: Conditional Compilation
Problem Statement
At design time, developers often find that they need to deal with certain scenarios to make their code ubiquitous and runs in every environment and under every runtime condition. At build time however, they want to emit code that is more suited for the runtime environment that they are targetting by not emitting code that is relevant to that environment.
This is directly related to #449 but it also covers some other issues in a similar problem space.
Similar Functionality
There are several other examples of apporaches to solving this problem:
Considerations
Most of the solutions above use "magic" language features that significantly affect the AST of the code. One of the benefits of the has.js approach is that the code is transparent for runtime feature detection and build time optimisation. For example, the following would be how design time would work:
If you then wanted to do a build that targeted NodeJS, then you would simply assert to the build tool (
staticHasFlags
) that instead of detecting that feature at runtime,host-node
was in facttrue
. The build tool would then realise that theelse
branch was unreachable and remove that branch from the built code.Because the solution sits entirely within the language syntax without any sort of "magical" directives or syntax, it does not take a lot of knowledge for a developer to leverage it.
Also by doing this, you do not have to do heavy changes to the AST as part of the complication process and it should be easy to identify branches that are "dead" and can be dropped out of the emit.
Of course this approach doesn't specifically address conditionality of other language features, like the ability to conditionally load modules or conditional classes, though there are other features being introduced in TypeScript (e.g. local types #3266) which when coupled with this would address conditionality of other language features.
Proposed Changes
In order to support conditional compile time emitting, there needs to be a language mechanic to identify blocks of code that should be emitted under certain conditions and a mechanism for determining if they are to be emitted. There also needs to be a mechanism to determine these conditions at compile time.
Defining a Conditional Identifier at Design Time
It is proposed that a new keyword is introduced to allow the introduction of a different class of identifier that is neither a variable or a constant. Introduction of a TypeScript only keyword should not be taken lightly and it is proposed that either
condition
orhas
is used to express these identifiers. When expressed at design time, the identifier will be given a value which can be evaluated at runtime, with block scope. This then can be substituted though a compile time with another value.Of the two keywords, this proposal suggests that
has
is more functional in meaning, but might be less desirable because of potential for existing code breakage, but examples utlise thehas
keyword.For example, in TypeScript the following would be a way of declaring a condition:
This would then emit, assuming there is no compile time substitutional value available (and targeting ES6) as:
Defining the value of a Conditional Identifier at Compile Time
In order to provide the compile time values, an augmentation of the
tsconfig.json
is proposed. A new attribute will be proposed that will be named in line with the keyword of eitherconditionValues
orhasValues
. Differenttsconfig.json
can be used for the different builds desired. Not considered in this proposal is consideration of how these values might be passed totsc
directly.Here is an example of
tsconfig.json
:Compiled Code
So given the
tsconfig.json
above and the following TypeScript:You would expect the following to be emitted:
As the compiler would replace the symbol of hostNode with the value provided in
tsconfig.json
and then substitute that value in the AST. It would then realise that the one of the branches was unreachable at compile time and then collapse the AST branch and only emit the reachable code.The text was updated successfully, but these errors were encountered: