[Tracking]: Testing against webpack core tests

[ahabhgk]

Rspack is running webpack tests to discover current implementations and functionalities misaligned with webpack.

Our goal is to maintain consistency with webpack as much as possible, but there are still some features that require discussion to determine whether or not to support them. These include APIs that have alternative ECMAScript standards or features that have high support costs but are used by very few people. This issue is meant to track these inconsistencies, and we will continue to improve test coverage and pass rates in the future.

We have already run some tests at the moment. Of course, we welcome your help in advancing the testing progress and discovering any issues. This may require a certain level of familiarity with webpack's code to identify the underlying causes of test failures.

The following are the steps to advance the testing progress:

1. Run pnpm run build:cli:debug or pnpm run build:cli:release to make sure you are on the latest build.
2. cd webpack-test and find a test that you want to run.
3. Make sure the test.filter.js under the test case is returning true.
4. Run pnpm run test -- -t "test name", for example, if you want to run webpack-test/cases/amd/define-needs-module, you can use the following command pnpm run test -- -t "amd define-needs-module"
5. If it passes, then you can remove test.filter.js under the test case.
6. If it doesn't passes, then you need to find the reason why it failed, and make test.filter.js return a string that contain the reason, and it would be better to create a issue and use the link as the reason, for example module.exports = () => {return "https://github.com/web-infra-dev/rspack/issues/4313"}

And the principle is not to modify the code of webpack-test's test to make the test passes. Instead, focus on tracking all inconsistencies as much as possible.

Here are some of the identified issues:

Unsupported features

Preview Give feedback

1. support analyze AMD module format #4313
   PR welcome feat good first issue team +4
2. support webpackMode and other inline magic comments #4306
   feat stale team +3
3. support require.ensure #4304
   PR welcome feat stale team +4
4. support top-level-await #3889
   feat +1
   
5. support more import.meta property like import.meta.webpack #4350
   stale team +2
6. support import attributes #4358
   team +1
7. aliasedRequire support #3346
   rsbuild +1
   
8. support js inline loader query options #4396
   team +1
   
9. allow parse js hashbang syntax #4427
   team +1
10. Should emit diagnostics using shared reference of compilation #4433
    stale team +2
    
11. should able to use inline loader with data uri #4445
    team +1
    
12. resolve to wrong module with aliasFields #4446
    team +1
    
13. support optimization.concatenateModules #3823
    feat +1
14. Support output.pathinfo #5254
    PR welcome feat stale team +4
15. Support use empty resource path with inline loader #5393
    team +1
    

Parser hook/Compile time evaluation

Preview Give feedback

1. HMR API exist in production build #4300
   bug stale team +3
2. refactor to parser hook #4439
   stale team +2
3. support compile time evaluation #4424
   stale team +2
   

TreeShaking/SideEffects

Preview Give feedback

1. full support __webpack_exports_info__ api #4426
   team +1
2. Treeshaking shaked variable that is used #4336
   team +1
   

SplitChunks

Preview Give feedback

1. Support object type of splitChunks.minSize #4331
   contrib: easy feat good first issue stale team +5
   
2. Support function type splitChunks #4333
   contrib: has guidance good first issue team +3
   
3. Splitted chunk id should be the same as webpack #4334
   stale +1
   
4. Support splitChunks.automatic_name_delimiter #4335
   contrib: easy contrib: has guidance good first issue +3
   

CSS

Preview Give feedback

1. Align experiments css runtime #4431
   stale team +2
   

Sourcemap

Preview Give feedback

1. Align sourcemap contenthash #5394
   team +1
   

Output

Preview Give feedback

1. Align output.chunkFilename #5395
   stale team +2
   

Node API

Preview Give feedback

1. Support loaderContext.importModule #4398
   stale team +2
2. Support loaderContext.loadModule #3738
   PR welcome feat stale team +4
3. Support webpackAst in js loader return #4442
   stale team +2

Dependency/Codegen

Preview Give feedback

1. feat: support reexport for cjs-esm interop #4325
   stale team +2
2. should detect module.require #4440
   team +1
   
3. should replace top-level this to undefined in esm #4421
   team +1
4. this object should be exports in cjs #4324
   team +1
5. support parser.javascript.exportsPresence and importExportsPresence #4323
   rsbuild stale team +3
6. support __webpack_nonce__ #4401
   stale team +2
7. build should failed when detect conflicting start exports conflict #4118
   stale team +2
   
8. should replace __resourceQuery even resource.query is empty #4441
   team +1
9. support __webpack_is_included__ #4443
   team +1
   
10. support import.meta.webpackHot.data #5596
    stale team +2

Errors/Warnings inconsistent

Preview Give feedback

1. Should emit error if entrypoint and splitted chunk have the same name #4332
   contrib: easy good first issue stale team +4
   
2. support hideStack in WebpackError #4326
   team +1
   
3. detect emitted value instead of an instance of Error for emitError and emitWarning #4349
   stale team +2
4. should error when webpackChunkName is conflicted with entrypoints #4318
   bug team +2
5. better resolve error message #4348
   team +1
6. should warning for direct access import.meta #4419
   team +1
7. feat: support WarnCaseSensitiveModulesPlugin #4347
   contrib: medium good first issue +2
   

ContextModule

Preview Give feedback

1. support String.raw for context module #4420
   team +1
   
2. should able to use inline loader in context module #4397
   team +1
   
3. Critical dependency warning for context module #4429
   stale team +2
4. support regexp look around for context module #4329
   team +1
   
5. support context for resolveWeak #4315
   stale team +2
   
6. support regexp g flag for context module #4328
   stale team +2
   
7. support import.meta.webpackContext #4305
   team +1
8. support __resourceQuery for context module #4450
   stale team +2

Panic bug

Preview Give feedback

1. Misleading error message when request is "" #3180
   bug good first issue team +3
   
2. [Bug]: panic "Run build_module hook failed" in compiler queue #5573
   bug stale team +3
   
3. [Bug]: panic "Failed to send process dependencies result" in compiler/compilation #5574
   bug team +2
   
4. [Bug]: panic "We should return this error rathen expect" in compiler/compilation.rs #5576
   bug stale team +3
   
5. [Bug]: webpack-test/configCases/css/{urls,large} is slow #5577
   bug team +2
   
6. [Bug]: panic in harmony_export_imported_specifier_dependency #5578
   bug team +2
   
7. [Bug]: panic in resolver with empty specifier for when path has ! at the end #5579
   bug team +2
   
8. [Bug]: panic "should have dependency id" in import_meta_context_dependency #5580
   bug stale team +3
   

Test Infrastructure

Preview Give feedback

1. remove 'changed-files' in hotTestCases #5582
   A-build-testing team +2

[chenjiahan]

I will close this tracking issue since we have a new tracking issue for webpack test cases: #8445