--order-group-scope for test which located in different folder

[veenone]

Hi,

I would like to know whether it's possible to make orders for the following the structure :

\src

• \test
  • \01_feature_1
    • test_feature_a.py
      • test_id_01 ---> order(1)
      • test_id_02 ---> order(2)
    • test_another_feature_a.py
      • test_id_03 ---> order(3)
      • test_id_04 ---> order(4)
  • \02_feature_2
    • test_feature_b.py
      • test_id_01 ---> order(1)
      • test_id_02 ---> order(2)
    • test_another_feature_b.py
      • test_id_03 ---> order(3)
      • test_id_04 ---> order(4)
  • \03_feature_3
    • test_feature_c.py
      • test_id_01 ---> order(1)
      • test_id_02 ---> order(2)
    • test_another_feature_c.py
      • test_id_03 ---> order(3)
      • test_id_04 ---> order(4)

I'm executing all pytest from the \test level.
how to have the execution ordered by folder, then by the ordering number from each folder?

currently I'm using --order-scope=module --order-group-scope=class, but it seems the ordering is still not following the exact order number in 1 folder

[mrbean-bremen]

This is currently not possible. Order groups only work on module and class scope, not on directory scope.

If you are ordering across modules (like in test_feature_b / test_another_feature_a) you cannot use the module order scope. If you use session scope and module order group scope, the modules will be reordered.
As a workaround, you have to adapt the order numbers inside the features to not overlap, for example by using 21, 22, 23... for feature 2 and 31, 32, 33... for feature 3.

I think that your use case is a valid option, and I will see if I can add something later. Thanks for using the plugin :)

[mrbean-bremen]

@veenone - I added a new option --order-scope-level to master that should do what you want, e.g. in your example --order-scope-level=2 should show the wanted behavior. Please check if that works for you - I will probably make a new release soon.

[veenone]

Hi @mrbean-bremen ,

Thanks for your response. I wasn't able to give you feedback on your first comment.

I'll try this out once I'm back to my work.

Does this option stackable with the other options? (order-group & order-group-scope)?

As for the new option, how the value maps to the desired structure?

[mrbean-bremen]

As the new option also defines an order scope, it cannot be used together with --order-scope, but shall work with --order-group-scope.
Please check the documentation for usage - if that is not sufficient, I'll have to adapt it...

[mrbean-bremen]

@veenone - did you find time to test this? I will wait with a new release until I get some confirmation that it works as intended.

[veenone]

@mrbean-bremen , I will try this out tomorrow and give you the feedback on the behavior