Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DO NOT MERGE. WIP: Split testing support in the LMS. #2042

Closed
wants to merge 1 commit into from
Closed

Conversation

shnayder
Copy link

(Opening a pull request just to have a convenient place to discuss. Will re-open when it's actually ready)

Adds a split_test_module XModule, that can choose one of its children
to display, based on a get_condition_for_user API added to the runtime.

To test, add something like this to an xml course, or make equivalent
tweaks in mongo.

 <vertical url_name="split_test_vert">
    <split_test url_name="split1" experiment_id="0" condition_id_to_child='{"0": "i4x://MITx/6.00x/html/split_test_cond0", "1": "i4x://MITx/6.00x/html/split_test_cond1"}'>
       <html url_name="split_test_cond0">condition 0</html>
       <html url_name="split_test_cond1">condition 1</html>
    </split_test>
  </vertical>

Also needs an experiment configured in the course policy json: e.g.

    "user_partitions": [{"id": 0,
                                  "name": "Experiment 0",
                                  "description": "Unicorns?",
                                  "version": 1,
                                  "groups": [{"id": 0,
                                                    "name": "group 0",
                                                    "version": 1},
                                                    {"id": 1,
                                                    "name": "group 1",
                                                    "version": 1}]}]

(This particular snippet will work inside a course with org MITx
and course name 6.00x)

TODO:

  • arch review. Is this what the arch council had in mind?
  • analytics -- actually add the user tags to all events
  • add a "hidden" attribute to blocks, have verticals and ab tests pass
    it up the tree, have sequentials and the accordion actually hide things.
    (There is already a way to hide certain things in the course accordion.
    Ideally this would be made consistent with that method.)
  • docs
  • performance review/testing
  • test all the things

@shnayder shnayder closed this Dec 25, 2013
Adds a split_test_module XModule, that can choose one of its children
to display, based on a get_condition_for_user API added to the runtime.

To test, add something like this to an xml course, or make equivalent
 tweaks in mongo.

 <vertical url_name="split_test_vert">
    <split_test url_name="split1" experiment_id="0" condition_id_to_child='{"0": "i4x://MITx/6.00x/html/split_test_cond0", "1": "i4x://MITx/6.00x/html/split_test_cond1"}'>
       <html url_name="split_test_cond0">condition 0</html>
       <html url_name="split_test_cond1">condition 1</html>
    </split_test>
  </vertical>

Also needs an experiment configured in the course policy json: e.g.

        "user_partitions": [{"id": 0,
                                      "name": "Experiment 0",
                                      "description": "Unicorns?",
                                      "version": 1,
                                      "groups": [{"id": 0,
                                                        "name": "group 0",
                                                        "version": 1},
                                                        {"id": 1,
                                                        "name": "group 1",
                                                        "version": 1}]}]


(This particular snippet will work inside a course with org MITx
 and course name 6.00x)

TODO:
 * arch review.  Is this a reasonable way to do it?
 * analytics -- actually add the user tags to all events
 * add a "hidden" attribute to blocks, have verticals and ab tests pass
   it up the tree, have sequentials and the accordion actually hide things.
  (There is already a way to hide certain things in the course accordion.
   Ideally this would be made consistent with that method.)
 * test all the things
@shnayder shnayder reopened this Dec 31, 2013
@shnayder shnayder closed this Dec 31, 2013
@shnayder
Copy link
Author

Note: a good place to start is experiments.rst

@benpatterson benpatterson deleted the hack/ab branch January 21, 2015 13:12
jenkins-ks pushed a commit to nttks/edx-platform that referenced this pull request Sep 22, 2017
* Add menu to ga_operation for ga_analyzer openedx#2039 (openedx#2088)

* add role for old course viewer openedx#2062 (openedx#2087)

* add role for old course viewer openedx#2062

* Change action for biz course by BetaTester role openedx#2062

* Construction of image server openedx#2025 (openedx#2106)

* cherry-pick 8c8953f

* Fix file upload in IE

* Construction of image server openedx#2025

* add all keywords search in Student management openedx#2029 (openedx#2034)

* Fix bug for before enrollment start in ga old course viewer openedx#2062 (openedx#2125)

* fix. Construction of image server openedx#2025 (openedx#2117)

* Modify message and css of enrollment for Course About openedx#2130

* Add a certificate list to user's profile page. openedx#2042 (openedx#2108)

* Mod UT openedx#2130

* add PDF File Construction of image server openedx#2025 (openedx#2140)

* add library option, and library links to the course. openedx#2001 (openedx#2124)

* Invalid StudioPermissionsService object in API to show/save xblock settings in CMS.
Randomized Content Block editor did not check Studio user's permissions

* add library option, and library links to the course. openedx#2001

* fix. add all keywords search in Student management openedx#2029 (openedx#2034) (openedx#2157)

* second fix. Construction of image server openedx#2025 (openedx#2158)

* add library option, and library links to the course. openedx#2001 (openedx#2160)

* third fix. Construction of image server openedx#2163 (openedx#2164)

* Add filter by category for certificates on profile page openedx#2042 (openedx#2165)

* Fix bug for  add library option, and library links to the course. openedx#2162 openedx#2133 (openedx#2167)

* Develop/dogwood/gacco201708 (openedx#2170)

* Fixed bugs openedx#2039 (openedx#2112)

* Fixed csv format openedx#2039 (openedx#2127)

* Change to split download if there are many display items openedx#916 (openedx#2121)

* Change to split download if there are many display items openedx#916

* Fix UT

* Fix Review

* Fix review2
shimulch pushed a commit to open-craft/edx-platform that referenced this pull request Jan 26, 2021
…K-1862

YONK-1862 | Redirect to apros login if learner hit the signup button …
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant