Currently, we have two places for experimental in the documentation.
I recommend turning all subsection from experimental (like https://huggingface.co/docs/trl/main/en/experimental#bema-for-reference-model) into section in Experimental (like https://huggingface.co/docs/trl/main/en/bco_trainer)