v1.6.0

New Releases

• SeeKeR project code and models release (#4447, #4458, #4449, #4453, #4448)
• User Simulators and Task Oriented Dialogue support (#4437, #4438, #4188, #4187, #4189, #4186, #4185, #4184, #4183, #4249, #4174, #4181, #4182, #4180, #4178, #4233)
• Per Turn evaluation project code release (#4304, #4323, #4333, #4362)
• SaFeRDialogues dataset and model release (#4229, #4300)
• Am I Me or You project code release (#4239, #4252, #4250)
• K2R Project release(#4251)

New Features

• Updating to Mephisto 1.0 (#4426)
• [TGA]
  • More flexible token metadata logging (#4169, #4427)
  • Record avg generation length (#4295)
  • change tga default to not sort (#4138)
• Add a small example Flask server (#4433)
• Add support for WorldLoggers in training (#4369)
• [T5] Support Distributed Training (#4434)
• [HuggingFace] Add support for any GPT-2 model hosted in Huggingface (#4360), and ranking (#4326)
• [Crowdsourcing]
  • [ACUTE-Eval] Add support for knowledgeable question (#4416), interestingness question (#4113)
  • [ACUTE-Eval] Record start and end times (#4208)
  • [Model chat] allow multiple final ratings (#4276)
  • [Model chat] allow spacing out of annotation buckets (#4275)
  • Allow Use of external database in crowdsourcing code (#4272)
  • Allow specification of blueprints from command line (#4254)
  • Unify turn annotation tasks (model chat and turn annotations static tasks) (#4162)
  • [ACUTE-Eval] Save worker name in Acute-Eval analysis script (#4126)
• [RAG/FiD/BB2]
  • [All] Incremental Decoding (#4088)
  • [BB2] Allow hybrid mode (skip search when needed) (#4221)
  • [FiD] Add specialized chunking to search engine retrievers (#4227)
  • [BB2] Support for gold docs training (#4163)
  • [FiD] Gold retrieved documents FiD Agent. (#4123)
  • Export memories to the observation output (#4040)
• [Style-Controlled Generation] OSS Second Classifier (#4380)
• [Re-ranker] Support for a classifier re-ranker agent (#4291)
• [TCA] return candidates (#4286)
• Curated response generators (#4197)
• [Chat Services] add option for host specification (#4335)

Bug fixes

• [TCA] Various updates and fixes (#4287, #4406, #4270)
• [BlenderBot2] Various updates and fixes (#4379, #4428, #4419, #4331, #4377, #4366, #4289, #4259, #4238, #4212, #4198, #4156)
• [TorchAgent] Fix an issue with warmup updates not working properly (introduced after 1.5.1) (#4384, #4242, #4196)
• [RAG/FiD] various updates and fixes (#4436, #4361, #4389, #4207, #4199, #4146)
• [GPT2] misc. Fixes (#4395)
• [Train Model] Fixes train_model worldlogging for multitask with mutators. (#4414)
• [Crowdsourcing] various updates and fixes (#4413, #4273, #4274, #4089)
• [Re-ranker] Bubble up all batch fields (#4296)
• Fix clobbering issues with WandB & Tensorboard requeueing (#4175, #4093)
• Fix interactive web (#4140)
• Several misc. fixes (#4459, #4403, #4386, #4439, #4425, #4021, #4218, #4164)

Datasets & Teachers & Mutators

• Relicense several parlai datasets as commercially friendly (#4269, #4213, #4126)
• LLLC, a large chinese dataset (#4325)
• Casino dataset (#4129)
• Upgrade internals of several teachers: WoW (#4284), Empathetic Dialogues (#4405), Natural Questions (#4205)
• WoW and WoI mutators (#4418, #4204, #4168, #4124, #4125, #4122, #4114)
• Speed up the json teachers (#4404)
• XPersona Dataset (#4314)
• ConversationTeacher parent class is now ParlAIDialogTeacher (#4256)
• [WizInt] Additional knowledge-related eval metrics (#4193); turn dicts to Messages (#4144)

Developers

• Various documentation improvements (#4423, #4352, #4375, #4074, #4172, #4423, #4100, #4385. #4349, #4298, #4297, #4217, #4173, #4133, #4120, #4028, #4104, #4102)
• Various test improvements and fixes (#4442, #4375, #4311, #4271, #4435, #4343, #4236, #4261, #4223, #4224, #4096, #4315, #4253, #4190)
• Various dependency bumps (#4464, #4463, #4420, #4351, #4348, #4346, #4337, #4317, #4302, #4299, #4301)
  Other QOL Improvements (#4095)