Skip to content

Latest commit

 

History

History
43 lines (24 loc) · 1.87 KB

README.md

File metadata and controls

43 lines (24 loc) · 1.87 KB
Raw

On Unifying Misinformation Detection

Code for our "On Unifying Misinformation Detection", NAACL2021, https://arxiv.org/pdf/2104.05243.pdf

Setting Up Environment:

  1. pip install -r requirement.txt to install all the dependencies.
  2. From https://drive.google.com/drive/folders/1QRBKuzykREarcsn1iaNr5xKSzTGTRwu1?usp=sharing, download:
    • preprocessed.zip, unzip it and place inside ROOTDIR/misinfo/data directory. As result, you will have ROOTDIR/misinfo/data/preprocessed
    • pretrained models (unifiedM2.zip and unifiedM2_pheme.zip), unzip and place inside ROOTDIR/misinfo/pretrained directory.
      • unifiedm2.zip: pretrained UnifiedM2 model
      • unifiedM2_pheme.zip: UnifiedM2 that is trained without rumor dataset to test for PHEME's leave-one-event-out setting

Code Structure:

  • /data_utils: contains codes data preprocessing and data analysis
  • /model: contains codes for ST-roberta and UnifiedM2
  • /utils: contains util codes for training/evaluating our models

How to run:

Refer to bash scripts listed below for your intended experiment (Before running the code, modify the arguments/parameters that fits your need/setting):

  • bash run_mt.sh : for training the shared UnifiedM2 encoder

  • bash run_ft.sh : for fine-tuning UnifiedM2 encoder to obtain better performance on individual tasks

  • bash run_fewshot.sh : for few-shot experiment (Section 4.1)

  • bash run_pheme_leave_one_event_out.sh : for leave-one-event-out experiment setting for PHEME dataset (Section 4.2)

Other details:

To add your custom tasks, made adjustments in:

  • datasets.py - modify get_processor() and get_misinfo_datset() function, and add a data processor by following the format of other data processors
  • utils/const.py - add your custom task name to the const file
  • For other questions, send email to nyleeaa@connect.ust.hk # UnifiedM2