Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training configuration #6

Open
kylemcdonald opened this issue Sep 14, 2020 · 1 comment
Open

Training configuration #6

kylemcdonald opened this issue Sep 14, 2020 · 1 comment

Comments

@kylemcdonald
Copy link

kylemcdonald commented Sep 14, 2020

Hello, I'm interested in the training configuration, or seeing the training code.

  • How many epochs did you train?
  • What batch size did you use?
  • Was the Adam learning rate fixed at 0.0001 or did you use a learning rate schedule?
  • Did you use any augmentation during training?
  • Did you weight the different losses equally (race, gender, age)?
  • Did you weight the loss in different classes to account for class imbalance?
  • Did you train the final dense layers with dropout, or with the default torchvision resnet34 architecture?
  • Did you unfreeze/make trainable all the resnet34 layers from the beginning, or only train the dense layer first? Did you unfreeze the resnet in blocks or all at once?
@zoltanfarkasgis
Copy link

The above list is very comprehensive and the correct one that is mandatory for training.
Regarding the presented labels one would add the previously raised question re the meaning of the "service_test" field.

The info in the paper about training is simply not enough to reconstruct what the authors did in terms of training their models.

Interestingly, the authors seem to have kind of a selective hearing: they do not respond to this question (and similar ones raised in the same context), while they are active (after this one was raised) and respond to many other questions.

This lack of detail undermines the value of the paper and questions how the fairness of the dataset was assessed (and whether that fairness is validated).

It would be kind from the authors to answer these points.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants