Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FjORD #2035

Closed
7 tasks done
jafermarq opened this issue Jul 6, 2023 · 4 comments
Closed
7 tasks done

FjORD #2035

jafermarq opened this issue Jul 6, 2023 · 4 comments
Assignees
Labels
summer-of-reproducibility About a baseline for Summer of Reproducibility

Comments

@jafermarq
Copy link
Contributor

jafermarq commented Jul 6, 2023

FjORD

Do you want to work on this baseline?

🌻 Check everything about the Summer of Reproducibility on flower.dev/summer

All available baselines are listed in the Summer of Reproducibility Dashboard and also in the GitHub Issues with the summer-of-reproducibility label. The content is the same.

📝 It is advised to complete these steps before your start working on your code. But if you can't wait to implement your baseline with Flower (we totally understand it 😄), please ensure you follow the steps on how to contribute a new baseline.

What follows are the steps 1 & 2 in the Summer of Reproducibility instructions.

1. Join the Summer of Reproducibility program

  • Join the Flower Slack and say "hi! 👋" in the channel #summer-of-reproducibility.
  • Pick a baseline from our curated list <---------------------------------------- [you are doing this now]

2. Define the scope of your contribution

  • What are you going to reproduce? Add a comment to your issue and tell us about your plan regarding this baseline: what experiments from the paper are you reproducing?, for which datasets ? the more details you provide us with the better !

  • Check if you are eligible for a reward.

    As we have to comply with US/EU regulations, we have checked that individual contributors based on these countries or territories are eligible: Australia, Austria, Belgium, Bulgaria, Canada, Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, France, Germany, Gibraltar, Greece, Hong Kong SAR China, Hungary, India, Ireland, Italy, Japan, Latvia, Liechtenstein, Lithuania, Luxembourg, Malta, Mexico, Netherlands, New Zealand, Norway, Poland, Portugal, Romania, Singapore, Slovakia, Slovenia, South Korea, Spain, Sweden, Switzerland, Thailand, United Arab emirates, United Kingdom United States.

    If where you are based is not on the list, please send us an email (summer@flower.dev) letting us know a bit about yourself (where are you currently based?, are you a university student? do you work at a public institution?). Please tell us the baselines you are interested in implementing (i.e. tell us your GitHub issue if you have crated one). We will reach back to you.

  • We will discuss with you about your contribution plan, if it sounds like a substantial enough contribution according to the Summer of Reproducibility rules (check our website flower.dev/summer), you'll get the OK from us to start working on your baseline!

What happens next?

Is something wrong or not clear ?

  • Ask a question directly in your issue.
  • Reach out to us via the Flower Slack and ask your question in the #summer-of-reproducibility channel
  • Check all the details (including FAQ) in the Summer of Reproducibility website: flower.dev/summer
@jafermarq jafermarq converted this from a draft issue Jul 6, 2023
@jafermarq jafermarq added the summer-of-reproducibility About a baseline for Summer of Reproducibility label Jul 6, 2023
@jafermarq jafermarq moved this from Proposed Baselines to In Progress in Summer of Reproducibility Jul 6, 2023
@stevelaskaridis
Copy link
Contributor

stevelaskaridis commented Jul 17, 2023

Hi,

@SamuelHorvath and I (@stevelaskaridis) would like to implement FjORD for replicating the experiments in Figure 5 in the paper.

Contribution plan

We are planning to implement the following:

  • Ordered Dropout, with and without KD
  • Client tiering (5 tiers)
  • Datasets: FEMNIST and CIFAR-10

Contributions will be jointly done.

Eligibility

Both of us are located in eligible countries and sum is expected to be shared equally amongst participants.

@jafermarq
Copy link
Contributor Author

Hi @stevelaskaridis and @SamuelHorvath, the plan sounds good! Thanks for the details and for confirming the point about reward eligibility. I've now ✅ all points above for Step 1&2, if you follow the link in the What happens next? section, you'll see a guide on how to start working on your baseline. Feel free to reach out to me over Slack if you have some questions or if you encounter some issues.

I have you (@stevelaskaridis) as assignee. @SamuelHorvath, apparently i can only add you as assignee if you write a comment in this issue. Totally up to you if you want to do this.

Looking forward to seeing FjORD in action! 🙌

@SamuelHorvath
Copy link
Contributor

I can confirm.

@jafermarq jafermarq moved this from In Progress to Verifying in Summer of Reproducibility Oct 16, 2023
@jafermarq
Copy link
Contributor Author

Congratulations @stevelaskaridis @SamuelHorvath your baseline has been merged. We'll follow up with you soon to complete your Summer of Reproducibility journey 😄 !

@jafermarq jafermarq moved this from Verifying to Merged ! in Summer of Reproducibility Oct 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
summer-of-reproducibility About a baseline for Summer of Reproducibility
Projects
Development

No branches or pull requests

3 participants