Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deepspeed #42

Closed
wants to merge 96 commits into from
Closed

Deepspeed #42

wants to merge 96 commits into from

Conversation

porteratzo
Copy link
Collaborator

No description provided.

akantak and others added 30 commits April 20, 2023 12:15
C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator

Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* Fix warnings and issues in docs

Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>

* fixup! Fix warnings and issues in docs

Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>

---------

Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
* Add Logo

* Update README.md
…ratedai#809)

This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.

    Known issues:
    1. The text font within the images has not been changed.
    2. Some icons that do not exist in the new font cannot be displayed properly.

    Fixes securefederatedai#799

    Co-authored-by: Wang, Le <le3.wang@intel.com>
    Signed-off-by: He, Dan H <dan.h.he@intel.com>
    Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
    Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
    Signed-off-by: Wang, Le <le3.wang@intel.com>
    Signed-off-by: Wu, Caili <caili.wu@intel.com>

Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
* Update ci config

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Add unit test for following files

- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Add some test cases for databases module

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Fix bugs for databases module unittest

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Update unit tests for component module

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Restore workflow config and update some comments

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Enable save_ test case.
Add yaml under test dir for unit test usage.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Remove plan to new dir.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Remove plan to new dir.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Add aggregator start test cases.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Add 2 aggregator test cases.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Add 1 aggregator test case.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Format code.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Refactor code.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Add collaborator start test cases.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Add 1 collaborator test case.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Format with flake8

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Remove TODO comments

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

---------

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.

    The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.

    Fixes securefederatedai#797

    Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
    Signed-off-by: He, Dan H <dan.h.he@intel.com>
    Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
    Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
    Signed-off-by: Wang, Le <le3.wang@intel.com>
    Signed-off-by: Wu, Caili <caili.wu@intel.com>

Signed-off-by: He, Dan H <dan.h.he@intel.com>
…nd (securefederatedai#813)

* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.

Fixes securefederatedai#692

Signed-off-by: Grant Baker <grant.baker@intel.com>

* Refactor read_csr function to use get_csr_hash

Signed-off-by: Grant Baker <grant.baker@intel.com>

* Ask to check hashes before prompt

---------

Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>
Remove the dump_requirement_file operation in export_ method.

            Fixes securefederatedai#767

            Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
            Co-authored-by: Wu, Caili <caili.wu@intel.com>
            Signed-off-by: He, Dan H <dan.h.he@intel.com>
            Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
            Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
            Signed-off-by: Wang, Le <le3.wang@intel.com>
            Signed-off-by: Wu, Caili <caili.wu@intel.com>

Signed-off-by: He, Dan H <dan.h.he@intel.com>
* created new ineractive_api dir to hold pytorch fedprox mnist example

corrected files

changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example

renamed FedProx notebook

used mode.parrameters() to get pytorch model weights

got weights using state_dict

changed old wieghts to list (for serialization) and fixed README

input wieghts before zero_grad

[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api

This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.

Fixes: securefederatedai#506

Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>

* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api

This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.

Fixes: securefederatedai#506

Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>

* Update README.md

Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>

* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.

Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>

---------

Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
…dai#807)

This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".

Fixes securefederatedai#768

Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
…#812)

* Add new tutorial example to OpenFL interactive API

This adds a new tutorial example on distributing a linear regression task over OpenFL cluster

The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.

Fixes securefederatedai#798

Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>

Signed-off-by: Yi CAO <yi2.cao@intel.com>

* reduced requirements.txt in workspace

Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>

---------

Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
…ecurefederatedai#776)

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.9.3...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.9.3...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Initial commit of Running the federation with GaNDLF Documentation

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update docs/running_the_federation_with_gandlf.rst

Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update README.md

Removed references to Intel's ownship, given it's now owned by the LF AI and Data.

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Fix Flake8 C419 for Ubuntu CI (securefederatedai#800)

C419 Unnecessary list comprehension passed to any()/all() prevents short-circuiting - rewrite as a generator

Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update README.md

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Fix warnings and issues in docs (securefederatedai#825)

* Fix warnings and issues in docs

Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>

* fixup! Fix warnings and issues in docs

Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>

---------

Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Add Logo (securefederatedai#827)

* Add Logo

* Update README.md

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Change OpenFL documentation font to improve accessibility (securefederatedai#809)

This replaces the font of OpenFL documents with Intel One Mono font for low vision developers.

    Known issues:
    1. The text font within the images has not been changed.
    2. Some icons that do not exist in the new font cannot be displayed properly.

    Fixes securefederatedai#799

    Co-authored-by: Wang, Le <le3.wang@intel.com>
    Signed-off-by: He, Dan H <dan.h.he@intel.com>
    Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
    Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
    Signed-off-by: Wang, Le <le3.wang@intel.com>
    Signed-off-by: Wu, Caili <caili.wu@intel.com>

Signed-off-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update unit tests to improve code coverage (securefederatedai#821)

* Update ci config

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Add unit test for following files

- openfl/federated/plan/plan.py
- openfl/interface/aggregation_functions/core/adaptive_aggregation.py

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Add some test cases for databases module

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Fix bugs for databases module unittest

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Update unit tests for component module

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Restore workflow config and update some comments

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Enable save_ test case.
Add yaml under test dir for unit test usage.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Remove plan to new dir.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Remove plan to new dir.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Add aggregator start test cases.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Add 2 aggregator test cases.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Add 1 aggregator test case.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Format code.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Refactor code.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Add collaborator start test cases.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Add 1 collaborator test case.

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Format with flake8

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

* Remove TODO comments

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>

---------

Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Add PyTorch linear regression example (securefederatedai#808)

This adds a new tutorial example on distributing a linear regression task over OpenFL cluster.

    The model is defined by Pytorch which is able to run over both cpu (by default) and gpu. The dataset is generated by make_regression from sklearn.datasets with pre-defined parameters.

    Fixes securefederatedai#797

    Co-authored-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
    Signed-off-by: He, Dan H <dan.h.he@intel.com>
    Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
    Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
    Signed-off-by: Wang, Le <le3.wang@intel.com>
    Signed-off-by: Wu, Caili <caili.wu@intel.com>

Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* This prints out the hash of the CSR to disk for both the aggregator and (securefederatedai#813)

* This prints out the hash of the CSR to disk for both the aggregator and
collaborator. The user then compares and approves this hash with the
hash printed out of the file to validate the CSR. In addition, a warning
message is pritned if certify is run in silent mode.

Fixes securefederatedai#692

Signed-off-by: Grant Baker <grant.baker@intel.com>

* Refactor read_csr function to use get_csr_hash

Signed-off-by: Grant Baker <grant.baker@intel.com>

* Ask to check hashes before prompt

---------

Signed-off-by: Grant Baker <grant.baker@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Improve workspace requirements import (securefederatedai#810)

Remove the dump_requirement_file operation in export_ method.

            Fixes securefederatedai#767

            Co-authored-by: Li, Qingqing <qingqing.li@intel.com>
            Co-authored-by: Wu, Caili <caili.wu@intel.com>
            Signed-off-by: He, Dan H <dan.h.he@intel.com>
            Signed-off-by: Jiang, Jiaqiu <jiaqiu.jiang@intel.com>
            Signed-off-by: Li, Qingqing <qingqing.li@intel.com>
            Signed-off-by: Wang, Le <le3.wang@intel.com>
            Signed-off-by: Wu, Caili <caili.wu@intel.com>

Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Issue 506 Added Example using FedProx (securefederatedai#818)

* created new ineractive_api dir to hold pytorch fedprox mnist example

corrected files

changed to FedProxOptimizer and ran set_old_weights for new FedProx Pytorch example

renamed FedProx notebook

used mode.parrameters() to get pytorch model weights

got weights using state_dict

changed old wieghts to list (for serialization) and fixed README

input wieghts before zero_grad

[Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api

This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.

Fixes: securefederatedai#506

Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>

* [Enhancement: 506] Add an example that uses the FedProx optimizer in the interative_api

This duplicates the MedNIST_2D example in the interative api but changes it to use the FedProx optimizer.

Fixes: securefederatedai#506

Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>

* Update README.md

Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>

* addressed comments by psfoley: corrected words in the jupyter notebook metadata and added a link to the FedProx paper in the README.

Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>

---------

Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* [Bug: 768] FX CLI: Separate create, cert gen commands (securefederatedai#807)

This change separates existing command
"fx collaborator.py generate-cert-request" command into two
commands.
"fx collaborator create -n {NAME} -d {DATA_PATH: optional}".
"fx collaborator generate-cert-request -n {NAME}".

Fixes securefederatedai#768

Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Add new tutorial example to OpenFL interactive API (securefederatedai#812)

* Add new tutorial example to OpenFL interactive API

This adds a new tutorial example on distributing a linear regression task over OpenFL cluster

The model is defined by scikit-learn which is able to run over both cpu (by default) and gpu. The dataset is 1-dimensional noisy data of sinusoid with pre-defined parameters.

Fixes securefederatedai#798

Co-authored-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Grant Baker <grant.baker@intel.com>

Signed-off-by: Yi CAO <yi2.cao@intel.com>

* reduced requirements.txt in workspace

Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>

---------

Signed-off-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>

* build(deps): bump tensorflow in /openfl-workspace/tf_cnn_histology (securefederatedai#776)

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.9.3...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* build(deps): bump tensorflow (securefederatedai#777)

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.9.3...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update GaNDLF repo location and test CI with master branch

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update GaNDLF repo location and test CI with master branch

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update GaNDLF repo location and test CI with master branch

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Fix documentation links. Change path names and templates for CI

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Fix paths

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Fix paths

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Fix breaking tests

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Add compatible onnx version to requirements.txt file

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Fix wrong csv file name

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Fix wrong csv file name

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Fix wrong names in workflow file

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Fix wrong data path

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Fix lint in test_gandlf.py

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Fix lint errors

Signed-off-by: Patrick Foley <psfoley@gmail.com>

---------

Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Aleksander Kantak <aleksander.kantak@intel.com>
Signed-off-by: He, Dan H <dan.h.he@intel.com>
Signed-off-by: Fang, Xiaoran <xiaoran.fang@intel.com>
Signed-off-by: Klemme, Beverly <beverly.klemme@intel.com>
Signed-off-by: Baker, Grant <grant.baker@intel.com>
Signed-off-by: ELizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Jillela, Emmanuel <emmanuel.jillela@intel.com>
Signed-off-by: Beverly Klemme <beverly.klemme@intel.com>
Signed-off-by: Elizabeth Simon, Neethu <neethu.elizabeth.simon@intel.com>
Signed-off-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Signed-off-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: Sarthak Pati <sarthak.pati@pennmedicine.upenn.edu>
Co-authored-by: Prashant Shah <40899779+SprashAI@users.noreply.github.com>
Co-authored-by: akantak <aleksander.kantak@intel.com>
Co-authored-by: wangleflex <106506636+wangleflex@users.noreply.github.com>
Co-authored-by: He, Dan H <dan.h.he@intel.com>
Co-authored-by: xiaoranf <desolatefang@gmail.com>
Co-authored-by: Wang, Wenjie <wenjie2.wang@intel.com>
Co-authored-by: Lei5 Chen <lei5.chen@intel.com>
Co-authored-by: Beverly Klemme <35578090+bjklemme-intel@users.noreply.github.com>
Co-authored-by: Emmanuel Jillela <emmanuel.jillela@intel.com>
Co-authored-by: Yi CAO <yi2.cao@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Fix links in GaNDLF Documentation

* Fixed GaNDLF rst issues. Add sphinxcontrib-mermaid

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Fix links in GaNDLF Documentation

Signed-off-by: Patrick Foley <psfoley@gmail.com>

---------

Signed-off-by: Patrick Foley <psfoley@gmail.com>
Signed-off-by: Francis Storr <francis.storr@intel.com>
…deratedai#840)

Bumps [onnx](https://github.com/onnx/onnx) from 1.12 to 1.13.0.
- [Release notes](https://github.com/onnx/onnx/releases)
- [Changelog](https://github.com/onnx/onnx/blob/main/docs/Changelog.md)
- [Commits](onnx/onnx@v1.12.0...v1.13.0)

---
updated-dependencies:
- dependency-name: onnx
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Fix incorrectly formatted link in docs

Signed-off-by: Francis Storr <francis.storr@intel.com>

* Font styling, color contrast, other accessibility updates

This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.

Closes securefederatedai#848

Signed-off-by: Francis Storr <francis.storr@intel.com>

---------

Signed-off-by: Francis Storr <francis.storr@intel.com>
…atest numpy stable release (1.24.3) (securefederatedai#833)

* fixing FedAvg averaging in order to be compatible with numpy v1.24+

Signed-off-by: kta-intel <kevin.ta@intel.com>

* uncommenting installations for consistency with other tutorials

Signed-off-by: kta-intel <kevin.ta@intel.com>

* fixing 301_MNIST_Watermarking tutorial FedAvg

Signed-off-by: kta-intel <kevin.ta@intel.com>

* fixing 301_MNIST_Watermarki
ng tutorial FedAvg

Signed-off-by: kta-intel <kevin.ta@intel.com>

* Switching to py38 kernel and clearing cell outputs

Signed-off-by: kta-intel <kevin.ta@intel.com>

---------

Signed-off-by: kta-intel <kevin.ta@intel.com>
…e/keras_nlp (securefederatedai#773)

* build(deps): bump tensorflow in /openfl-workspace/keras_nlp

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update RMSProp optimizer import

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* flake8

Signed-off-by: Patrick Foley <psfoley@gmail.com>

---------

Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
…e/keras_cnn_mnist (securefederatedai#771)

* build(deps): bump tensorflow in /openfl-workspace/keras_cnn_mnist

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* revert experimental Adam to legacy (securefederatedai#863)

Signed-off-by: kta-intel <kevin.ta@intel.com>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Ta <116312994+kta-intel@users.noreply.github.com>
…e/keras_cnn_with_compression (securefederatedai#770)

* build(deps): bump tensorflow

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Update Adam Optimizer import

Signed-off-by: Patrick Foley <psfoley@gmail.com>

---------

Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
…s/interactive_api/Flax_CNN_CIFAR (securefederatedai#775)

* build(deps): bump tensorflow

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.9.3 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.9.3...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Fixed breaking backages

Signed-off-by: Patrick Foley <psfoley@gmail.com>

* Add quiet flag back to pip install

Signed-off-by: Patrick Foley <psfoley@gmail.com>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
…space/keras_nlp_gramine_ready (securefederatedai#769)

* build(deps): bump tensorflow-cpu

Bumps [tensorflow-cpu](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow-cpu
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Use legacy RMSprop optimizer

Signed-off-by: Patrick Foley <psfoley@gmail.com>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Patrick Foley <psfoley@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
* Fix incorrectly formatted link in docs

Signed-off-by: Francis Storr <francis.storr@intel.com>

* Font styling, color contrast, other accessibility updates

This update:
1. Restores Roboto and Lato fonts for most body copy, leaving Intel One Mono for code samples.
2. Adds colors (in `colors.css`)
3. Adds a new `accessibility_overrides.css` file containing CSS that improves the accessibility of the documentation and, where possible, Read The Docs. These updates remediate numerous non-conforming WCAG 2.x Level AA bugs. The use of a separate file for this hopefully makes these changes easier to manage and less likely to be accessibility overwritten in the future.

Closes securefederatedai#848

Signed-off-by: Francis Storr <francis.storr@intel.com>

* Color contrast updates for accessibility

Color contrast updates for accessibility
- update generic `a` element
- update color of links in the toggle-able read-the-docs panel
- update the color of the text in search results
- update the color of notes headers

Signed-off-by: Francis Storr <francis.storr@intel.com>

---------

Signed-off-by: Francis Storr <francis.storr@intel.com>
…refederatedai#758)

* implemented ray.wait

* reverted changes back after testing

* adding datastore cli test case

* removed unused variables

* removed stderr validation

* fixed lint suggestions
Signed-off-by: Francis Storr <francis.storr@intel.com>
…teractive_api_director/experiments/tensorflow_mnist/envoy (securefederatedai#772)

* build(deps): bump tensorflow

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.8.4 to 2.11.1.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](tensorflow/tensorflow@v2.8.4...v2.11.1)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update sd_requirements.txt

* revert to legacy SGD and install tensorflow==2.11 for workflow

Signed-off-by: kta-intel <kevin.ta@intel.com>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: kta-intel <kevin.ta@intel.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Patrick Foley <patrick.foley@intel.com>
Co-authored-by: kta-intel <kevin.ta@intel.com>
porteratzo and others added 29 commits October 30, 2023 07:43
* Merged 102 and 201

Signed-off-by: leofracca <leonardofraccaroli1999@gmail.com>

* Merge 301-401

Signed-off-by: leofracca <leonardofraccaroli1999@gmail.com>

* Fixed bugs and substituted the example file with the correct one

Signed-off-by: leofracca <leonardofraccaroli1999@gmail.com>

* Fixed cells explanation for Workflow Interface 401

Signed-off-by: leofracca <leonardofraccaroli1999@gmail.com>

* Cleared outputs

Signed-off-by: leofracca <leonardofraccaroli1999@gmail.com>

* Optimized introduction and fixed a wrong class name

Signed-off-by: leofracca <leonardofraccaroli1999@gmail.com>

* Fixed comments

Signed-off-by: leofracca <leonardofraccaroli1999@gmail.com>

* Fixed comments punctuation

Signed-off-by: leofracca <leonardofraccaroli1999@gmail.com>

* Removed unnecessary files and added authors' names

Signed-off-by: leofracca <leonardofraccaroli1999@gmail.com>

* Removed author list

Signed-off-by: leofracca <leonardofraccaroli1999@gmail.com>

---------

Signed-off-by: leofracca <leonardofraccaroli1999@gmail.com>
Co-authored-by: Albio-uni <alberto.carli_01@studenti.univr.it>
Co-authored-by: Rickybolo99 <80536015+Rickybolo99@users.noreply.github.com>
Co-authored-by: leofracca <leonardofraccaroli1999@gmail.com>
Co-authored-by: Gabriele <39500974+aymuthe@users.noreply.github.com>
Co-authored-by: Marcello De Vincenzi <80536254+MDV-droid@users.noreply.github.com>
* Update README.md

Added Gaudi2 run instructions on Intel Developer Cloud

Signed-off-by: orionsBeltWest <basem.barakat@intel.com>

* Update README.md with Gaudi2 instructions

Signed-off-by: orionsBeltWest <basem.barakat@intel.com>

* Update README.md with Gaudi2 instructions

Signed-off-by: orionsBeltWest <basem.barakat@intel.com>

* update README as per PR comments

* Updated README with more information on building a Dockerfile

* Update openfl-tutorials/interactive_api/HPU/PyTorch_MedMNIST_2D/README.md

Co-authored-by: Patrick Foley <psfoley@gmail.com>

* Update openfl-tutorials/interactive_api/HPU/PyTorch_TinyImageNet/README.md

Co-authored-by: Patrick Foley <psfoley@gmail.com>

* Update openfl-tutorials/interactive_api/HPU/PyTorch_Kvasir_UNet/README.md

Co-authored-by: Patrick Foley <psfoley@gmail.com>

---------

Signed-off-by: orionsBeltWest <basem.barakat@intel.com>
Co-authored-by: Patrick Foley <psfoley@gmail.com>
@porteratzo porteratzo closed this Nov 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.