Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(framework) Add SuperExec logcatcher #3584

Merged
merged 86 commits into from
Sep 19, 2024
Merged

feat(framework) Add SuperExec logcatcher #3584

merged 86 commits into from
Sep 19, 2024

Commits on Jun 11, 2024

  1. Initial commit

    @chongshenng
    chongshenng committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    9de511d View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Add multiprocessing logstreaming

    @chongshenng
    chongshenng committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    4b1df94 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into add-superexec-logcatcher

    @chongshenng
    chongshenng committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    97cef65 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Lint code

    @chongshenng
    chongshenng committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    b429096 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into add-superexec-logcatcher

    @chongshenng
    chongshenng committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    95731ab View commit details
    Browse the repository at this point in the history

  3. Add dataclass

    @chongshenng
    chongshenng committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    49da0b4 View commit details
    Browse the repository at this point in the history

  4. Add init

    @chongshenng
    chongshenng committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    13ab65f View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. Merge main

    @chongshenng
    chongshenng committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    a6c08eb View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into add-superexec-logcatcher

    @chongshenng
    chongshenng committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    4ae26c8 View commit details
    Browse the repository at this point in the history

  3. Fix docstring

    @chongshenng
    chongshenng committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    48c2ef6 View commit details
    Browse the repository at this point in the history

  4. Lint

    @chongshenng
    chongshenng committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    eddbc6d View commit details
    Browse the repository at this point in the history

  5. Lint

    @chongshenng
    chongshenng committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    9d656ef View commit details
    Browse the repository at this point in the history

  6. Fix proto file

    @chongshenng
    chongshenng committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    1ddfd58 View commit details
    Browse the repository at this point in the history

  7. Add context cancel

    @chongshenng
    chongshenng committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    0e4f091 View commit details
    Browse the repository at this point in the history

  8. Push protoc files

    @chongshenng
    chongshenng committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    5442ea0 View commit details
    Browse the repository at this point in the history

  9. Fix proc.stdout/err close

    @chongshenng
    chongshenng committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    0ec6188 View commit details
    Browse the repository at this point in the history

  10. Relocate context cancel for full logging

    @chongshenng
    chongshenng committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    5888c76 View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2024

  1. Merge branch 'main' into add-superexec-logcatcher

    @danieljanes
    danieljanes authored Jun 16, 2024
    Configuration menu
    Copy the full SHA
    3a5b739 View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. Remove protobuf changes

    @chongshenng
    chongshenng committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    7a70236 View commit details
    Browse the repository at this point in the history

  2. feat(framework) Add new proto definitions for FABs (#3618)

    @tanertopal @chongshenng
    tanertopal authored and chongshenng committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    7e03fe4 View commit details
    Browse the repository at this point in the history

  3. fix(framework) Pass superlink address when starting supernode (#3621)

    @jafermarq @chongshenng
    jafermarq authored and chongshenng committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    360fee8 View commit details
    Browse the repository at this point in the history

  4. Update proto-compiled files

    @chongshenng
    chongshenng committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    91e3e21 View commit details
    Browse the repository at this point in the history

  5. Merge LogStreamer into RunTracker

    @chongshenng
    chongshenng committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    2219ca4 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into add-superexec-logcatcher

    @chongshenng
    chongshenng committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    7dd3965 View commit details
    Browse the repository at this point in the history

  7. Add comments

    @chongshenng
    chongshenng committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    cb07b43 View commit details
    Browse the repository at this point in the history

  8. Remove redundant lines

    @chongshenng
    chongshenng committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    853416c View commit details
    Browse the repository at this point in the history

  9. Revert

    @chongshenng
    chongshenng committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    6914780 View commit details
    Browse the repository at this point in the history

  10. Merge proto files

    @chongshenng
    chongshenng committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    49ed59b View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. Merge branch 'main' into add-superexec-logcatcher

    @chongshenng
    chongshenng committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    5393a25 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. Merge branch 'main' into add-superexec-logcatcher

    @chongshenng
    chongshenng committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    c010499 View commit details
    Browse the repository at this point in the history

  2. Merge LogStreamer to RunTracker, cleanup

    @chongshenng
    chongshenng committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    743268b View commit details
    Browse the repository at this point in the history

  3. Remove redundant code

    @chongshenng
    chongshenng committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    831dc6f View commit details
    Browse the repository at this point in the history

  4. Update comment

    @chongshenng
    chongshenng committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    2883974 View commit details
    Browse the repository at this point in the history

  5. Remove self.lock

    @chongshenng
    chongshenng committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    cc33d3f View commit details
    Browse the repository at this point in the history

  6. Remove lock

    @chongshenng
    chongshenng committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    a7a0a56 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' into add-superexec-logcatcher

    @chongshenng
    chongshenng committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    aef56a6 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. Move capture_logs outside ExecServicer

    @chongshenng
    chongshenng committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    1fe80c8 View commit details
    Browse the repository at this point in the history

  2. Add test for capture_logs

    @chongshenng
    chongshenng committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    7291e49 View commit details
    Browse the repository at this point in the history

  3. Merge main

    @chongshenng
    chongshenng committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    3f5d5c5 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2024

  1. Merge branch 'main' into add-superexec-logcatcher

    @chongshenng
    chongshenng committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    72160a0 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2024

  1. Remove if statement

    @chongshenng
    chongshenng committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    946adfa View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into add-superexec-logcatcher

    @chongshenng
    chongshenng committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    4c617d2 View commit details
    Browse the repository at this point in the history

  3. Increase sleep to 1s

    @chongshenng
    chongshenng committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    3d93466 View commit details
    Browse the repository at this point in the history

  4. Remove threading.Event

    @chongshenng
    chongshenng committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    869e692 View commit details
    Browse the repository at this point in the history

  5. Remove unused lib

    @chongshenng
    chongshenng committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    f1fbc69 View commit details
    Browse the repository at this point in the history

  6. Move exit on run_id not found outside while loop

    @chongshenng
    chongshenng committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    acc08c7 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' into add-superexec-logcatcher

    @tanertopal
    tanertopal authored Jul 22, 2024
    Configuration menu
    Copy the full SHA
    7da980f View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2024

  1. Merge main

    @chongshenng
    chongshenng committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    e29ca76 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into add-superexec-logcatcher

    @tanertopal
    tanertopal authored Jul 23, 2024
    Configuration menu
    Copy the full SHA
    01a55c5 View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2024

  1. Merge branch 'main' into add-superexec-logcatcher

    @chongshenng
    chongshenng committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    7b49171 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2024

  1. Merge branch 'main' into add-superexec-logcatcher

    @chongshenng
    chongshenng committed Jul 25, 2024
    Configuration menu
    Copy the full SHA
    7c332cc View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2024

  1. Merge branch 'main' into add-superexec-logcatcher

    @chongshenng
    chongshenng committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    4e8826f View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. Merge branch 'main' into add-superexec-logcatcher

    @chongshenng
    chongshenng committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    67957c5 View commit details
    Browse the repository at this point in the history

  2. Fix test

    @chongshenng
    chongshenng committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    41cd3dc View commit details
    Browse the repository at this point in the history

  3. Add comment

    @chongshenng
    chongshenng committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    4dfae32 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into add-superexec-logcatcher

    @chongshenng
    chongshenng committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    1529565 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Merge main

    @chongshenng
    chongshenng committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    372f03c View commit details
    Browse the repository at this point in the history

  2. Ruff

    @chongshenng
    chongshenng committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    09988d1 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Merge branch 'main' into add-superexec-logcatcher

    @chongshenng
    chongshenng committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    5068b79 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. docs(framework) Remove default title for Flower documentation from `b… 

    …ase.html` (#3927)
    @chongshenng
    chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    5b42b27 View commit details
    Browse the repository at this point in the history

  2. docs(framework:skip) Add sphinxext-opengraph to dev dependencies (#4212 

    )
    @chongshenng
    chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    54ed582 View commit details
    Browse the repository at this point in the history

  3. refactor(framework) Update get/set parameter functions for FlowerTune… 

    … template (#4217)
    @yan-gao-GY @chongshenng
    yan-gao-GY authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    b886960 View commit details
    Browse the repository at this point in the history

  4. break(datasets) Drop support for Python 3.8 (#4213)

    @adam-narozniak @chongshenng
    adam-narozniak authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    fd46f2d View commit details
    Browse the repository at this point in the history

  5. refactor(examples) Update get/set parameters functions for FlowerTune… 

    … LLM example (#4219)
    @yan-gao-GY @chongshenng
    yan-gao-GY authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    ef486a8 View commit details
    Browse the repository at this point in the history

  6. refactor(examples) Update quickstart-pandas example (#4007) 

    Co-authored-by: jafermarq <javier@flower.ai>
    @chongshenng @jafermarq
    chongshenng and jafermarq committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    8628b1a View commit details
    Browse the repository at this point in the history

  7. feat(examples) Update vertical-fl example (#3716) 

    Co-authored-by: jafermarq <javier@flower.ai>
Co-authored-by: Daniel J. Beutel <daniel@flower.ai>
    @charlesbvll @jafermarq
    @danieljanes @chongshenng
    3 people authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    24d0353 View commit details
    Browse the repository at this point in the history

  8. refactor(examples) Update tensorflow-privacy example (#4204) 

    Co-authored-by: jafermarq <javier@flower.ai>
    @mohammadnaseri @jafermarq @chongshenng
    2 people authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    d994741 View commit details
    Browse the repository at this point in the history

  9. refactor(examples:skip) Update quickstart-tensorflow example (#4227)

    @mohammadnaseri @chongshenng
    mohammadnaseri authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    624c868 View commit details
    Browse the repository at this point in the history

  10. docs(framework) Add new blockchain example to FAQ (#3993)

    @ray-ruisun @chongshenng
    ray-ruisun authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    0135f60 View commit details
    Browse the repository at this point in the history

  11. refactor(benchmarks) Update llm leaderboard Readmes (#4228)

    @yan-gao-GY @chongshenng
    yan-gao-GY authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    97e94ff View commit details
    Browse the repository at this point in the history

  12. refactor(framework) Migrate ID handling from sint64 to uint64 (#4170) 

    Co-authored-by: Heng Pan <pan@flower.ai>
Co-authored-by: Daniel J. Beutel <daniel@flower.ai>
    @mohammadnaseri @panh99
    @danieljanes @chongshenng
    3 people authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    ba1c577 View commit details
    Browse the repository at this point in the history

  13. docs(framework) Update Quickstart Tutorial documentation for TensorFl… 

    …ow with `flwr run` (#3338)

Co-authored-by: Javier <jafermarq@users.noreply.github.com>
Co-authored-by: Charles Beauville <charles@flower.ai>
    @chongshenng @jafermarq @charlesbvll
    3 people committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    5869a18 View commit details
    Browse the repository at this point in the history

  14. docs(framework) Update quickstart tutorial documentation for Hugging … 

    …Face with `flwr run` (#3341)

Co-authored-by: Javier <jafermarq@users.noreply.github.com>
    @chongshenng @jafermarq
    chongshenng and jafermarq committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    f47380f View commit details
    Browse the repository at this point in the history

  15. docs(framework) Update fastai quickstart tutorial (#4151)

    @jafermarq @chongshenng
    jafermarq authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    75d779c View commit details
    Browse the repository at this point in the history

  16. docs(framework) Update pytorch-lightning quickstart tutorial (#4152)

    @jafermarq @chongshenng
    jafermarq authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    bd7ba5f View commit details
    Browse the repository at this point in the history

  17. feat(datasets) Add SizePartitioner (#4111) 

    Co-authored-by: jafermarq <javier@flower.ai>
    @adam-narozniak @jafermarq @chongshenng
    2 people authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    fa0ae67 View commit details
    Browse the repository at this point in the history

  18. refactor(examples) Update advanced-pytorch example (#4130) 

    Co-authored-by: Chong Shen Ng <chong.shen@flower.ai>
    @jafermarq @chongshenng
    jafermarq and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    f110cb0 View commit details
    Browse the repository at this point in the history

  19. refactor(examples) Make quickstart-huggingfaceuse a smaller LM (#4206)

    @jafermarq @chongshenng
    jafermarq authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    93977af View commit details
    Browse the repository at this point in the history

  20. fix(*:skip) Update .editorconfig (#4238)

    @danieljanes @chongshenng
    danieljanes authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    7f0f5c4 View commit details
    Browse the repository at this point in the history

  21. feat(framework:skip) Add gcc in Docker compose setup (#4187) 

    Signed-off-by: Robert Steiner <robert@flower.ai>
Co-authored-by: Flower <148336023+flwrmachine@users.noreply.github.com>
    @Robert-Steiner @flwrmachine @chongshenng
    2 people authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    ed2f70c View commit details
    Browse the repository at this point in the history

  22. refactor(framework) Add further unit tests to sint64 to uint64 conver… 

    …sion utils (#4237)
    @mohammadnaseri @chongshenng
    mohammadnaseri authored and chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    0710884 View commit details
    Browse the repository at this point in the history

  23. Address comments

    @chongshenng
    chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    8fcd519 View commit details
    Browse the repository at this point in the history

  24. Merge main

    @chongshenng
    chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    b89def1 View commit details
    Browse the repository at this point in the history

  25. Update comment

    @chongshenng
    chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    10cf562 View commit details
    Browse the repository at this point in the history

  26. Add return

    @chongshenng
    chongshenng committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    01fb1a3 View commit details
    Browse the repository at this point in the history

  27. Update src/py/flwr/superexec/exec_servicer.py

    @danieljanes
    danieljanes authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    23f14b4 View commit details
    Browse the repository at this point in the history