Skip to content

Conversation

@Jiseong-oh
Copy link
Collaborator

@Jiseong-oh Jiseong-oh commented Nov 11, 2025

Summary

Enable E2E test for the Exynos backend.
Modify it to run the testing using a device from devicefarm that can be used directly in CI.

Test plan

Each test case was verified on a real device.

cc @SS-JIA @digantdesai @kimishpatel

@Jiseong-oh Jiseong-oh requested a review from cccclai as a code owner November 11, 2025 04:59
@pytorch-bot
Copy link

pytorch-bot bot commented Nov 11, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15731

Note: Links to docs will display an error until the docs builds have been completed.

❌ 4 New Failures

As of commit 1c8c753 with merge base b7dc758 (image):

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 11, 2025
@Jiseong-oh Jiseong-oh force-pushed the exynosbackend_e2e_test branch 21 times, most recently from 4dc30f7 to fefa7e4 Compare November 17, 2025 23:43
@Jiseong-oh Jiseong-oh force-pushed the exynosbackend_e2e_test branch 6 times, most recently from 613ad0b to 629a7e3 Compare November 24, 2025 06:12
@Jiseong-oh Jiseong-oh force-pushed the exynosbackend_e2e_test branch 2 times, most recently from c697a09 to bed25ce Compare November 24, 2025 08:28
@Jiseong-oh Jiseong-oh requested a review from SS-JIA November 24, 2025 09:35
@Jiseong-oh Jiseong-oh changed the title Exynosbackend e2e test Enable Exynosbackend e2e test Nov 24, 2025
@Jiseong-oh Jiseong-oh added partner: samsung For backend delegation, kernels, demo, etc. from the 3rd-party partner, Samsung release notes: exynos module: samsung labels Nov 24, 2025
@Jiseong-oh Jiseong-oh force-pushed the exynosbackend_e2e_test branch 2 times, most recently from f1987b9 to 062ae21 Compare November 27, 2025 05:06
@Jiseong-oh Jiseong-oh force-pushed the exynosbackend_e2e_test branch from 062ae21 to 3ba9d9f Compare December 4, 2025 11:18
Copy link
Contributor

@SS-JIA SS-JIA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very cool - LGTM!

Jiseong-oh and others added 10 commits December 16, 2025 17:04
Co-authored-by: chong-chen <chong.chen@samsung.com>
For op test, add run_method_and_compare_outputs to make the test complete.
The Exynos-backend-specific PTE file will be executed on device, and its outputs will be checked.

Co-authored-by: chong-chen <chong.chen@samsung.com>
Add more models for E2E test(edsr, inception v3/v4, mobilenet v3, resnet 18/50)

Co-authored-by: Jonghun Cha <jhbb.cha@samsung.com>
The original float models are tested by executing aot_compiler script.
Additionally, unify the outputs to tuple format in base tester.

Co-authored-by: chong-chen <chong.chen@samsung.com>
Signed-off-by: jiseong.oh <jiseong.oh@samsung.com>
Signed-off-by: jiseong.oh <jiseong.oh@samsung.com>
update devicefarm-cli
remove ops test due to long latency

Signed-off-by: jiseong.oh <jiseong.oh@samsung.com>
Signed-off-by: jiseong.oh <jiseong.oh@samsung.com>
Signed-off-by: jiseong.oh <jiseong.oh@samsung.com>
Signed-off-by: jiseong.oh <jiseong.oh@samsung.com>
@Jiseong-oh Jiseong-oh force-pushed the exynosbackend_e2e_test branch from 669a8ee to 1c8c753 Compare December 16, 2025 08:04
@SS-JIA SS-JIA merged commit 28da6a8 into main Dec 18, 2025
372 of 401 checks passed
@SS-JIA SS-JIA deleted the exynosbackend_e2e_test branch December 18, 2025 15:36
xingguo01 pushed a commit to xingguo01/executorch that referenced this pull request Dec 18, 2025
### Summary
Enable E2E test for the Exynos backend.
Modify it to run the testing using a device from devicefarm that can be
used directly in CI.

### Test plan
Each test case was verified on a real device.

cc @SS-JIA @digantdesai @kimishpatel

---------

Signed-off-by: jiseong.oh <jiseong.oh@samsung.com>
Co-authored-by: chong-chen <chong.chen@samsung.com>
Co-authored-by: Jonghun Cha <jhbb.cha@samsung.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. module: samsung partner: samsung For backend delegation, kernels, demo, etc. from the 3rd-party partner, Samsung release notes: exynos

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants