Skip to content
This repository has been archived by the owner on Jan 24, 2024. It is now read-only.

PaddlePaddle/paddle-ce-latest-kpis

Folders and files

NameName
Last commit message
Last commit date

Latest commit

f9a9ca7 · Dec 13, 2021
Aug 20, 2019
Dec 10, 2020
Sep 17, 2021
Jun 4, 2021
Dec 13, 2021
Apr 20, 2021
Sep 27, 2019
Dec 2, 2019
Mar 11, 2020
Mar 26, 2019
Oct 18, 2019
Apr 2, 2018
May 28, 2018
May 22, 2019

Repository files navigation

Paddle Continuous Evaluation Baselines

Howtos

Add New Evaluation Task

Reference mnist task, the following files are required by CE framework:

  • run.xsh , a script to start this evaluation execution
    • this script can be any bash script, just place #!/bin/bash or #/bin/xonsh to the head if it is written in the bash or xonsh language
  • continuous_evaluation.py to include all the KPIs this task tracks
  • latest_kpis directory, include all the baseline files

PR and Add to Service

  • PR to fast branch, and run ce-kpi-fast-test test on teamcity,
  • if passed, PR from fast to master branch.

Add new KPI to track

Reference the interface kpi.py, there are two basic KPIs:

  • LessWorseKpi
  • GreaterWorseKpi