Ability to update labels once marked

[sonalgoyal]

Right now there is no way to update labels if a wrong one has been specified. See https://zinggai.slack.com/archives/C02JNH144TB/p1638361934009800

[sonalgoyal]

We need to spec this out.

[sonalgoyal]

What if we had multiple htmls, one per run html containing the pairs and their labels in that run? The label phase could generate this with the round number and pair information everytime. And then have a master html which will have total stats, and links to marked, unmarked etc

eventually, we will be using this structure to print out data quality reports.

we could then define a new phase - updateLabel which takes in the id/ids of the pairs we want to update

[sonalgoyal]

Let us make a folder html under model/modelId and have same marked/unmaked. Write html version of the dataframe to this folder after findtrainingData and label phases.

[sonalgoyal]

This html framework will eventually be used for dq, stats, model documentation etc so we have to write it in a generic way

[sonalgoyal]

After discussion with @navinrathore :

• Separate phase generateTrainingDataDocs which goes over marked and unmarked records and builds out the html. The html contains pagination and search. And separate sections for records - marked (match/non match/cant say) and unmarked
• Focus on readability of pairs in all cases
• Write under model/modelId/docs/trainingData.html with subfiles.

[sonalgoyal]

Have a phase updateLabel which first invokes generateTrainingDataDocs and asks the user to tell which record id to update in a loop. It then updates the labels and generates the docs again

[sonalgoyal]

Have a phase updateLabel which first invokes generateTrainingDataDocs and asks the user to tell which record id to update in a loop. It then updates the labels and generates the docs again

@navinrathore can you please work on this?

[sonalgoyal]

Have a phase updateLabel and asks the user to tell which record id to update in a loop. It then updates the labels and generates the docs again