Skip to content

Commit

Permalink
Update DeTPP results for StackOverflow with new metrics
Browse files Browse the repository at this point in the history
  • Loading branch information
ivan-chai committed Dec 17, 2024
1 parent d530d52 commit 605e28f
Show file tree
Hide file tree
Showing 2 changed files with 18 additions and 2 deletions.
10 changes: 9 additions & 1 deletion experiments/stackoverflow/results/multiseed_detection.yaml
Original file line number Diff line number Diff line change
@@ -1,9 +1,11 @@
date: '2024-10-01 13:23:57'
date: '2024-12-17 10:18:27'
num_seeds: 5
test/T-mAP (mean): 0.23108274340629578
test/T-mAP (std): 0.0017025853559023028
test/T-mAP-micro (mean): 0.6593285322189331
test/T-mAP-micro (std): 0.00254118089034342
test/horizon-max-accuracy-micro (mean): 0.6592200636863709
test/horizon-max-accuracy-micro (std): 0.0018028824345208759
test/horizon-mean-time-step (mean): 0.19802537858486174
test/horizon-mean-time-step (std): 0.002031596174685396
test/loss (mean): 2.2089333534240723
Expand Down Expand Up @@ -32,6 +34,8 @@ test/next-item-map (mean): 0.12334492355585099
test/next-item-map (std): 0.0028632898859583347
test/next-item-map-micro (mean): 0.3604132473468781
test/next-item-map-micro (std): 0.0015318422131242986
test/next-item-max-accuracy (mean): 0.45569363236427307
test/next-item-max-accuracy (std): 0.0008483168706081746
test/next-item-mean-time-step (mean): 0.8790849328041077
test/next-item-mean-time-step (std): 0.002354380511752819
test/next-item-rmse (mean): 1.078858995437622
Expand All @@ -50,6 +54,8 @@ val/T-mAP (mean): 0.24438766539096832
val/T-mAP (std): 0.0019863717851950663
val/T-mAP-micro (mean): 0.6643559336662292
val/T-mAP-micro (std): 0.002574725140051977
val/horizon-max-accuracy-micro (mean): 0.6650668621063233
val/horizon-max-accuracy-micro (std): 0.0028456345616964755
val/horizon-mean-time-step (mean): 0.1990049362182617
val/horizon-mean-time-step (std): 0.001939020202331865
val/loss (mean): 2.1684677600860596
Expand Down Expand Up @@ -78,6 +84,8 @@ val/next-item-map (mean): 0.1275002360343933
val/next-item-map (std): 0.0020428296458902435
val/next-item-map-micro (mean): 0.3766181945800781
val/next-item-map-micro (std): 0.001967335611504322
val/next-item-max-accuracy (mean): 0.46233893632888795
val/next-item-max-accuracy (std): 0.0004502916980277972
val/next-item-mean-time-step (mean): 0.9078915238380432
val/next-item-mean-time-step (std): 0.0021362896991798165
val/next-item-rmse (mean): 1.1023093700408935
Expand Down
Original file line number Diff line number Diff line change
@@ -1,9 +1,11 @@
date: '2024-10-01 13:13:59'
date: '2024-12-17 10:25:55'
num_seeds: 5
test/T-mAP (mean): 0.22719434797763824
test/T-mAP (std): 0.0023343581262561357
test/T-mAP-micro (mean): 0.6566985964775085
test/T-mAP-micro (std): 0.0019573345470623995
test/horizon-max-accuracy-micro (mean): 0.6569351553916931
test/horizon-max-accuracy-micro (std): 0.0005454182547954742
test/horizon-mean-time-step (mean): 0.1974691182374954
test/horizon-mean-time-step (std): 0.002017314546897837
test/loss (mean): 4.446385192871094
Expand Down Expand Up @@ -36,6 +38,8 @@ test/next-item-map (mean): 0.1400308519601822
test/next-item-map (std): 0.0010666263593771472
test/next-item-map-micro (mean): 0.3710343360900879
test/next-item-map-micro (std): 0.00101997625155711
test/next-item-max-accuracy (mean): 0.4582278966903687
test/next-item-max-accuracy (std): 0.0007515411562785001
test/next-item-mean-time-step (mean): 0.8722787499427795
test/next-item-mean-time-step (std): 0.0009396466135117075
test/next-item-rmse (mean): 1.0624217987060547
Expand All @@ -54,6 +58,8 @@ val/T-mAP (mean): 0.23797641694545746
val/T-mAP (std): 0.0009989218736830949
val/T-mAP-micro (mean): 0.6619092345237731
val/T-mAP-micro (std): 0.0010677867093069713
val/horizon-max-accuracy-micro (mean): 0.664458954334259
val/horizon-max-accuracy-micro (std): 0.0009883045144394814
val/horizon-mean-time-step (mean): 0.1979090690612793
val/horizon-mean-time-step (std): 0.0018428624409114003
val/loss (mean): 4.365755558013916
Expand Down Expand Up @@ -86,6 +92,8 @@ val/next-item-map (mean): 0.14257933497428893
val/next-item-map (std): 0.0011800711583904108
val/next-item-map-micro (mean): 0.3869736075401306
val/next-item-map-micro (std): 0.0005923216994001201
val/next-item-max-accuracy (mean): 0.46284475922584534
val/next-item-max-accuracy (std): 0.000664708701892392
val/next-item-mean-time-step (mean): 0.9004297137260437
val/next-item-mean-time-step (std): 0.000832262785613416
val/next-item-rmse (mean): 1.0842974424362182
Expand Down

0 comments on commit 605e28f

Please sign in to comment.