Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Markup fix #186

Merged
merged 3 commits into from
Jan 13, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
26 changes: 13 additions & 13 deletions .ci/benchmark.txt
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
META MD5 984f912263c0c337a1672296aa759cbc
DATA MD5 6db3f0cb94aad9db85077fb00a1ae6bf
META MD5 d0a224099b6f47bb8948c372b8fc6144
DATA MD5 0c336686c107937f85997d599484de04
DATA: 16329853 interested lines. MARKUP: 59550 items
FileType FileNumber ValidLines Positives Negatives Templates
--------------- ------------ ------------ ----------- ----------- -----------
Expand Down Expand Up @@ -82,10 +82,10 @@ FileType FileNumber ValidLines Positives Negatives Templat
.ipynb 1 134 6
.j 1 241 4
.j2 30 5530 6 174 10
.java 613 133184 347 1323 171
.java 613 133184 345 1325 171
.jenkinsfile 1 58 2 6
.jinja2 1 64 2
.js 653 532652 512 2450 331
.js 653 532652 527 2450 316
.json 843 13045846 1076 10012 139
.jsp 13 3202 1 37
.jsx 7 857 19
Expand Down Expand Up @@ -159,7 +159,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.pyx 2 1094 23
.r 4 62 4 2 1
.rake 2 51 2
.rb 834 128817 269 2457 615
.rb 834 128817 270 2456 615
.re 1 31 1
.red 1 159 1
.release 1 13 4
Expand All @@ -179,7 +179,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.scala 39 5028 22 99
.scss 16 8553 32 1
.secrets 1 11 1
.sh 142 21518 57 464 24
.sh 142 21518 58 464 23
.slim 1 153 1 2
.smali 1 775 18
.snap 3 1708 9 29 2
Expand Down Expand Up @@ -219,10 +219,10 @@ FileType FileNumber ValidLines Positives Negatives Templat
.xib 11 503 164
.xsl 1 311 1
.yaml 136 18591 123 341 42
.yml 418 36057 522 910 376
.yml 418 36057 523 910 375
.zsh 6 872 12
.zsh-theme 1 97 1
TOTAL: 10003 16329853 11858 46612 5084
TOTAL: 10003 16329853 11874 46613 5067
credsweeper result_cnt : 0, lost_cnt : 0, true_cnt : 0, false_cnt : 0
Rules Positives Negatives Templates Reported TP FP TN FN FPR FNR ACC PRC RCL F1
------------------------------ ----------- ----------- ----------- ---------- ---- ---- ----- ----- -------- -------- -------- ----- -------- ----
Expand All @@ -231,7 +231,7 @@ AWS Client ID 168 21 0
AWS Multi 82 10 0 0 0 10 82 0.000000 1.000000 0.108696 0.000000
AWS S3 Bucket 67 23 0 0 0 23 67 0.000000 1.000000 0.255556 0.000000
Atlassian Old PAT token 3 7 0 0 0 7 3 0.000000 1.000000 0.700000 0.000000
Auth 417 2741 82 0 0 2823 417 0.000000 1.000000 0.871296 0.000000
Auth 415 2743 82 0 0 2825 415 0.000000 1.000000 0.871914 0.000000
Azure Access Token 19 0 0 0 0 0 19 1.000000 0.000000 0.000000
BASE64 Private Key 12 4 0 0 0 4 12 0.000000 1.000000 0.250000 0.000000
BASE64 encoded PEM Private Key 7 0 0 0 0 0 7 1.000000 0.000000 0.000000
Expand All @@ -257,20 +257,20 @@ Grafana Provisioned API Key 22 1 0
JSON Web Token 170 61 0 0 0 61 170 0.000000 1.000000 0.264069 0.000000
Jira / Confluence PAT token 0 4 0 0 0 4 0 0.000000 1.000000
Jira 2FA 15 6 1 0 0 7 15 0.000000 1.000000 0.318182 0.000000
Key 3911 15715 485 0 0 16200 3911 0.000000 1.000000 0.805529 0.000000
Key 3912 15714 485 0 0 16199 3912 0.000000 1.000000 0.805480 0.000000
Nonce 93 49 0 0 0 49 93 0.000000 1.000000 0.345070 0.000000
Other 9 7447 5 0 0 7452 9 0.000000 1.000000 0.998794 0.000000
PEM Private Key 1019 1483 0 0 0 1483 1019 0.000000 1.000000 0.592726 0.000000
Password 1869 7536 2680 0 0 10216 1869 0.000000 1.000000 0.845345 0.000000
Password 1887 7535 2663 0 0 10198 1887 0.000000 1.000000 0.843856 0.000000
Salesforce Credentials 2 0 0 0 0 0 2 1.000000 0.000000 0.000000
Salt 47 76 1 0 0 77 47 0.000000 1.000000 0.620968 0.000000
Secret 1297 1576 802 0 0 2378 1297 0.000000 1.000000 0.647075 0.000000
Seed 1 6 0 0 0 6 1 0.000000 1.000000 0.857143 0.000000
Slack Token 4 1 0 0 0 1 4 0.000000 1.000000 0.200000 0.000000
Stripe Credentials 2 0 0 0 0 0 2 1.000000 0.000000 0.000000
Tencent WeChat API App ID 6 0 0 0 0 0 6 1.000000 0.000000 0.000000
Token 644 4170 454 0 0 4624 644 0.000000 1.000000 0.877752 0.000000
Token 643 4171 454 0 0 4625 643 0.000000 1.000000 0.877942 0.000000
Twilio Credentials 30 39 0 0 0 39 30 0.000000 1.000000 0.565217 0.000000
URL Credentials 210 157 215 0 0 372 210 0.000000 1.000000 0.639175 0.000000
UUID 1075 265 0 0 0 265 1075 0.000000 1.000000 0.197761 0.000000
11858 46612 5084 0 0 0 46612 11858 0.000000 1.000000 0.797195 0.000000
11874 46613 5067 0 0 0 46613 11874 0.000000 1.000000 0.796981 0.000000
2 changes: 1 addition & 1 deletion meta/2ba83c6a.csv
Original file line number Diff line number Diff line change
Expand Up @@ -861,7 +861,7 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
24919,911dde03,GitHub,2ba83c6a,data/2ba83c6a/test/911dde03.txt,9668,9668,T,F,6,54,F,F,,,,,0.0,0,F,F,F,Key
24921,28587231,GitHub,2ba83c6a,data/2ba83c6a/test/28587231.txt,224,224,T,F,6,70,F,F,,,,,0.0,0,F,F,F,Key
24922,911dde03,GitHub,2ba83c6a,data/2ba83c6a/test/911dde03.txt,10228,10228,T,F,6,54,F,F,,,,,0.0,0,F,F,F,Key
24923,b40503ed,GitHub,2ba83c6a,data/2ba83c6a/test/b40503ed.txt,193,193,F,F,-1,-1,F,F,,,,,0.0,0,F,F,F,Key
24923,b40503ed,GitHub,2ba83c6a,data/2ba83c6a/test/b40503ed.txt,193,193,F,F,6,15,F,F,,,,,0.0,0,F,F,F,Key
24926,f887f7cf,GitHub,2ba83c6a,data/2ba83c6a/test/f887f7cf.txt,33,33,F,F,-1,-1,F,F,,,,,0.0,0,F,F,F,Key
24927,f887f7cf,GitHub,2ba83c6a,data/2ba83c6a/test/f887f7cf.txt,40,40,F,F,-1,-1,F,F,,,,,0.0,0,F,F,F,Key
24928,f887f7cf,GitHub,2ba83c6a,data/2ba83c6a/test/f887f7cf.txt,17,17,F,F,-1,-1,F,F,,,,,0.0,0,F,F,F,Key
Expand Down
30 changes: 15 additions & 15 deletions meta/4764adaf.csv
Original file line number Diff line number Diff line change
Expand Up @@ -190,25 +190,25 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
34393,7daff6a3,GitHub,4764adaf,data/4764adaf/test/7daff6a3.js,829,829,T,T,19,29,F,F,Any,,,Secret,3.12,10,F,F,F,Password
34886,6c4ac771,GitHub,4764adaf,data/4764adaf/test/6c4ac771.js,56,56,T,F,16,28,T,F,,,,,0.0,0,F,F,F,Token
35022,f07c4281,GitHub,4764adaf,data/4764adaf/src/f07c4281.json,33,33,T,T,17,30,F,F,Any,,,Secret,2.9,13,F,F,F,Password
36228,b37ca27a,GitHub,4764adaf,data/4764adaf/test/b37ca27a.js,631,631,Template,T,25,33,F,F,CharsOnly,,,Secret,2.5,8,F,F,F,Password
36239,b37ca27a,GitHub,4764adaf,data/4764adaf/test/b37ca27a.js,499,499,Template,T,29,40,F,F,CharsOnly,,,Secret,2.91,11,F,F,F,Password
36339,b37ca27a,GitHub,4764adaf,data/4764adaf/test/b37ca27a.js,472,472,Template,T,25,39,F,F,Any,,,Secret,2.56,14,F,F,F,Password
36228,b37ca27a,GitHub,4764adaf,data/4764adaf/test/b37ca27a.js,631,631,T,T,25,33,F,F,CharsOnly,,,Secret,2.5,8,F,F,F,Password
36239,b37ca27a,GitHub,4764adaf,data/4764adaf/test/b37ca27a.js,499,499,T,T,29,40,F,F,CharsOnly,,,Secret,2.91,11,F,F,F,Password
36339,b37ca27a,GitHub,4764adaf,data/4764adaf/test/b37ca27a.js,472,472,T,T,25,39,F,F,Any,,,Secret,2.56,14,F,F,F,Password
36444,e45b2ef1,GitHub,4764adaf,data/4764adaf/test/e45b2ef1.js,661,661,T,T,30,37,F,F,Any,,,Secret,2.81,7,F,F,F,Password
37129,c907da53,GitHub,4764adaf,data/4764adaf/test/c907da53.js,124,124,Template,T,17,25,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
37130,52c4868e,GitHub,4764adaf,data/4764adaf/test/52c4868e.js,2246,2246,Template,T,27,35,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
37131,52c4868e,GitHub,4764adaf,data/4764adaf/test/52c4868e.js,2289,2289,Template,T,25,33,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
37132,52c4868e,GitHub,4764adaf,data/4764adaf/test/52c4868e.js,2485,2485,Template,T,23,31,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
37133,52c4868e,GitHub,4764adaf,data/4764adaf/test/52c4868e.js,2540,2540,Template,T,23,31,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
37129,c907da53,GitHub,4764adaf,data/4764adaf/test/c907da53.js,124,124,T,T,17,25,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
37130,52c4868e,GitHub,4764adaf,data/4764adaf/test/52c4868e.js,2246,2246,T,T,27,35,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
37131,52c4868e,GitHub,4764adaf,data/4764adaf/test/52c4868e.js,2289,2289,T,T,25,33,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
37132,52c4868e,GitHub,4764adaf,data/4764adaf/test/52c4868e.js,2485,2485,T,T,23,31,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
37133,52c4868e,GitHub,4764adaf,data/4764adaf/test/52c4868e.js,2540,2540,T,T,23,31,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
37161,7daff6a3,GitHub,4764adaf,data/4764adaf/test/7daff6a3.js,885,885,T,T,19,30,F,F,Any,,,Secret,3.03,11,F,F,F,Password
37162,7daff6a3,GitHub,4764adaf,data/4764adaf/test/7daff6a3.js,870,870,T,T,19,29,F,F,Any,,,Secret,3.12,10,F,F,F,Password
37628,b37ca27a,GitHub,4764adaf,data/4764adaf/test/b37ca27a.js,651,651,Template,T,25,33,F,F,CharsOnly,,,Secret,2.5,8,F,F,F,Password
37647,b37ca27a,GitHub,4764adaf,data/4764adaf/test/b37ca27a.js,561,561,Template,T,29,40,F,F,CharsOnly,,,Secret,2.91,11,F,F,F,Password
46524,7e37e5b4,GitHub,4764adaf,data/4764adaf/test/7e37e5b4.js,6855,6855,Template,T,29,37,F,F,CharsOnly,,,Unknown,2.75,8,F,F,F,Password
46747,52c4868e,GitHub,4764adaf,data/4764adaf/test/52c4868e.js,818,818,Template,T,27,37,F,F,Any,,,Secret,3.12,10,F,F,F,Password
46788,b37ca27a,GitHub,4764adaf,data/4764adaf/test/b37ca27a.js,786,786,Template,T,27,39,F,F,Any,,,Secret,2.79,12,F,F,F,Password
37628,b37ca27a,GitHub,4764adaf,data/4764adaf/test/b37ca27a.js,651,651,T,T,25,33,F,F,CharsOnly,,,Secret,2.5,8,F,F,F,Password
37647,b37ca27a,GitHub,4764adaf,data/4764adaf/test/b37ca27a.js,561,561,T,T,29,40,F,F,CharsOnly,,,Secret,2.91,11,F,F,F,Password
46524,7e37e5b4,GitHub,4764adaf,data/4764adaf/test/7e37e5b4.js,6855,6855,T,T,29,37,F,F,CharsOnly,,,Unknown,2.75,8,F,F,F,Password
46747,52c4868e,GitHub,4764adaf,data/4764adaf/test/52c4868e.js,818,818,T,T,27,37,F,F,Any,,,Secret,3.12,10,F,F,F,Password
46788,b37ca27a,GitHub,4764adaf,data/4764adaf/test/b37ca27a.js,786,786,T,T,27,39,F,F,Any,,,Secret,2.79,12,F,F,F,Password
47085,a7d5a18a,GitHub,4764adaf,data/4764adaf/test/a7d5a18a.js,3221,3221,F,F,,,F,F,,,,,0,0,F,F,F,API
47125,7daff6a3,GitHub,4764adaf,data/4764adaf/test/7daff6a3.js,815,815,Template,T,23,31,F,F,CharsOnly,,,Unknown,2.75,8,F,F,F,Password
47204,a7d5a18a,GitHub,4764adaf,data/4764adaf/test/a7d5a18a.js,1403,1403,Template,T,21,29,F,F,CharsOnly,,,Unknown,2.75,8,F,F,F,Password
47125,7daff6a3,GitHub,4764adaf,data/4764adaf/test/7daff6a3.js,815,815,T,T,23,31,F,F,CharsOnly,,,Unknown,2.75,8,F,F,F,Password
47204,a7d5a18a,GitHub,4764adaf,data/4764adaf/test/a7d5a18a.js,1403,1403,T,T,21,29,F,F,CharsOnly,,,Unknown,2.75,8,F,F,F,Password
47571,c907da53,GitHub,4764adaf,data/4764adaf/test/c907da53.js,230,230,Template,T,19,26,F,F,Any,,,Secret,2.52,7,F,F,F,Password
47572,c907da53,GitHub,4764adaf,data/4764adaf/test/c907da53.js,212,212,Template,T,19,26,F,F,Any,,,Secret,2.52,7,F,F,F,Password
47573,c907da53,GitHub,4764adaf,data/4764adaf/test/c907da53.js,221,221,Template,T,19,26,F,F,Any,,,Secret,2.52,7,F,F,F,Password
Expand Down
2 changes: 1 addition & 1 deletion meta/50b38ef0.csv
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
46799,8b39bea1,GitHub,50b38ef0,data/50b38ef0/test/8b39bea1.js,189,189,Template,F,23,29,F,F,Any,,,Secret,2.58,6,F,F,F,Secret
48127,30b47f0b,GitHub,50b38ef0,data/50b38ef0/other/30b47f0b.md,251,251,F,F,-1,-1,F,F,,,,,0.0,0,F,F,F,Other
50398,bb7f2b59,GitHub,50b38ef0,data/50b38ef0/other/bb7f2b59.md,52,52,Template,T,19,27,T,F,CharsOnly,,,Secret,2.75,8,F,F,F,URL Credentials
57866,cc148162,GitHub,50b38ef0,data/50b38ef0/other/cc148162.md,69,69,F,F,,,F,F,,,,,0,0,F,F,F,Password
57866,cc148162,GitHub,50b38ef0,data/50b38ef0/other/cc148162.md,69,69,T,F,15,25,F,F,,,,,0,0,F,F,F,Password
74675,09276c69,GitHub,50b38ef0,data/50b38ef0/test/09276c69.js,85,85,Template,T,23,29,F,F,CharsOnly,,,Unknown,2.25,6,F,F,F,Password
74676,09276c69,GitHub,50b38ef0,data/50b38ef0/test/09276c69.js,169,169,Template,T,23,29,F,F,CharsOnly,,,Unknown,2.25,6,F,F,F,Password
74746,cc148162,GitHub,50b38ef0,data/50b38ef0/other/cc148162.md,57,57,T,T,13,23,F,F,CharsOnly,,,Secret,2.65,10,F,F,F,Password
Expand Down
2 changes: 1 addition & 1 deletion meta/784d78e8.csv
Original file line number Diff line number Diff line change
Expand Up @@ -89,7 +89,7 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
26369,f5ee60af,GitHub,784d78e8,data/784d78e8/src/f5ee60af.txt,18,18,F,F,,,F,F,,,,,0,0,F,F,F,Password
27182,6b896691,GitHub,784d78e8,data/784d78e8/src/6b896691.j2,7,7,F,F,,,F,F,,,,,0,0,F,F,F,Password
29404,13210d77,GitHub,784d78e8,data/784d78e8/src/13210d77.cfg,525,525,Template,T,7,15,F,F,Any,,,Token,2.62,8,F,F,F,Token
29481,1420d33a,GitHub,784d78e8,data/784d78e8/other/1420d33a.md,110,110,T,F,11,35,F,F,CharsOnly,,JSON Web Token,Token,1.92,24,F,F,F,Token
29481,1420d33a,GitHub,784d78e8,data/784d78e8/other/1420d33a.md,110,110,F,F,11,35,F,F,CharsOnly,,,Token,1.92,24,F,F,F,Token
29580,6c7156cb,GitHub,784d78e8,data/784d78e8/test/6c7156cb.yaml,7,7,Template,F,27,36,F,F,Any,,,Secret,0.0,9,F,F,F,Password
29909,dca0818e,GitHub,784d78e8,data/784d78e8/other/dca0818e.md,28,28,T,T,12,20,F,F,Any,,,Secret,2.38,8,F,F,F,Password
30638,25820bb5,GitHub,784d78e8,data/784d78e8/src/25820bb5.j2,42,42,T,T,17,27,F,F,Any,,,Secret,2.99,10,F,F,F,Password
Expand Down
2 changes: 1 addition & 1 deletion meta/7f0408de.csv
Original file line number Diff line number Diff line change
Expand Up @@ -84,7 +84,7 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
35473,e15fd91c,GitHub,7f0408de,data/7f0408de/other/e15fd91c.md,149,149,T,F,23,28,F,F,CharsOnly,,,Secret,2.32,5,F,F,F,Password
35474,57f97bec,GitHub,7f0408de,data/7f0408de/src/57f97bec.yml,60,60,T,F,25,30,F,F,CharsOnly,,,Secret,2.32,5,F,F,F,Password
35539,aea989ce,GitHub,7f0408de,data/7f0408de/other/aea989ce.md,303,303,F,F,63,69,F,F,NumbersOnly,,,Token,1.58,6,F,F,F,Token
36072,f8a3143f,GitHub,7f0408de,data/7f0408de/src/f8a3143f.yml,5,5,Template,T,16,26,F,F,CharsOnly,,,Secret,2.32,10,F,F,F,Password
36072,f8a3143f,GitHub,7f0408de,data/7f0408de/src/f8a3143f.yml,5,5,T,T,16,26,F,F,CharsOnly,,,Secret,2.32,10,F,F,F,Password
36431,a1e61a3f,GitHub,7f0408de,data/7f0408de/other/a1e61a3f.md,284,284,F,F,104,168,F,F,,,,,0.0,0,F,F,F,Certificate:Token
36704,b70ca451,GitHub,7f0408de,data/7f0408de/other/b70ca451.md,272,272,Template,T,81,85,F,F,CharsOnly,,,Secret,1.5,4,F,F,F,Password
37453,e15fd91c,GitHub,7f0408de,data/7f0408de/other/e15fd91c.md,139,139,T,F,29,34,F,F,CharsOnly,,,Secret,2.32,5,F,F,F,Password
Expand Down
2 changes: 1 addition & 1 deletion meta/9ccb72ee.csv
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
131184,3e7b3bfa,GitHub,9ccb72ee,data/9ccb72ee/src/3e7b3bfa.rb,613,613,F,F,,,F,F,,,,,0.00,,F,F,F,Password
131185,3e7b3bfa,GitHub,9ccb72ee,data/9ccb72ee/src/3e7b3bfa.rb,615,615,F,F,,,F,F,,,,,0.00,,F,F,F,Password
134221,3b57f191,GitHub,9ccb72ee,data/9ccb72ee/src/3b57f191.rb,928,928,F,F,,,F,F,,,,,0,0,F,F,F,Certificate
134222,3b57f191,GitHub,9ccb72ee,data/9ccb72ee/src/3b57f191.rb,959,959,F,F,-1,-1,F,F,,,,,0.0,0,F,F,F,Key
134222,3b57f191,GitHub,9ccb72ee,data/9ccb72ee/src/3b57f191.rb,959,959,T,F,34,45,F,F,,,,,0.0,0,F,F,F,Key
1138004,b3356305,GitHub,9ccb72ee,data/9ccb72ee/other/b3356305.md,784,784,T,F,73,94,F,F,,,,,0.0,0,F,F,F,Auth
1138005,b3356305,GitHub,9ccb72ee,data/9ccb72ee/other/b3356305.md,787,787,T,F,106,127,F,F,,,,,0.0,0,F,F,F,Auth
1138006,b3356305,GitHub,9ccb72ee,data/9ccb72ee/other/b3356305.md,790,790,T,F,76,97,F,F,,,,,0.0,0,F,F,F,Auth
Expand Down
Loading
Loading