{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":707349481,"defaultBranch":"main","name":"StockLLM","ownerLogin":"Thytu","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2023-10-19T17:59:54.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/43698357?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1702064182.0","currentOid":""},"activityList":{"items":[{"before":"41bb81433c813c8134f775d9d82228d38692465e","after":"db3b7e14ccbf75fe1497ceed1c02b6d3cbd773b0","ref":"refs/heads/feat/improve-dataset-pretraining","pushedAt":"2023-12-08T20:24:50.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"feat: draft improving dataset for pretraining\n\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"feat: draft improving dataset for pretraining"}},{"before":null,"after":"41bb81433c813c8134f775d9d82228d38692465e","ref":"refs/heads/feat/improve-dataset-pretraining","pushedAt":"2023-12-08T19:36:22.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"feat: training support both full training and lora\n\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"feat: training support both full training and lora"}},{"before":"3d104c7d5041a9af2402be7dec1b92af2d0a482d","after":"b98c5e8680d4ac7a7b31ea70e9627b39f0cce00b","ref":"refs/heads/main","pushedAt":"2023-12-08T10:46:56.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"doc: update roadmap on readme","shortMessageHtmlLink":"doc: update roadmap on readme"}},{"before":"e5aef5de5dc44d5bda6a9ce044ef2c55249566e0","after":null,"ref":"refs/heads/feat/training-v2","pushedAt":"2023-12-06T15:12:15.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"}},{"before":"0eaa42c568fea376269f84d5aecdc7ecaee91155","after":null,"ref":"refs/heads/feat/training-stages","pushedAt":"2023-12-06T15:12:03.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"}},{"before":"f3294b8bd34086e22cfcaa5a67809815b08f2989","after":"3d104c7d5041a9af2402be7dec1b92af2d0a482d","ref":"refs/heads/main","pushedAt":"2023-12-06T15:05:58.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"feat: training stages (#4)\n\n* feat: draft dvc stages data pre-pro\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: draft DVC steps\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: dvc stages\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* fix: get_random_data_samples now actually shuffle the dataset\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: store task id in row\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* fix: inccease max lenght to 4k\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* refactor: increase dataset size to 100k\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* chore: remove deprecated code\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* chore: remove deprecated code\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: draft of switching to parquet\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: draft of switching to parquet\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: switching to parquet\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* fix: train and test set no longer are inverted\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* refactor(generate_ready_to_use_dataset): keep only input_ids and labels\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* fix(train): no longer load train set twice\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* refactor(generate_ready_to_use_dataset): keep only input_ids for labels\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* refactor(generate_ready_to_use_dataset): force clear cache\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: draft training stages\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* fix(model): provides default params\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* refactor(train): exepct path_to_dataset\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* fix(dvc): stage generate-poc-dataset\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: draft training\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: draft training\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* build: add depencies to req.txt\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: draft training v2\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: draft training-v2 w/ causal\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* doc: usage section in readme\r\n\r\n* feat: new module merge_lora_to_model\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* chore: remove deprecated file\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* refactor: change runs by date only\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n---------\r\n\r\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"feat: training stages (#4)"}},{"before":"8c4c04d8fa5d6f6ea8478dfc967c8cfed9ecf099","after":"e5aef5de5dc44d5bda6a9ce044ef2c55249566e0","ref":"refs/heads/feat/training-v2","pushedAt":"2023-12-06T15:05:39.000Z","pushType":"push","commitsCount":6,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"fix: merge conflicts\n\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"fix: merge conflicts"}},{"before":"cd2e16a4d75b7349a7f7eab58aeb4cc536dbcbe2","after":"f3294b8bd34086e22cfcaa5a67809815b08f2989","ref":"refs/heads/main","pushedAt":"2023-12-06T14:57:03.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"doc: change logo to compressed version","shortMessageHtmlLink":"doc: change logo to compressed version"}},{"before":"b37975a425b09f345007847e3a1bdba8e16f1827","after":"8c4c04d8fa5d6f6ea8478dfc967c8cfed9ecf099","ref":"refs/heads/feat/training-v2","pushedAt":"2023-12-06T14:38:12.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"chore: remove deprecated file\n\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"chore: remove deprecated file"}},{"before":"429327fe92cfb9a06d3d42eaea95d2a353247e1c","after":"b37975a425b09f345007847e3a1bdba8e16f1827","ref":"refs/heads/feat/training-v2","pushedAt":"2023-12-06T14:31:07.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"Merge branch 'feat/training-v2' of github.com:Thytu/StockLLM into feat/training-v2","shortMessageHtmlLink":"Merge branch 'feat/training-v2' of github.com:Thytu/StockLLM into fea…"}},{"before":"0f933db96d0f81ab1d846b4eb84e7554338e4087","after":"429327fe92cfb9a06d3d42eaea95d2a353247e1c","ref":"refs/heads/feat/training-v2","pushedAt":"2023-12-06T10:13:23.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"doc: usage section in readme","shortMessageHtmlLink":"doc: usage section in readme"}},{"before":"a27e7e02118824bbb564e8cea6cf888bb49b30cf","after":"0f933db96d0f81ab1d846b4eb84e7554338e4087","ref":"refs/heads/feat/training-v2","pushedAt":"2023-12-06T09:41:59.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"feat: draft training-v2 w/ causal\n\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"feat: draft training-v2 w/ causal"}},{"before":null,"after":"a27e7e02118824bbb564e8cea6cf888bb49b30cf","ref":"refs/heads/feat/training-v2","pushedAt":"2023-12-04T10:41:22.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"feat: draft training v2\n\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"feat: draft training v2"}},{"before":"c4974ac3c9b23135918b4ceb6779ff0f821a502c","after":"0eaa42c568fea376269f84d5aecdc7ecaee91155","ref":"refs/heads/feat/training-stages","pushedAt":"2023-11-30T18:19:12.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"build: add depencies to req.txt\n\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"build: add depencies to req.txt"}},{"before":"ebde5e772a3535ce58c50dd6fb75fcb5c1f0963e","after":"c4974ac3c9b23135918b4ceb6779ff0f821a502c","ref":"refs/heads/feat/training-stages","pushedAt":"2023-11-30T18:18:18.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"feat: draft training\n\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"feat: draft training"}},{"before":"790720d70f04e3faccb993a41d5e1765a8541bab","after":"ebde5e772a3535ce58c50dd6fb75fcb5c1f0963e","ref":"refs/heads/feat/training-stages","pushedAt":"2023-11-30T10:05:55.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"feat: draft training\n\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"feat: draft training"}},{"before":"ada2d49a168aaf6957b452cbe0306437026805b8","after":"790720d70f04e3faccb993a41d5e1765a8541bab","ref":"refs/heads/feat/training-stages","pushedAt":"2023-11-29T20:18:54.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"fix(dvc): stage generate-poc-dataset\n\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"fix(dvc): stage generate-poc-dataset"}},{"before":null,"after":"ada2d49a168aaf6957b452cbe0306437026805b8","ref":"refs/heads/feat/training-stages","pushedAt":"2023-11-27T20:34:05.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"feat: draft training stages\n\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"feat: draft training stages"}},{"before":"6ae0a8fb6fe17e3b64854838678b6daae4f658ee","after":"cd2e16a4d75b7349a7f7eab58aeb4cc536dbcbe2","ref":"refs/heads/main","pushedAt":"2023-11-25T22:27:31.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"doc: link to ChessInstruct","shortMessageHtmlLink":"doc: link to ChessInstruct"}},{"before":"e7db91f51540fecd424cc8321c62b967696af1a4","after":"6ae0a8fb6fe17e3b64854838678b6daae4f658ee","ref":"refs/heads/main","pushedAt":"2023-11-25T22:05:37.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"doc: project presentation and general improvements","shortMessageHtmlLink":"doc: project presentation and general improvements"}},{"before":"890bdb3c76c7a77449ccf29300598fef65f49ac1","after":null,"ref":"refs/heads/feat/switch-to-parquet","pushedAt":"2023-11-25T21:40:23.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"}},{"before":"474ccc959459bd867f360b982a8170fe5433568e","after":"e7db91f51540fecd424cc8321c62b967696af1a4","ref":"refs/heads/main","pushedAt":"2023-11-25T21:40:20.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"feat: switch to parquet (#2)\n\n* feat: draft dvc stages data pre-pro\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: draft DVC steps\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: dvc stages\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* fix: get_random_data_samples now actually shuffle the dataset\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: store task id in row\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* fix: inccease max lenght to 4k\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* refactor: increase dataset size to 100k\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* chore: remove deprecated code\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* chore: remove deprecated code\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: draft of switching to parquet\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: draft of switching to parquet\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* feat: switching to parquet\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* fix: train and test set no longer are inverted\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* refactor(generate_ready_to_use_dataset): keep only input_ids and labels\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* fix(train): no longer load train set twice\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* refactor(generate_ready_to_use_dataset): keep only input_ids for labels\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n* refactor(generate_ready_to_use_dataset): force clear cache\r\n\r\nSigned-off-by: Valentin De Matos \r\n\r\n---------\r\n\r\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"feat: switch to parquet (#2)"}},{"before":"8913c0b47429f6ecc2aa441d1ec5b3f299b209be","after":"890bdb3c76c7a77449ccf29300598fef65f49ac1","ref":"refs/heads/feat/switch-to-parquet","pushedAt":"2023-11-25T21:40:08.000Z","pushType":"push","commitsCount":11,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"fix: merge conflict\n\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"fix: merge conflict"}},{"before":"9efb2eabddecd7b5ad3e8dbd23d76f17dcd6fb7c","after":"8913c0b47429f6ecc2aa441d1ec5b3f299b209be","ref":"refs/heads/feat/switch-to-parquet","pushedAt":"2023-11-25T20:57:50.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"refactor(generate_ready_to_use_dataset): force clear cache\n\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"refactor(generate_ready_to_use_dataset): force clear cache"}},{"before":"29cd489521b94a08906cecaef7e8a6b587ba83d9","after":"9efb2eabddecd7b5ad3e8dbd23d76f17dcd6fb7c","ref":"refs/heads/feat/switch-to-parquet","pushedAt":"2023-11-25T20:47:58.000Z","pushType":"push","commitsCount":4,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"refactor(generate_ready_to_use_dataset): keep only input_ids for labels\n\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"refactor(generate_ready_to_use_dataset): keep only input_ids for labels"}},{"before":"308e02db33c4e554ae2b3aaecfe9ac31bc8f4981","after":"29cd489521b94a08906cecaef7e8a6b587ba83d9","ref":"refs/heads/feat/switch-to-parquet","pushedAt":"2023-11-25T20:20:36.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"feat: switching to parquet\n\nSigned-off-by: Valentin De Matos ","shortMessageHtmlLink":"feat: switching to parquet"}},{"before":"13dbab514f236af23b7c7a8f19cb4d5db6f9b573","after":"474ccc959459bd867f360b982a8170fe5433568e","ref":"refs/heads/main","pushedAt":"2023-11-22T08:45:15.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"doc: RM for dataset","shortMessageHtmlLink":"doc: RM for dataset"}},{"before":"f24d82a9991a5f5e52cef51c6b02b70733e99cf3","after":"13dbab514f236af23b7c7a8f19cb4d5db6f9b573","ref":"refs/heads/main","pushedAt":"2023-11-21T17:28:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"doc: force refresh cache","shortMessageHtmlLink":"doc: force refresh cache"}},{"before":"9cbbfb6220d16b8b025039f72747f5395a115744","after":"f24d82a9991a5f5e52cef51c6b02b70733e99cf3","ref":"refs/heads/main","pushedAt":"2023-11-21T17:21:49.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"doc: fix LICENSE url","shortMessageHtmlLink":"doc: fix LICENSE url"}},{"before":"577b0aca696469f2f3cd1b4fd15d957bc22acf69","after":"9cbbfb6220d16b8b025039f72747f5395a115744","ref":"refs/heads/main","pushedAt":"2023-11-21T17:11:44.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Thytu","name":"Valentin De Matos","path":"/Thytu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/43698357?s=80&v=4"},"commit":{"message":"doc: sub-title","shortMessageHtmlLink":"doc: sub-title"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAADxavm_wA","startCursor":null,"endCursor":null}},"title":"Activity · Thytu/StockLLM"}