Code

Configure Renovate#1

Code

Closed

renovate[bot] wants to merge 213 commits intomainbrave-experiments/MELT-public:mainfrom renovate/configurebrave-experiments/MELT-public:renovate/configureCopy head branch name to clipboard

+6

Commits

Commits on Sep 29, 2023

• Initial commit

  stevelaskaridis

  committed
  9ea3603

• Add frameworks as submodules

  stevelaskaridis

  committed
  fa7e064

• Add HF model downloader

  stevelaskaridis

  committed
  18115c2

• Add model converter/quantizer

  stevelaskaridis

  committed
  4fdf5b5

• Add README

  stevelaskaridis

  committed
  554ff2f

• Merge pull request #11 from brave-experiments/dev/model_automation

  Show description for 1fb61b9
  stevelaskaridis

  authored
  1fb61b9

Commits on Oct 5, 2023

• Update MLC submodules

  stevelaskaridis

  committed
  c13380b

• Merge pull request #15 from brave-experiments/dev/mlc-submodule-update

  Show description for 60b7163
  stevelaskaridis

  authored
  60b7163

Commits on Oct 6, 2023

• llama.cpp submodule to custom version

  stevelaskaridis

  committed
  12be6d6

• Merge pull request #16 from brave-experiments/dev/llamacpp-submodule-update

  Show description for 6b102d6
  stevelaskaridis

  authored
  6b102d6

Commits on Oct 18, 2023

• Move parsers to MELT

  stevelaskaridis

  committed
  879d211

• Add llama.cpp support for parsers

  stevelaskaridis

  committed
  b30a85b

• Add dummy files for testing

  stevelaskaridis

  committed
  6fe3c8d

• Merge pull request #18 from brave-experiments/dev/parsers

  Show description for 39ae6b1
  stevelaskaridis

  authored
  39ae6b1

Commits on Oct 19, 2023

• Add batterylab module

  stevelaskaridis

  committed
  54ea08a

• Custom internal llama.cpp module

  stevelaskaridis

  committed
  d55b3cd

• Update llama.cpp

  stevelaskaridis

  committed
  dba7ae1

Commits on Nov 2, 2023

• Update llama.cpp submodule

  stevelaskaridis

  committed
  f97bd48

• Update batterylab submodule

  stevelaskaridis

  committed
  2925ae2

• Update llama.cpp submodule

  stevelaskaridis

  committed
  31bef4e

Commits on Nov 3, 2023

• Update submodules

  stevelaskaridis

  committed
  cda8a28

Commits on Nov 18, 2023

• Switch from LLMFarm to LLMFarmEval

  stevelaskaridis

  committed
  81e51f2

Commits on Nov 19, 2023

• Add perf report scripts

  Show description for 098f4a3
  

  stevelaskaridis

  and

  minoskt

  committed
  098f4a3

• Address most comments from @stevelaskaridis

  

  minoskt

  authored and

  stevelaskaridis

  committed
  894d5d9

• Remove dependency to static list of power_events

  

  minoskt

  authored and

  stevelaskaridis

  committed
  a5d5370

• Remove dependency to event_driver

  minoskt

  committed
  57370b7

• Merge pull request #29 from brave-experiments/performance_report

  Show description for 1f20cdf
  stevelaskaridis

  authored
  1f20cdf

Commits on Nov 22, 2023

• Convert models that disregard token length

  stevelaskaridis

  committed
  2247b8f

• Merge pull request #35 from brave-experiments/dev/fixed_token_length

  Show description for c1156b2
  stevelaskaridis

  authored
  c1156b2

• Update submodules

  stevelaskaridis

  committed
  2c02ac6

Commits on Nov 23, 2023

• Better fn naming

  stevelaskaridis

  committed
  ced6205

• Add model hyperparams configuration for MLC

  stevelaskaridis

  committed
  5ffc889

• Remove model batched execution

  stevelaskaridis

  committed
  adb6c47

• Add support for llama hyperparam config extraction

  stevelaskaridis

  committed
  8c2b5a1

• Housekeeping

  stevelaskaridis

  committed
  710af79

• Fix empty str arg on subprocess

  stevelaskaridis

  committed
  a25d337

• Add prompt for llama.cpp

  stevelaskaridis

  committed
  9dbaba6

Commits on Nov 24, 2023

• Print command to be run

  stevelaskaridis

  committed
  ebb6f40

• Fix multiple dots in name

  stevelaskaridis

  committed
  925ce9f

• Add configs for models of interest

  stevelaskaridis

  committed
  ca8689e

• Add URLs to model configs

  stevelaskaridis

  committed
  5997a1e

• Merge pull request #36 from brave-experiments/dev/hyperparams

  Show description for 853c002
  stevelaskaridis

  authored
  853c002

• Minor fixes

  stevelaskaridis

  committed
  665a51c

• Merge pull request #38 from brave-experiments/dev/minor-config-fixes

  Show description for f500f09
  stevelaskaridis

  authored
  f500f09

• Add oasst-based conversation dataset

  LorenzoMinto

  committed
  125d388

• Add llama.cpp conversion for starcoder

  stevelaskaridis

  committed
  ac5c2d7

• Ignore empty valued params

  stevelaskaridis

  committed
  1896067

• Add starcoder config

  stevelaskaridis

  committed
  b34a49f

• Update llama.cpp submodule

  stevelaskaridis

  committed
  a812b99

• Merge pull request #41 from brave-experiments/dev/starcoder-support

  Show description for dd972fc
  stevelaskaridis

  authored
  dd972fc

Commits on Nov 27, 2023

• Minor org changes

  stevelaskaridis

  committed
  d76908d

• Merge pull request #40 from brave-experiments/conv-prompts

  Show description for 4db9756
  stevelaskaridis

  authored
  4db9756

• Add code conversations prompts

  LorenzoMinto

  committed
  d1d5908

Commits on Nov 29, 2023

• Update batterylab submodule

  stevelaskaridis

  committed
  26b7d65

• Update MLC submodules

  stevelaskaridis

  committed
  942d05c

• Add seed and length limit

  stevelaskaridis

  committed
  2df203f

• Merge pull request #43 from brave-experiments/starcoder-prompts

  Show description for 14e92e6
  stevelaskaridis

  authored
  14e92e6

Commits on Nov 30, 2023

• Refinements for starcoder on llama.cpp

  stevelaskaridis

  committed
  49d50c7

• Add support for TinyLlama on MLC

  stevelaskaridis

  committed
  2d8b6c7

• Add support for TinyLlama on llama.cpp

  stevelaskaridis

  committed
  12300b4

• Add config for tinyllama

  stevelaskaridis

  committed
  c87c19c

Commits on Dec 1, 2023

• Add tinyllama v0.5

  stevelaskaridis

  committed
  2eea712

• Update submodules

  stevelaskaridis

  committed
  5dc1be1

• Change handling of ingore_eos on llama.cpp

  stevelaskaridis

  committed
  c8f1ac4

• Fix prompt for new version of llama.cpp

  stevelaskaridis

  committed
  505720c

• Remove tinyllama v0.6

  stevelaskaridis

  committed
  334dee7

• Merge pull request #46 from brave-experiments/dev/tinyllama_support

  Show description for 70d587e
  stevelaskaridis

  authored
  70d587e

• Update mlc submodule

  stevelaskaridis

  committed
  c4e457f

Commits on Dec 15, 2023

• Update MLC submodule

  stevelaskaridis

  committed
  dc24037

• Update submodules

  stevelaskaridis

  committed
  4f86cb5

Commits on Dec 18, 2023

• Define conv_template from yaml

  stevelaskaridis

  committed
  4b3b7f7

• Download if inexistent

  stevelaskaridis

  committed
  43223bf

• Add config for zephyr-3b

  stevelaskaridis

  committed
  1cafde1

• Update mlc submodule

  stevelaskaridis

  committed
  8979b9b

• Merge pull request #49 from brave-experiments/dev/zephyr-3b

  Show description for 0ab51d5
  stevelaskaridis

  authored
  0ab51d5

Commits on Dec 19, 2023

• Add conversion script for awq models

  stevelaskaridis

  committed
  979c321

• Make config arg optional for awq

  stevelaskaridis

  committed
  e48fd59

Commits on Dec 22, 2023

• Merge pull request #50 from brave-experiments/dev/awq_convert

  Show description for 38216f1
  stevelaskaridis

  authored
  38216f1

• Add expect scripts

  

  minoskt

  authored and

  stevelaskaridis

  committed
  82f88fc

• Change hard-coded path of llama.cpp

  stevelaskaridis

  committed
  c0f35aa

• Fix issue with prompt string expectation

  stevelaskaridis

  committed
  5860f52

• Mirror changes to android

  stevelaskaridis

  committed
  cce5196

• Fix model name and args translation for tinyllama

  stevelaskaridis

  committed
  ea38aee

• Move scripts to framework

  stevelaskaridis

  committed
  0b78005

• Merge pull request #51 from brave-experiments/dev/add-expect-scripts

  Show description for b2129a7
  stevelaskaridis

  authored
  b2129a7

Commits on Jan 5, 2024

• Convert yaml to json config for llmfarm

  stevelaskaridis

  committed
  50d5b63

• Reuse previous converted weights

  stevelaskaridis

  committed
  70df5e9

• Add fallback for model config path

  stevelaskaridis

  committed
  32c3554

• Fix ios arg for mlc conversion

  stevelaskaridis

  committed
  2035eaf

• Add convert-all script

  stevelaskaridis

  committed
  016acf6

• Update llama.cpp submodule

  stevelaskaridis

  committed
  2be69cd

• Merge pull request #55 from brave-experiments/dev/automate_model_conversion

  Show description for 225f93b
  stevelaskaridis

  authored
  225f93b

Commits on Jan 8, 2024

• Use TRANSFORMERS_CACHE when downloading models

  stevelaskaridis

  committed
  87e095c

Commits on Jan 9, 2024

• Update MLC submodules

  stevelaskaridis

  committed
  4563f04

Commits on Jan 10, 2024

• Add support for converting to cuda

  stevelaskaridis

  committed
  24662ad

• Additional args if CUDA backend

  stevelaskaridis

  committed
  614f7c5

• Update mlc-submodule

  stevelaskaridis

  committed
  e0e8d61

• Merge pull request #56 from brave-experiments/dev/cuda_conversions

  Show description for 7eaaebb
  stevelaskaridis

  authored
  7eaaebb

• Add GPTQ/AWQ models download script

  stevelaskaridis

  committed
  4410ccc

• Add evaluation scripts

  stevelaskaridis

  committed
  a42b394

• Add run instructions

  stevelaskaridis

  committed
  cfcab90

• Add mistral 0.1 model

  stevelaskaridis

  committed
  c73062d

• Merge pull request #60 from brave-experiments/dev/gptq_awq

  Show description for 16da69a
  stevelaskaridis

  authored
  16da69a

• Fix zephyr q0 conversion

  stevelaskaridis

  committed
  1241aae

• Remove max_window_size from mistral config

  stevelaskaridis

  committed
  8f73689

• Merge pull request #62 from brave-experiments/bug-fixes

  Show description for 2a8a712
  stevelaskaridis

  authored
  2a8a712

Commits on Jan 11, 2024

• Refinements

  stevelaskaridis

  committed
  f312a7e

• Add script to download all models

  stevelaskaridis

  committed
  6351016

Commits on Jan 18, 2024

• Update submodules

  stevelaskaridis

  committed
  65dac2e

• Update scripts

  stevelaskaridis

  committed
  c4f9919

Commits on Jan 19, 2024

• Change zephyr's conversion from download

  stevelaskaridis

  committed
  6d6d51d

• Merge pull request #65 from brave-experiments/dev/extra-evals

  Show description for 9f2efbc
  stevelaskaridis

  authored
  9f2efbc

Commits on Feb 2, 2024

• Update submodules

  stevelaskaridis

  committed
  bdc93d8

Commits on Feb 5, 2024

• Remove lowercase from model-name

  stevelaskaridis

  committed
  2777035

Commits on Feb 6, 2024

• Update submodules

  stevelaskaridis

  committed
  8971216

Commits on Feb 8, 2024

• Add analysis for prompts

  stevelaskaridis

  committed
  b7a63e9

• Merge pull request #74 from brave-experiments/exp/prompt_stats

  Show description for 356cb34
  stevelaskaridis

  authored
  356cb34

Commits on Feb 9, 2024

• Add results and figures

  LorenzoMinto

  committed
  0bce0bb

• Update dataset results

  LorenzoMinto

  committed
  1e07c4a

• Figure changes for paper

  stevelaskaridis

  committed
  923941c

• Fix framework provenance

  LorenzoMinto

  committed
  56612b2

• Change visualisations for paper

  stevelaskaridis

  committed
  0a8c77e

• Extract tables in latex

  stevelaskaridis

  committed
  c609b18

• Restructure model evaluation

  stevelaskaridis

  committed
  6a7c420

• Merge pull request #75 from brave-experiments/eval-results

  Show description for eec6781
  stevelaskaridis

  authored
  eec6781

Commits on Feb 10, 2024

• Missing property in mistral yaml

  stevelaskaridis

  committed
  5c65f0a

• Add all quants in conversion script

  stevelaskaridis

  committed
  af7f153

• Add flag for generating only config in llama.cpp

  stevelaskaridis

  committed
  3bc99f5

• Merge pull request #81 from brave-experiments/dev/fix-mistral

  Show description for 5d636df
  stevelaskaridis

  authored
  5d636df

Commits on Feb 14, 2024

• Add jetsonlab submodule

  stevelaskaridis

  committed
  4440e3b

Commits on Feb 17, 2024

• Update mistral template

  stevelaskaridis

  committed
  319d480

Commits on Feb 23, 2024

• Update with arc challenge results

  LorenzoMinto

  committed
  01ec48c

Commits on Feb 24, 2024

• Add support for llamacpp data

  minoskt

  committed
  2e3e1bc

Commits on Feb 25, 2024

• Update report_performance.py

  minoskt

  committed
  897a419

• Report mlc-stats correctly

  minoskt

  committed
  2f2f590

• Fix for supporting different models

  minoskt

  committed
  154189f

Commits on Feb 28, 2024

• Parse in a sorted manner

  stevelaskaridis

  committed
  d339571

• Move script to jetsonlab

  stevelaskaridis

  committed
  2f4aedd

• Merge pull request #84 from brave-experiments/dev/report-jetson-performance

  Show description for 3a6cde9
  stevelaskaridis

  authored
  3a6cde9

Commits on Mar 1, 2024

• New conversion scripts

  stevelaskaridis

  committed
  4af802c

• Add new config files

  stevelaskaridis

  committed
  8850c7e

• Add new models to download

  stevelaskaridis

  committed
  b36060e

• Fix for gemma llama conversion

  stevelaskaridis

  committed
  9d86b8a

Commits on Mar 3, 2024

• Allow extra args to propagate to mlc building

  stevelaskaridis

  committed
  5a25e8b

• Escape prompts for gemma llama.cpp

  stevelaskaridis

  committed
  9d8d707

• Update empty prompt

  stevelaskaridis

  committed
  5718ef5

• Evaluate llamacpp models script

  stevelaskaridis

  committed
  6ab0f25

• Add script for evaluating HF models

  stevelaskaridis

  committed
  6f48e4f

• Add support for converting pretrained gemma models

  stevelaskaridis

  committed
  64d47e6

Commits on Mar 4, 2024

• Add script for replacing symlinked models

  stevelaskaridis

  committed
  c8e3ac3

Commits on Mar 11, 2024

• More configurable logcat getter script

  stevelaskaridis

  committed
  36fcf02

• Merge split log lines for json parsing

  stevelaskaridis

  committed
  a0e43d1

Commits on Mar 19, 2024

• Update with final results

  LorenzoMinto

  committed
  dc26872

Commits on Jun 7, 2024

• Remove phi-2 from converstion script (didn't work)

  stevelaskaridis

  committed
  9921cd5

• Remove unused config

  stevelaskaridis

  committed
  d044e1e

• Change mlc logs parsing

  stevelaskaridis

  committed
  5175b97

• Edit logcat getter for robustness

  stevelaskaridis

  committed
  b0f9b6f

• Uncomment q4_0 quant

  stevelaskaridis

  committed
  5fe9325

• Add per op analysis in notebook

  stevelaskaridis

  committed
  a8a475d

• Add script for logcat logging

  stevelaskaridis

  committed
  190d870

• Add input for sustained throughput exp

  stevelaskaridis

  committed
  e2b9b61

• Merge pull request #86 from brave-experiments/dev/per_op_parsing

  Show description for 9ad6899
  stevelaskaridis

  authored
  9ad6899

• Merge pull request #92 from brave-experiments/dev/new_models

  Show description for 8f14e1c
  stevelaskaridis

  authored
  8f14e1c

• Update evaluations notebook

  stevelaskaridis

  committed
  5cac9f3

• Remove figures from repo

  stevelaskaridis

  committed
  2785474

• Merge branch 'eval-results'

  stevelaskaridis

  committed
  900b5db

• Update models to download from HF

  stevelaskaridis

  committed
  5fd4ec6

• Update README.md

  stevelaskaridis

  committed
  c2eefda

• Update gitignore to disregard model dirs

  stevelaskaridis

  committed
  7234d16

• Update notebook

  stevelaskaridis

  committed
  2d0c533

• Edit and document configs

  stevelaskaridis

  committed
  b8c744f

• Clean up evaluation scripts

  stevelaskaridis

  committed
  00a3f4a

• Add README and gitignore

  stevelaskaridis

  committed
  e1bcf75

• Update notebooks

  stevelaskaridis

  committed
  19cbfd4

• Add README

  stevelaskaridis

  committed
  732e0b6

Commits on Jun 10, 2024

• Update parser utils functions

  stevelaskaridis

  committed
  6d2619b

• Update documentation

  stevelaskaridis

  committed
  4ab7795

• Remove unused script

  stevelaskaridis

  committed
  6eb764c

• Add per op plotting notebook

  stevelaskaridis

  committed
  4b8f0f7

• Clean up conversion scripts

  stevelaskaridis

  committed
  0ba4abf

• Organise model download/conversion scripts

  stevelaskaridis

  committed
  812f45f

• Update documentation

  stevelaskaridis

  committed
  7fdca99

Commits on Jun 21, 2024

• Create LICENSE

  stevelaskaridis

  authored
  a2f7442

• Clean up notebooks

  stevelaskaridis

  committed
  e754879

• Add requirements file and update README

  stevelaskaridis

  committed
  9934de4

• Fix conversion scripts

  stevelaskaridis

  committed
  79d3e81

Commits on Jun 24, 2024

• Fix prompt notebooks directories

  stevelaskaridis

  committed
  9907a1b

• Add requirements explicitly

  stevelaskaridis

  committed
  45f6807

• Update requirements and README how-to-run

  stevelaskaridis

  committed
  aa1ffbd

• Add llama-cpp requirements

  stevelaskaridis

  committed
  ec0bc2a

• Update model root dirs

  stevelaskaridis

  committed
  8127f0a

• Cleanup accuracy eval notebook

  stevelaskaridis

  committed
  4ff4590

Commits on Jun 25, 2024

• Update conversion scripts models

  stevelaskaridis

  committed
  26837ea

Commits on Jun 27, 2024

• Fix typo

  minoskt

  committed
  05a1517

• Fix typo

  minoskt

  committed
  6117bd8

Commits on Jul 9, 2024

• Adopt consistent config naming

  stevelaskaridis

  committed
  d587b60

• Fix config names in new conversion pipeline

  stevelaskaridis

  committed
  a634ece

Commits on Jul 10, 2024

• Change converted model path

  stevelaskaridis

  committed
  76ab3d6

• Update top-level documentation

  stevelaskaridis

  committed
  0cb8074

• Pass through black,isort,autopep8

  stevelaskaridis

  committed
  0460953

• Update submodules

  stevelaskaridis

  committed
  78f50e8

• Merge pull request #94 from brave-experiments/dev/housekeeping

  Show description for 1ed92ae
  stevelaskaridis

  authored
  1ed92ae

Commits on Jul 19, 2024

• Update submodules

  stevelaskaridis

  committed
  5b76f78

• Update README

  stevelaskaridis

  committed
  f772677

• Change submodule target

  stevelaskaridis

  committed
  79fdca0

• Update submodules

  stevelaskaridis

  committed
  672c544

• Merge pull request #103 from brave-experiments/dev/rename

  Show description for 9563647
  stevelaskaridis

  authored
  9563647

• Modify LICENSE

  stevelaskaridis

  committed
  fba8212

• Update submodules

  stevelaskaridis

  committed
  94f1581

• Update public submodules

  stevelaskaridis

  committed
  7e9bf8c

• Update submodule repos

  stevelaskaridis

  committed
  9b17383

• Update README links

  stevelaskaridis

  committed
  454e791

• Add renovate.json

  renovate[bot]

  authored
  d3f3d84