Skip to content

Commit

Permalink
syntax
Browse files Browse the repository at this point in the history
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
  • Loading branch information
kylesayrs committed Dec 20, 2024
1 parent 5b4ee22 commit bbe3eb6
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/llmcompressor/transformers/finetune/data/base.py
Original file line number Diff line number Diff line change
Expand Up @@ -240,7 +240,7 @@ def filter_processor_args(self, dataset: DatasetType) -> DatasetType:

column_names = get_columns(dataset)
return dataset.remove_columns(
list(set(column_names) - set(processor_kwargs)) - set([self.PROMPT_KEY])
list(set(column_names) - set(processor_kwargs) - set([self.PROMPT_KEY]))
)

def tokenize(self, data: LazyRow) -> Dict[str, Any]:
Expand Down

0 comments on commit bbe3eb6

Please sign in to comment.