Skip to content
This repository has been archived by the owner on Jul 30, 2024. It is now read-only.

Commit

Permalink
bug fix introduced in last commit
Browse files Browse the repository at this point in the history
  • Loading branch information
wasiahmad committed Mar 1, 2022
1 parent f1599d4 commit 9bf5e12
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion data/github/preprocessing/src/code_tokenizer.py
Original file line number Diff line number Diff line change
Expand Up @@ -225,7 +225,7 @@ def tokenize_python(code, keep_comments=False, process_strings=True):
return tokens[:-1]


def detokenize_code(self, code):
def detokenize_code(code):
# replace recreate lines with \n and appropriate indent / dedent
# removing indent/ dedent tokens
assert isinstance(code, str) or isinstance(code, list)
Expand Down

0 comments on commit 9bf5e12

Please sign in to comment.