maix0 c284eb3786 update: commented the python code so it is more readable		2024-09-26 17:50:57 +02:00
..
.gitignore	update: added python version of the tokenizer	2024-09-26 16:51:01 +02:00
app.py	update: commented the python code so it is more readable	2024-09-26 17:50:57 +02:00
concat.py	update: commented the python code so it is more readable	2024-09-26 17:50:57 +02:00
flake.lock	update: added python version of the tokenizer	2024-09-26 16:51:01 +02:00
flake.nix	update: added python version of the tokenizer	2024-09-26 16:51:01 +02:00
str_to_token.py	update: commented the python code so it is more readable	2024-09-26 17:50:57 +02:00
ttoken.py	update: pushed more readable tokens	2024-09-26 17:37:57 +02:00