Fix issue with setPadding and setTruncation overriding configurations…#2741

Merged

siddvenk merged 1 commit intodeepjavalibrary:masterfrom siddvenk:tokenizer-fix

Aug 10, 2023

+255-9

Commits on Aug 9, 2023

Fix issue with setPadding and setTruncation overriding configurations set in tokenizer.json
siddvenk
committed