Add Tokenizer custom token mapper support#2184

iffyio merged 1 commit intoapache:mainapache/datafusion-sqlparser-rs:mainfrom

askalt:askalt/tokenizer-iteratoraskalt/datafusion-sqlparser-rs:askalt/tokenizer-iteratorCopy head branch name to clipboard