handle_words_set

scripts.fix_tokenization.handle_words_set(rule, i, terminals, preterminals, preterminal_parents, state)[source]

use set of words to determine the right fix needed