split_hyphen_to_units

scripts.fix_tokenization.split_hyphen_to_units(i, terminals, preterminals, preterminal_parents, tag1, tag2, state)

split token with hyphen to two different units. xxx-xxx -> xxx - xxx