Reads and consumes characters from regex string until a right
bracket is seen. Assembles them into a list (which is returned) of
characters, character ranges, like (:RANGE #\A #\E) for a-e, and
tokens representing special character classes.