interestingly this is almost the exact opposite of what GPT does, since it can only generate new tokens and has no way to revise existing output. i'd imagine language models would be able to produce much more accurate output if they were able to revise.
post source:
i am satisfied