I vaguely remember something about language models with a diffusion objective but I don't know much about them. Certainly work on using language models to edit text has been done.