How to handle out of vocabulary words

Hi,
It would be great if I can get some pointers on handling out of vocabulary words.
How to handle new words or words that are repeatedly being transcribed wrong.

I have a setup where people can edit incorrect outputs from the model and I fine-tune the model at the end of every week. This methods feels slow and resource intensive. Any alternatives would be great.

Thanks.