How to create AI voice generator for fantasy language?

Crossposting this from AI SE: How to create AI voice generator for fantasy language?

How can you create a TTS tool which translate text written using a fantasy language script (my script is ASCII, where each letter means one thing, but not necessarily the standard meaning English gives it)?