Firefox version keeps changing from ESR to release version automatically

I originally had the latest release version of Firefox but started to experience issues with certain banking websites, and misc printing issues. So I decided to downgrade from the release version to the extended support release.

I uninstalled the release version, and went into the Appdata folder and deleted anything Firefox related. Then I installed the ESR version. It worked fine for the day, but a restart the next day, I discovered that my install changed from ESR to the release channel. I once again went through the install process mentioned above, and the next day, the same thing happened. Any idea on why this might be changing?

Note: I have tried both the MSI and .exe versions and experience the same issue. I am the only one that logs into this workstation. This workstation is actually a Azure Virtual Desktop with a variation of windows 10. (Screenshot attached with the OS).