I’ve scoured over the net on how to permanently remove the Exim4 Mail Server from the Ubuntu OS and came across with this one command that did it. The other options that include purge with it didn’t work. So I’m sticking with this one since it is what made it work and I was able to reinstall Exim4 again.
apt-get remove exim4 exim4-base exim4-config exim4-daemon-light
Then just install Exim4 again with this command.
apt-get install exim4
If you are using an account that doesn’t have root access, add the command