Andrew Chan provided the right answer for me. To extend his answer a bit, here's what you can do on the commandline;
stop apache2
sudo systemctl stop apache2.service
prevent apache2 to start at boot
sudo systemctl disable apache2.service
Reinstall nginx
sudo apt-get install nginx
