Yes - you can delete corda.service, and as you’re not using systemd, /etc/systemd/system is probably empty so you can remove that directory too.
To start and stop Corda as an Upstart service:
sudo stop corda
sudo start corda
You shouldn’t need to reboot to start it for the first time, just use “sudo start corda”.