To uninstall upstart-bin just follow these instructions.
sudo apt-get remove upstart-bin
This will remove just the upstart-bin package itself.
sudo apt-get remove --auto-remove upstart-bin
This will remove the upstart-bin package and any other dependant packages which are no longer needed.
If you also want to delete your local/config files for upstart-bin then this will work.
sudo apt-get purge upstart-bin
Or similarly, like this upstart-bin
sudo apt-get purge --auto-remove upstart-bin
|Maintainer||James Hunt <firstname.lastname@example.org>|
|Description||event-based init daemon - transitional dummy package|