The application in question has already been deployed. I have found out about ACRA, and will be adding that in to find out why the application crashes are happening.
My problem however, is that the application will crash (the dialog will show up giving you the option to either "Force Close" or "Wait"), but instead of restarting the application completely, it resumes from a point before the crash occurred. This causes problems however, that are only fixed by restarting the application (eg. sudden loss of data, crashes that don't make sense, etc.).
So how can I force my application, once crashed, to just end? (NOT restart).
Edit: The biggest issue is that after the application crashes, all the data in my preferences file disappears, until the app is restarted when it comes back.
Android will re-start the last active activity by default. Instead of forcing it to restart, the better strategy would be to fix your application, so that activities don't crash or exit gracefully even if no data is available. If you absolutely depend on some data (intent extras) and there are no defaults, you can just call finish() if it is not available, or start the main/parent activity.
Another way is to have your own default exception handler which re-starts the main activity, etc. after reporting the crash using ACRA (I believe there is a feature request for this in ACRA's bugtracker).