Rake tasks suffer from the same problem as running tests: the Rails bootup process takes a long time before the task is even running.
Is there a way to integrate spork and rake together?
I discovered zeus today. It's the best thing ever, so I'm changing my answer to zeus:
zeus rake my:special:task