It should be something very natural to have, I was wondering if there is a ready implementation of Prioritized BufferBlock from TPL DataFlow library?
Seems the best way to achieve this is to use a specialised Task Scheduler, rather than implementing your own BufferBlock. There are many variety of them one can find out in net. For instance, check QueuedTaskScheduler in ParallelExtensions Library