I usually type :bd
to remove the buffer, however, it results in undesirable side-effect of the window being closed which I do NOT want.
I usually use :bn
(next buffer) followed by :bd#
(delete alternate buffer). You could create a mapping or command for this, of course.