I checked the documentation but couldn't find it. Does anybody knows?
Put your cursor over the bookmark you want to delete and hit shift-d (i.e. capital D).
If you hit ? question mark while in the NERDTree window you'll find the docs for this. Search for "delete".