Essentially I need a folder and its items available in the project for debugging but I don't want it included in the publish.
You can exclude folders from your build-Solution (by default Debug and Publish are available).
Add New Folder
. Name it.Exclude from project
'Note the screenshot is from VS2010 C# Express, but the same option is available in VS2012.