There only seems to be an Add NuGet Package option. No manage or remove option as is available in the Windows edition of Visual Studio.
You can remove a NuGet package from the Solution window. Expand the Packages folder for your project, select the package, right click and select Remove, or press the delete key.