I'm a starter in AngularJS, the question is as the title.
Angular 1.4.4 is 147kb when minified, jQuery 2.1.4 is 84kb when minified. All together this is roughly the equivalent of loading a second (properly optimized) banner image. Leaving out jQuery is the equivalent of leaving an image out of a slideshow. Unless you're target users are in an area with super slow internet this performance impact is negligible.
EDIT: I feel like I should add that if you're starting with angular try not to use the full blown jQuery library. There's a pretty significant shift in the thought processes involved in building web apps with angular vs jQuery. At least initially it's probably best to avoid using it.