Any one know of a way to install MS Office Primary Interop Assemblies without installing having to install office itself?
Nope, not possible, or useful. There is no sense installing libraries designed so you can interoperate with Office, if there is no Office to interoperate with. (Note, you need a full licence for whatever office product you are using trough Interop too).