I am looking at the compat tables, and it seems like IE 11 supports all of ES5 except (under Miscellaneous) this feature: "Enumerable properties can be shadowed by non-enumerables". I don't understand what that means, despite the provided example.
Can I get away from using ES5 shim since IE11 supports most of it?
Yes it is safe to drop ES5 shim in that scenario. I make websites available IE11 and common issues are custom variables, ES6 obviously and CSS calc() related bugs. Managed to make my own custom variable emulator using a map and used a similar approach CSS calc().