I spent some time investigating the collections.namedtuple
module a few weeks ago. The module uses a factory function which populates the dynamic data (the name of the new namedtuple
class, and the class attribute names) into a very large string. Then exec
is executed with the string (which represents the code) as the argument, and the new class is returned.
Does anyone know why it was done this way, when there is a specific tool for this kind of thing readily available, i.e. the metaclass? I haven't tried to do it myself, but it seems like everything that is happening in the namedtuple
module could have been easily accomplished using a namedtuple
metaclass, like so:
class namedtuple(type):
etc etc.
EDIT: Humbly suggest reading the answer I wrote several years later, which is a bit down the page.
There are some hints in the issue 3974. The author proposed a new way to create named tuples, which was rejected with the following comments:
It seems the benefit of the original version is that it's faster, thanks to hardcoding critical methods. - Antoine Pitrou
There is nothing unholy about using exec. Earlier versions used other approaches and they proved unnecessarily complex and had unexpected problems. It is a key feature for named tuples that they are exactly equivalent to a hand-written class. - Raymond Hettinger
Additionally, here is the part of the description of the original namedtuple
recipe:
... the recipe has evolved to its current exec-style where we get all of Python's high-speed builtin argument checking for free. The new style of building and exec-ing a template made both the __new__ and __repr__ functions faster and cleaner than in previous versions of this recipe.
If you're looking for some alternative implementations:
abstract base class + mix-in for named tuples recipe by Jan Kaliszewski
metaclass-based implementation by Aaron Iles (see his blog post)