Search code examples
profilingprofilerjax

what are the numbers in the operation names when profiling an application


What are the numbers in "fusion_2", "fusion_4"? Where do they come from? Thank you!

JAX profiling


Solution

  • These numbers exist to de-duplicate the names of generated HLO operations. The first fusion operation created by the compiler is called fusion, the next is fusion_2, then fusion_3, and so on.

    Note that the order of creation does not necessarily match the order of execution.