Is it possible to configure Mojo::Log in a way so it adds the line number to the log messages?
Nope. That is not a supported feature.