Are there any audio formats that are stored in a plain text file? For me it is easier to understand how they are stored and how they are read, rather than reading documentation on binary formats.
No, there is not. You can however easily, using for example a Python interpreter, print out any binary file as numbers.