Search code examples
pythonpython-asynciopython-aiofiles

AIOFiles Take Longer Than Normal File Operation


I have a question I'm new to the python async world and I write some code to test the power of asyncio, I create 10 files with random content, named file1.txt, file2.txt, ..., file10.txt

here is my code:

import asyncio
import aiofiles
import time

async def reader(pack, address):
    async with aiofiles.open(address) as file:
        pack.append(await file.read())

async def main():
    content = []
    await asyncio.gather(*(reader(content, f'./file{_+1}.txt') for _ in range(10)))

    return content

def core():
    content = []
    for number in range(10):
        with open(f'./file{number+1}.txt') as file:
            content.append(file.read())
    
    return content

if __name__ == '__main__':
    # Asynchronous
    s = time.perf_counter()
    content = asyncio.run(main())
    e = time.perf_counter()
    print(f'Take {e - s: .3f}')

    # Synchronous
    s = time.perf_counter()
    content = core()
    e = time.perf_counter()
    print(f'Take {e - s: .3f}')

and got this result:

Asynchronous: Take 0.011
Synchronous: Take 0.001

why Asynchronous code takes longer than Synchronous code ? where I do it wrong ?


Solution

  • I post an issue #110 on aiofiles's GitHub and the author of aiofiles answer that:

    You're not doing anything wrong. What aiofiles does is delegate the file reading operations to a thread pool. This approach is going to be slower than just reading the file directly. The benefit is that while the file is being read in a different thread, your application can do something else in the main thread.

    A true, cross-platform way of reading files asynchronously is not available yet, I'm afraid :)

    I hope it be helpful to anybody that has the same problem