Getting FileNotFoundError when trying to open a file for reading in Python 3

I am using the OS module to open a file for reading, but I'm getting a FileNotFoundError.

I am trying to

find all the files in a given sub-directory that contain the word "mda"
for each of those files, grab the string in the filename just after two "_"s (indicates a specific code called an SIC)
open that file for reading
will write to a master file for some Mapreduce processing later

When I try to do the opening, I get the following error:

 File "parse_mda_SIC.py", line 16, in <module>
     f = open(file, 'r')
FileNotFoundError: [Errno 2] No such file or directory:        
'mda_3357_2017-03-08_1000230_000143774917004005__3357.txt'

I am suspicious the issue is either with the "file" variable or the fact that it is one directory down, but confused why this would occur when I am using OS to address that lower directory.

I have the following code :

working_dir = "data/"

for file in os.listdir(working_dir):
    if (file.find("mda") != -1):
        SIC = re.findall("__(\d+)", file)
        f = open(file, 'r')

I would expect to be able to open the file without issue and then create my list from the data. Thanks for your help.

Solution

This should work for you. You need to append the directory because it sees it as just the file name at the top of your code and will look only in the directory where your code is located for that file name.

for file in os.listdir(working_dir):
    if (file.find("mda") != -1):
        SIC = re.findall("__(\d+)", file)
        f = open(os.path.join(working_dir, file), 'r')

Also it's a good practice to open files using a context manager of with as it will handle closing your file when it is no longer needed:

for file in os.listdir(working_dir):
    if (file.find("mda") != -1):
        SIC = re.findall("__(\d+)", file)
        with open(os.path.join(working_dir, file), 'r') as f:
            # do stuff with f here