Permission denied when pandas dataframe to tempfile csv

I'm trying to store a pandas dataframe to a tempfile in csv format (in windows), but am being hit by:

[Errno 13] Permission denied: 'C:\Users\Username\AppData\Local\Temp\tmpweymbkye'

import tempfile
import pandas

with tempfile.NamedTemporaryFile() as temp:
    df.to_csv(temp.name)

Where df is the dataframe. I've also tried changing the temp directory to one I am sure I have write permissions:

tempfile.tempdir='D:/Username/Temp/'

This gives me the same error message

Edit:

The tempfile appears to be locked for editing as when I change the loop to:

with tempfile.NamedTemporaryFile() as temp:
    df.to_csv(temp.name + '.csv')

I can write the file in the temp directory, but then it is not automatically deleted at the end of the loop, as it is no longer a temp file.

However, if I change the code to:

with tempfile.NamedTemporaryFile(suffix='.csv') as temp:
    training_data.to_csv(temp.name)

I get the same error message as before. The file is not open anywhere else.

Solution

Check your permissions and, according to this post, you can run your program as an administrator by right click and run as administrator.

We can use the to_csv command to do export a DataFrame in CSV format. Note that the code below will by default save the data into the current working directory. We can save it to a different folder by adding the foldername and a slash to the file

verticalStack.to_csv('foldername/out.csv').

Check out your working directory to make sure the CSV wrote out properly, and that you can open it! If you want, try to bring it back into python to make sure it imports properly.

newOutput = pd.read_csv('out.csv', keep_default_na=False, na_values=[""])

ref

Unlike TemporaryFile(), the user of mkstemp() is responsible for deleting the temporary file when done with it.

With the use of this function may introduce a security hole in your program. By the time you get around to doing anything with the file name it returns, someone else may have beaten you to the punch. mktemp() usage can be replaced easily with NamedTemporaryFile(), passing it the delete=False paramete.