Is there a temporary folder that I can access while using AWS Glue?

Question

Is there a temporary folder that I can access to hold files temporarily while running processes within AWS glue? For example, in Lambda we have access to a /tmp directory as long as the process is executing. Do we have something similar in AWS Glue that we can store files while the job is executing?

Answer 1

Are you asking for this? There are a number of argument names that are recognized and used by AWS Glue, that you can use to set up the script environment for your Jobs and JobRuns:

• --TempDir — Specifies an S3 path to a bucket that can be used as a temporary directory for the Job.

Here is a link, which you can refer.

Hope, this helps.