Using Queue() to share files in a distributed application with python

Question

Master:

have multiple files that he need to apply the same function for each file, so i considered each file as a Job and I put them in a Queue().

Worker:

Each process get a job from the shared queue and process the file in it and return the processed file.

My question is :

Do I have to send the file from master to worker or just share it with the Queue() ?

for information : the file here is a video sequence.

Answer 1

The best you can do here, all very abstract really by the way, is to share the Queue(), and each worker ask if "has something to do, else they sleep (lock)