I am doing some tasks with tens of thousands of activity directory objects that can take several minutes to load.
To speed up things up I'd like to just refresh this data into the sqllite database in the middle of the night (since there's no need for it to be current).
Is there a way to typically approach to this type of problem? Perhaps have Django periodically run a function somehow?
you can write a django admin command and use cron or at to execute the command.
or just use a django cron lib: