Search code examples
pythonjupyter-notebookcrongithub-actionsjupyter

Github Actions to run Jupyter notebook scripts


I have an environment set up in jupyterhub with all my production scripts. Firstly I was using Jupyter_Scheduler to run my jobs however it's very inconsistent and requires server reboots time to time. I had a look into Github Actions which looks promising and I've got my workflow yaml file set up but if my jupyter notebook scripts contain credential checks which is stored in the OS within jupyterhub, will Github Actions be able to access this? I'm unsure of how it will communicate with each other.

my end goal is:

  • Set up a cron schedule using github actions
  • run my jupyter notebook scripts that is currently on my jupyterhub which i will be cloning to my github repo.
  • Safe method of accessing credentials within my script, which at the moment i am storing in my OS

Thanks!


Solution

  • For GitHub Actions there is something called secrets, which I strongly suggest you use if you don't want anybody else to see your tokens/passwords.
    As to how you get them onto the repository: if your secrets don't change you can just set them manually, but if they do change regularly you can take a look at the API for setting secrets and write a script that automatically creates/updates the secrets