I come from making a script.sql to fill and create tables to a database. ( 10000 lines of code)
The script is big, since I have to apply some logic to be able to fill some tables, all the instructions are like this ( BY EXEMPLE):
That is, my script is made up of many instructions, when I run it in the WorkSheet, everything works perfectly.
My question is, how can I fit all my script logic into one task? Any architecture advice before I start thinking about CRAZY options?
BY EXEMPLE
--- 1 statement CREATE OR REPLACE TABLE TEST.AFFAIRES.CLIENT .....;
--- 2 statement DROP TABLE TEST.AFF.CLIENT;
--- 3 statement CREATE OR REPLACE VIEW TEST.AFF.PROVIDER .........;
--- 100 statements etc....
Thank you for your advices
You can write them into a stored procedure to run them all from a single task. If you don't want to write your own stored procedure, I wrote one that will read SQL statements written to a table and run them one at a time. That way all you have to do is store the statements in a table with a numbered order column to tell it the sequence. It includes simple variable substitutions.
I'm planning to move this to Snowflake Labs (it did not exist yet when I wrote this), and you can grab it here now if you're interested or just want to see how it works to try something similar: