ETL dataflow task - remain calculation
let me ask your help for understanding the main logic of data flow task. I'm using ETL to load data into data warehouse (staging and dwh part too). Now I got a task to calculate data with the existing fields, but have to calculate by inventory data...
I would need the correct qty of remain_qty, Assigned_qty and in_progress_qty. (as in picture). but currently I don't see this result. It would be great to get it. I did the calculation process after the lookup get the list of inventory data.
Then check the actual temp data an other lookup. when it is not exist on temp by item, then insert the record, else just a simple update.. With this method I would do the calculation process.. I think on the next record system should re-query the temp table and query the actual data.. I mean with the quantity reduced. record by record. But now it looks after this two lookup I got the same result for every row. that means for me the temp table does not re-query inside of the data flow. Shall I use an other data flow for calculation? Or may I use the temp table inside of this dataflow, which may updated by records? Because I would re-query the actual inventory quantity by records..
..Thanks for reading!
Click here for picture! Hello guys, I have found a solution and made changes on the ETL process.. I have separated the data flow task and used stored procedure to re-calculate the data on temp table. Then the next data flow is able to query the updated data from temp and fill the fact table with correct quantity and price. That time I have learn the control flow and data flow processes. Now it is clear for me and the app is working fine. Thanks for the support!
- Providing string variable into Dynamic SQL SELECT statement WITHOUT it being read as a column name?
- How to store geocoded address information into the database
- Truncate a DDL or DML command
- How can I find out what FOREIGN KEY constraint references a table in SQL Server?
- Why ISDATE() is returning 9996 as date?
- .NET 8 & SQL Server 2016 - Contains() throws error
- IsDate Function in SQL evaluates invalid dates as valid
- SQL Server - Value passes ISDATE() but fails to CAST as DATE or DATETIME
- Error when connecting to SQL Server in deno: 'cannot find module crypto'
- Multiple many-to-many and multiple one-to-one relationships in the same entities
- SQL Server DATEDIFF round up the YEAR difference. How to round it down?
- Path table to HTML treeview in SQL Server
- SUM and Decimal precision
- Parse TEXT datatype column to grab values based on TAGS
- How can I create a tar file in memory from several varbinary(max) columns stored in SQL Server using .NET native API?
- collation conflict between "Hebrew_CI_AS" and "SQL_Latin1_General_CP1_CI_AS"
- Maintaining property order with get-member
- migrate data from MS SQL to PostgreSQL?
- Add multiple conditional values to one column
- Read Committed vs Read Uncommitted if both transactions do not rollback
- SQL YEAR(GETDATE())
- VIEW with NOLOCK but called without NOLOCK
- SQL Merge WHEN NOT MATCHED BY SOURCE THEN on filtered source and targed tables
- SQL obtain timestamps for end datetime row 1 and start timestamp row 2
- Tricky SQL update
- Remove Identity from a column in a table
- Return 1 if value is 0 without CASE statement
- Append string text based on pattern search SQL
- How to find Cyrillic font (russian characters)?
- Query Azure SQL Database using Rest-API