SSIS-- Archive Flat File Task Creating Duplicate Files
I have an SSIS package that first looks at a table in the database for flat files that have been ingested. If they have a status of 1, they are ready to be first archived, and then imported into a database table.
I am using a For Each Loop to Archive the Files and then import them into the database and then mark them as processed in the source table.
For some reason, the archive file task is creating duplicate files on SOME files, but not all. And then when this happens, duplicate data gets inserted into the database.
We have a similar package that does the same thing, yet it does not create duplicate files or database entries.
Does anyone know anything off the top of their head? Please let me know if I need to provide more details
A better way of doing what this package does is making sure all the files that you need are in a folder/subfolders and then using for each loop read file after file and save file name in a variable then load data into database and then archive using file system task with additional date and time concatenated to the end of the original file name so there won't be any duplicates.
- Blank xml namespace in child nodes in SQL Server
- SQL Server migrate new data into old schema
- Newline in SQL Server
- Combine First and Last Names of people based on criteria
- "The transaction log for database is full due to 'LOG_BACKUP'" in a shared host
- Copy a ODBC-linked SQL-Table to an Access table with VBA
- How to execute a stored procedure inside a select query
- JPA entity ID field with a SQL Server 2022 Sequence
- Error 'Conversion failed when converting from a character string to uniqueidentifier.' when using UNION ALL
- migrate data from MS SQL to PostgreSQL?
- Sqoop Import HBase - SQL Database
- How important is the order of columns in indexes?
- Connect to SQL Server running on Windows host from a WSL 2/Ubuntu sqlcmd
- SQL Server, to normalize this much or not?
- Strange behavior of symfony doctrine during phpunit test - field becomes null in database
- How do I make it to where my login will accept either an email or username in the username field
- Adding column to select statement in SQL causes timeout
- SQL Server: Clustered index on datetime, ASC or DESC
- SQL Pivot on Conditional Count
- SQL Server indexes - ascending or descending, what difference does it make?
- Query to concatenate row data in each group
- Combine 2 SQL Statements
- Converting SQL server timestamp to an epoch timestamp
- How does SQL Server allow multiple of the same alias in the same SELECT statement?
- Change Date format from yyyy-mm-dd to mm/dd/yyyy Derived Column
- How do you send email with TSQL using a Agent Operator instead of an email address?
- Spark sending LIMIT to SQL Server on display function
- How can I manage Azure SQL user/login/credentials
- Can't add members to SSAS role through Visual Studio
- How to use Charindex for one or the other character