Moving SQL server data into Dynamics 365 CRM
I have more than 500s of tables in SQL server that I want to move to Dynamics 365. I am using SSIS so far. The problem with SSIS is the destination entity of dynamics CRM is to be specified along with mappings and hence it would be foolish to create separate data flows for entities for 100s of SQL server table sources. Is there any better way to accomplish this?
I am new to SSIS. I don't feel this is the correct approach. I am just simulating the import/export wizard of SQL server. Please let me know if there are better ways
It's amazing how often this gets asked!
SSIS cannot have dynamic dataflows because the buffer size (the pipeline) is calculated at design time (as opposed to execution time).
The only way you can re-use a dataflow is if all the source to target mappings are the same - Eg if you have 2 tables with exactly the same DDL structure.
One option (horrible IMO) is to concatenate all columns into a massive pipe-separated VARCHAR and then write this to your destination into a custom staging table with 2 columns eg (table_name, column_dump) & then "unpack" this in your target system via a post-Load SQL statement.
I'd bite the bullet, put on your headphones and start churning out the SSIS dataflows one by one - you'd be surprised how quick you can bang them out!
- Insert leading spaces, then the value to a field in varchar(10)
- How to use order by with union all in sql?
- Is it good to create a nonclustered index on a column of type varchar?
- Unable to install SQL Server(setup.exe) Exit code decimal: -2061893606
- No PK or FK when exporting SQL Server database
- SQL Server SELECT LAST N Rows
- SSRS Query execution failed for dataset
- Order by Specific id first then By rest
- Fuzzy phrase similarity in SQL Server
- Union two selects removing duplicates base on some columns (not the full row)
- SQL fill gaps with hold
- Create login and logout rows from single row
- Create Index without name while creating table
- Extracting SQL Server table data to parquet file
- SQL, How to convert VARCHAR to bigint?
- PHP and SQL Shopping Cart is Not Adding Products to Shopping Cart
- SQL Server query to find all permissions/access for all users in a database
- How to merge 2 or more rows and SUM a column in an UPDATE without a primary key?
- How can I update top 100 records in SQL server?
- inserting data into SQL DB from C# ASP.NET
- Display the average number of days between a customer's last and second to the last transaction
- Fastest way to determine if record exists
- Unrecognized column name that I define
- What are the advantages of running SQL Server in a Docker container?
- How do I get the MAX of two values in SQL Server?
- How can I split a single, very long string into separate columns and rows delimited by commas and semicolons in SQL Server?
- Why can't I use table names of aliased tables in WHERE clause?
- Function vs. Stored Procedure in SQL Server
- How to correctly join two tables that each have Start Date and Stop Date columns?
- How to run sql script using SQL Server Management Studio?