In Sql Server 2008, I need to create a large data mart. I've written .NET Code (C#) for running all SELECT Stored Procs in parallel from code and join the results in datatable in memory.
I insert the datatable to database by SqlBulkCopy, but it gets really slow after some time. I use table lock and i adjusted batch sizes, but still there is no performance gain.
How can I insert the Datatable into Sql Server 2008 database by creating SSIS package from code and run the package as an alternative to SqlBulkCopy?