I usually don’t make entries here that consist of just links to other things, but I have to make an exception in this case. I just came across Josef Richberg’s article about using SSIS and parallelism and I am thoroughly impressed! He took a job that was taking 40 hours to run and cut it down to 2 hours by breaking the problem up into pieces and using parallel processing provided by SSIS to tackle different parts of the problem at the same time. The method he came up with for distributing the work is genius. In fact, I find the logic and thought process behind coming up with the method to be more interesting then the process itself. I don’t currently have a need for something like this, but it is something I will definitely keep in mind in case such a need comes up.
SSIS and Parallelism: The Unseen Minions