There's also one other problem: If you're a company selling luxuries, you don't want the crash in living standards needed to make outsourcing unattractive because it'll gut your profitability. You want the purchasing power difference to be as high as practical between your manufacturing base and your sales base because that results in the market generally setting a higher price.
You've also got to consider the changes required to bring down western manufacturing costs into line with developing world manufacturing costs. It ain't a pretty path to go down for anyone involved.