The one thing that really puts me off Rapha is their slapdash approach to making the bulk of their pieces. Their halo garments are made in the UK, but everything else is china/thailand. While it is possible to get good work done in those places, it requires that you own the factory, and are willing to put in the time over there to handle QA.
However, everyone at the company that I've ever spoken with has been quite nice, and I certainly don't disrespect them in any way.
It's also important to keep in mind that they are a luxury goods provider, and not a premium goods provider. There's a vast difference in those two markets. It's like comparing, say, Seven or Rock and Republic, to IH.
(full disclosure: I'm launching a line of technical merino blend cycling wear soon, and have researched materials & manufacturing to death. I'm opting to build in USA at 2x the cost of going offshore.)