"Greedy bastard" or selfish?

Colbert talked about "going John Galt" on his show last night (about three minutes in). Naturally he makes fun of it, and does not seem to understand it from either a moral perspective, or as a form of protest. However, at least it is getting some attention. And as threatened as left-leaning types seem to be by the term, it must really strike a chord. It strikes me as odd that if you work and make money, you're a selfish bastard and if you stop working hard and making money, you're a selfish bastard. Which is it?