Changing Image of Librarians?

What does it mean that Stephen Colbert would include librarians in a list of hate groups? It's not the first time he's singled us out for attention, either. Is it because we're stereotypically a very tame group, so the ridiculousness of the assertion makes it humorous, or are librarians getting a new reputation? I know conservative groups have complained about the ALA's stance on intellectual freedom and opposition to Internet filters and we've gotten a bit of notice for fighting the Patriot Act. So is it possible that the image of librarians is changing a little, that people now see us as a group in support of the right to freely access information? Is that why Colbert is tweaking us, to build on that new reputation? Maybe I'm being too hopeful here, but it would be nice.