"the man"

This weekend while discussing where to get coffee my daughter said, "let's get it from some small independent place, not from "the man". I've heard this before in reference to large corporate entities, but where does this phrase come from. Someone thought from the Black Panthers in the 70's. Any ideas?