A man's natural rights are his own, against the whole world; and any infringement of them is equally a crime, whether committed by one man, or by millions; whether committed by one man, calling himself a robber, (or by any other name indicating his true character,) or by millions, calling themselves a government.

In this quote, Lysander Spooner asserts that natural rights are inalienable and belong to each individual, standing against any infringement, regardless of the source. Spooner argues that the violation of these rights is a crime, whether perpetrated by a single individual or a government. The key point he makes is that the scale or authority behind the infringement does not change its illegitimacy. This perspective aligns with his broader anarchist and libertarian beliefs that no one, including governments, has the moral right to infringe upon an individual’s freedom.

Spooner’s remark also critiques the idea of governmental authority, equating the actions of governments to those of robbers. He draws a parallel between a person who steals from others and a government that enforces laws which he believes violate personal liberties. The use of the phrase “calling themselves a government” challenges the legitimacy of state power, suggesting that merely labeling an action as governmental does not make it morally just. In Spooner's view, governments, no matter how many people are involved, can still commit the same violations as any criminal.

The quote originates from Spooner’s abolitionist and anti-government views, which were foundational in his writings. Spooner was deeply critical of the U.S. government, particularly its role in perpetuating slavery and its infringement on the rights of individuals. His advocacy for individual sovereignty and the abolition of oppressive institutions is reflected here, as he stresses the moral equivalence between personal crimes and state-sanctioned actions.

Ultimately, this quote captures Spooner’s belief in the primacy of individual rights and his argument that no authority, whether a single person or an entire government, has the legitimate power to violate those rights. It is a call for people to recognize that freedom and justice cannot be defined by the structures of power but by the natural rights inherent in every individual.