Castor Hat refers to a Hat made of beaver fur.

Castor pronounced "kas-ter" is the French word for "beaver" or "rabbit", from which Castor Hats are made of.