Incorporated in 1794, the town was probably named for its location near a shallow water crossing on the Souhegan River by an early mill site known as the Mill Ford. It was separated from the town of Monson, which ended up on the Massachusetts side of the border. Milford is also known as the Granite Town, because of extensive high-quality granite quarries.