Berry Head was a promontory fortress and hospital constructed in the Napoleonic period, but situated on much earlier settlers remains. These earthworks were probably of from the Early Iron Age. The Berry Head earthworks, pottery, and coins suggest a late Celtic trading settlement, persisting into Roman times.

Palaeolithic man, may also have resided in Brixham, with evidence of occupation in the "Windmill Cave". Brixham was originally a royal estate in Saxon times, pre-conquest (1066) and stretched as far as Kingswear and Galmpton. (It is thought that the name "Brixham" probably came from Brioc's village . Brioc was an old English personal name and ham is an ancient term for village.

Brixham is more famous as a fishing port, still active and producing a good catches daily. Originally competing with Torquay and Paignton, it eventually dominated and remained the only active port. In the 1800's as many as 250 vessels fished out of Brixham, from large trawlers to inshore boats, employing over 1,500 people.

The fishing industry all but collapsed at the end of the second world war. The old harbour originally nestled in central lower part of the town, with natural protection, has been replaced and protected by the new harbour and eventual breakwater.

On the Quay at Brixham is a statue, erected in 1889, to commemorate the landing of William of Orange at this point on 5 November 1688, although some of his compatriots are reputed to have landed at the various coves around the bay.

The harbour area is the focus for Brixham; this is where the seagulls try to get scraps from the fishermens nets on the Fish Quay. A stroll past the back of this quay takes you to one of the finest office locations anywhere in the world; one of the research laboratories of Astra Zeneca. There is also plenty of parking for visitors here and great views.