Early 1100s Sir Payn de Turberville, knight of Robert Fitzhamon, gained control of the Coity Lordship from Morgan Gam and began construction of a Norman earth and timber stronghold to replace a possibly pre-existing Welsh structure.

1180s Sir Gilbert de Turberville refortified castle with stone, including addition of a curtain wall enclosing the inner bailey and a NE tower.

ca. 1384 The Lordship of Coity passed in this year to Sir Lawrence Berkerolles, who probably ordered extensive alterations, including the addition of a middle gate offering access to the inner bailey. An annex to the NE was constructed for the possible purpose of serving as private apartments. Berkerolles also ordered the addition of an E gate, opening toward Coity Church, a new curtain wall surrounding the outer bailey, and a 4-storey round latrine tower on the S side of the curtain.

1411 Coity passed to the Gamage family, who added a chapel over the hall, a large barn attached to the S wall of the outer bailey, and converted one of the wall towers into a gatehouse.

1584 On the marriage of Barbara Gamage to Robert Syndey, 15th Earl of Leicester (1563--1626), qv, Coity was abandoned for the primary Sydney residence of Penshurst, Kent.