The semi-fortified brick Manor House was built by Sir John Cheyne about 1460. Sir John Russell (later the 1st Earl of Bedford) made additions in 1526, and it was his principal residence.