Located on the banks of the Parramatta River, Old Government House is the oldest surviving public building in Australia.