The 117 meter high cliff of Ballard is part of the chalk ridge that runs inland through the Isle of Purbeck and outcrops to form the cliff at Flowers Barrow above Worbarrow Bay 12 (19.5 km) miles away. The cliff forms the eastern side of Swanage Bay.