Of the 12th century castle, only one of the four original towers remains today. The original castle and its outbuildings covered an area of 4 hectares. Inside, there were 3 other buildings, a lower courtyard, a dovecote, a large fountain and 2 chapels, including that of Notre Dame de L'Isle which is still on the site.
The castle was burnt down in 1637 along with the village. The remaining tower of the castle was then used in different ways: in the 19th century it was used as a prison, while in the 20th century it was used as a dwelling for a long period.