Looking onto Gijón/Gijón Marina and the statue of King Pelayo, the palace is an 18th-century building, although one of its two towers dates from the 15th century.
The design of the building we see today can be attributed without doubt to the architect Francisco Menéndez Camino, who remodelled the original tower and elevated the rest of the construction.
Externally, the two square towers, higher than the central body, are topped with battlements and decorated with Historicist bays.
The ornamental wealth of the building is concentrated on the central body. It is divided into three floors and five bays, the central one being slightly wider. The ground floor is accessed through decorated archways flanked by columns, the first floor opens out onto five balconies and the second has four windows.
Pillasters flank the bays of the upper floors, except for the central bay, which is flanked by columns. Above the central balcony there is a large panel bearing the coat of arms of the Ramírez Jove family.
The entire top part of the central body is topped with a stone balustrade with pinnacles.
The Colegiate Church of St John the Baptist, designed by Pedro Muñiz Somonte in 1720, adjoins the palace.