The original structure on this site, not far from the ramparts of El Morro, was a frame house built in 1521 as a home for Ponce de Leon. But Ponce de Leon died in Cuba without ever having lived in it, and it was virtually destroyed by a hurricane in 1523, after which his son-in-law had the present masonry …