Head up the alleyway behind Sally's Rooftop Garden and then proceed upwards by trial and error, along cracked steps and through ancient archways, and eventually you'll emerge by the top of Hora, next to the Panagia Gremiotissa church, with its superb sunset views. For even better views, climb for a few minutes more to the three small chapels above it.
Panagia Gremiotissa
Top choice in Ios