The substantial and picturesque Church of the Holy Trinity sits below the upper fortress. Of all the churches within the fortress walls, it's the best preserved but sadly it's normally kept locked; try enquiring at the Onufri Museum about access.
Church of the Holy Trinity
Berat