If these walls could talk.... Photo by your wandering travel4seniors.com editor. There were two rival Popes in Rome in 1309, so Pope Clement V decided to flee to this French city and build this imposing fortress. When the Catholic Church was united again under Pope Gregory IX, it returned to Rome in 1377, and has been there at the Vatican ever since.