Try get your GB up in level and you will get more points but what really matter, when it comes to attack and defense is your army.
1. Get a nice defense = 8 updated unit, some ritual flames from GE, event buildings with defense, maybe a GB that help your defense and harvest your town befor your neighbor do it.
2. If you want to attack your neighbors, get Zeus Aachen and CDM up i level and look for event buildings with attack.
If you do this, you will end up in the better end of the neighborhood.
The neighborhod are balanced fine, and help you trade your goods as they are in same age as you when neighborhood changes. Jes there are a few in the lower ages that had been there to long but you get rid of them when you changes age.
One more thing that will place you in the bottom of the neighborhood is to changes ages to fast so your GB not get up in level. Also if you do not do GE, you will miss out good rewards, that could help your town.