Your fps really should not, especially in GG have that large of a band of fluctuation unless your settings are bad or your equipment is way over burdened. Large rapid drops in fps create frame lags which cause a player to feel jitter like response when this occurs.

If the lag that you feel is occurring along with these massive fps drops than that is the issue.

How often are you dropping below 100fps or having drops >50fps at a time?