For some reason it takes awhile for the server to actually refresh the whitelist, oddly enough when we do a full reload of everything it still wont work. Until I am able to pinpoint what's going on it might take 20-30 minutes for it to actually apply.