How are you adjusting your batch size? If you are doing this by just changing the batch size within a recipe and not scaling the recipe to a new batch size, then the grain bill does not change and the result is that you have the same amount of grains contributing a fixed amount of sugars to the wort. The net result would be a dilution of the wort and therefore a reduced FG.