Can we dynamically add fields that are in custom setting in Visualforce page?

Try this approach to fulfill your requirement

Create a method with return type PageReference and call this method from the page reference method. Finally call page reference method from your vf page. Basically when we call method from vf page we should have method return type PageReference.