Unfortunately you don't have a whole lot of information.
Did your grandfather come to North America or was he born here?
I would advise you to talk to you relatives first. Any uncles or aunts or distant relatives. The older they are the better. Not everyone in your family will be interested but you might find someone who knows something. Please be patient with them as it may take more than one visit.
I have recently discovered a village called Filipow in Poland, however, I don't have a connection there that I know of, you also may or may not.