Your fig tree needs a lot of sunlight to grow successfully in the northeastern U.S.
LIGHT & HEAT: Success in growing figs has many variables. One of the most important is adequate sun and heat. In the Northeast growing season there are approximately 196 days of optimal temperatures. Growing figs in the northeast requires at least 120 warm summer days. If you have a southern exposure, and or white wall helping to reflect the southern sunlight, that would be optimum. More on how to grow your fig tree: http://libanswers.nybg.org/faq/222724
Hope this is helpful.