As far as I can tell, they don't pay taxes to the US, only to their own government. You're right, they do receive monetary aid from the US to the tune of
$4.2 billion annually, much of it earmarked for public welfare costs, but their programs are mostly internal, such as "Nutrition Assistance for Puerto Rico" instead of food stamps--they are not part of the same system we are.