For campaigns, impressions and clicks are unavailable 14 days after the last impression / click. It means that if there were no impressions or clicks in a campaign during two weeks, then the audience that was built on the basis of such a campaign will be reset.
Use only campaigns that have impressions and clicks in the last 14 days as a source for remarketing.