Does frozen helium float on air

I don’t know it hasn’t been invented yet

I would highly doubt it. Some aerogels are lighter than air. They dont necessarily float though. They would have to be evacuated which is a difficult state to maintain.