Essentially, the only things that can truly destroy them are our Weapons, or specific abilities, like Tsukumo's overlaid form.

That's because, at the root, it's the Astrals' power that counteracts them.

... Of course, relatedly, things like "Rank-Up-Magic" also were the Astrals' power, at it's root conception. But I don't know how far that goes.