If properly rinsed go for it.
But sand is a detritus trap plus its also a pain to cleanly transfer. Honestly new bags are worth the menial cost comparative to the mess
Highly recommend not reusing the sand. It is going to be a big PIA to clean it properly as mentioned vs the cost of buying new and your rock will help seed the new sand.