How hard would it be to get back to natural blonde?

You would have to bleach out the dye which can damage and or fry your hair. It may take several stages, but I would strongly suggest seeing a professional colourist. See if they can take your hair back to blonde.