Is having an abnormal pap but no HPV normal?

I've had 3 abnormal pap smears in a row and my pcp has referred me to a gynecologist to get my first colposcopy/biopsy. I'm pretty much freaking out but when i got my last pap results the doctor said that the good news is that i DON'T have HPV. Should i still be freaking out about the biopsy? Is there anything i should be worrying about?? Help me put my mind at ease!!!