Zit next to ear piercing?

I got my ears pierced about 6 months ago and I change my earrings once in a while but I have kept the one's I got them pierced with and wear those the most. A few days ago I was wearing some new pearl earrings I got I took them out at the end of the day. Now like 4 days later I felt a bump on my ear so I squeezed it and puss came out of my ear piercing hole. I think it is just a zit I had one on my ear once before..but Im not sure. Should I be worried. Should I put my earrings in or leave them out?