I would get the refill. I didn't go back to the doctor the first time I was diagnosed with pneumonia because I felt pretty good. My symptoms came back a couple weeks later... I eventually went back to the doctor after a month or so of coughing, congestion, and chest pain. You should take care of it now.