Does HIPAA apply to SSDI appeal?

I have a litany of illnesses. Most major are Bipolar, Osteoarthritis, Chronic Vertigo and Chronic Insomnia. I went to my SSDI forced Phsyciatric evaluation today and the Physychiatrist had Medical Records (which I might add were completely derrogatory to me). The only disclosure agreement I signed per HIPAA for medical records was to my attorney representative. I have checked with my attorneys office and the doctors office. My attorneys office had never received these records because I had to physically got to their office and pay the fee at 2:00pm on 7/6/11. So how does a Soc Sec phsychiatrist have these records,that were never authorized to be released to him, at 12:30pm on 7/7/11? I have, as of yet, to fax these records to my attorneys. My doctors office also claims they have not sent the records to Soc Sec themselves. So, one of two things happened. My doctors office uses an outside company to scan and send medical records. My bill from the records company even says no records will be released until I paid for them and they were only to go to my attorney. This never happened because I paid for them at the doctors office. So, either the records company seriously violated HIPAA laws and released information to Soc Sec without my consent, or Soc Sec has a way to get the records without HIPAA authorization. Can Social Security legally do this? I've searched the internet for hours trying to find the answer with no results. My advocate isn't even sure if Soc Sec can do this. Does anyone have any information? Please, help.