DENIED SSI BECAUSE NOT ENOUGH WORK IN LAST 10YRS BUT WAS ON WORKERS COMP FOR 5YRS WITH NO SSI WITHOLDINGS CAN I FIGHT AND WIN?

I WAS ELIGIBLE FOR SSI IN 2011 BUT WAS NOT DISABLED.FIVE YEARS OF REHAB AND RETURNED TO WORK FOR 6 MONTHS THEN HEALTH FAILURE.CAN SSI HOLD IT AGAINST ME THAT I WAS INJURED?WILL I LOSE MY MONEY THAT I PAID IN BECAUSE OF WORKERS COMP. NOT TAKING SSI OUT? I AM 45YRS OLD