I have had three gallbladder attacks over the past two months and ...?

My mother had hers removed. It took them a while to do it, but I don't think it was a severe as yours. Even if your scan comes back and doesn't look so bad, they will still take into consideration that you have had some bad episodes recently. If you are not satisfied with what the doctor tells you, get a second opinion.