I think my lawyer may be trying to "get in my pocket..."?

Start by demanding (in writing) a detail of his billing and a copy of your file. He must provide you with justification for his charges, meaning what he's billed and what he's done to earn it. He must also provide you with ALL doentation in your file. If he can justify his bill, then sticking with him is up to you. If he can't justify it, or if he refuses to cooperate, fire him. You may fire your attorney any time you want. Then hire another attorney and file a complaint with the state Bar against the first yo-yo.