A reduction in force of tens of thousands of employees would render the agency “dysfunctional,” a former IRS Commissioner said.