Washington ? Vowing to recover “every single dime the American people are owed,” President Barack Obama on Thursday proposed a new tax on the nation’s largest financial institutions to recover projected losses from the government’s bailouts.

“We want our money back and we’re going to get it,” Obama said in a short but sharply worded White House speech. “If these companies are in good enough shape to afford massive bonuses, they surely are in good enough shape to afford to pay back every penny to taxpayers.”

Obama’s tough talk comes amid public anger about big profits and large bonuses at major financial firms as Wall Street — with the help of taxpayer money — has returned to robust fiscal health while much of the nation struggles to recover.

Obama said the bailouts, which were begun under the Bush administration, were “as necessary as it was unfortunate” because of the vital role large financial institutions play in the economy. Even though many of the firms have repaid the money, Obama said that’s not good enough.

“My commitment is to recover every single dime the American people are owed,” he said. “And my determination to achieve this goal is only heightened when I see reports of massive profits and obscene bonuses at some of the very firms who owe their continued existence to the American people, folks who have not been made whole and who continue to face real hardship in this recession.”

The new Financial Crisis Responsibility Fee would have to be approved by Congress. It would hit about 50 of the nation’s largest financial institutions and generate about $9 billion annually for at least 10 years, administration officials said. The tax would be an annual 0.15 percent fee on a company’s liabilities, excluding insured deposits, and would be assessed on banks, insurance companies and other financial firms with at least $50 billion in assets.

The goal is to offset projected losses of about $117 billion from the $700 billion Troubled Asset Relief Program, or TARP. About 60 percent of the fee would be raised from the 10 largest financial firms, among them some of the biggest names from the financial crisis, including Bank of America, Citigroup, Goldman Sachs Group, JPMorgan Chase & Co. and Morgan Stanley.

But most of the large recipients of bailout money have repaid all of their infusions, and the Treasury Department has projected a profit from the TARP program that injected money into banks because of payments from dividends and stock warrants.

The tax, which would begin on June 30, would be assessed on firms that have repaid their money and some that never received any bailout. It would not be assessed on automakers General Motors Co. and Chrysler Group, which have received about $64 billion in bailout money and are projected to account for a large share of the losses. Such a fee would be logistically difficult to impose on a manufacturing company, according to a senior administration official.

The administration also is spending about $50 billion of TARP money on its plan to offer incentives to banks to modify home mortgages to reduce foreclosures. That program’s cost is included in the projected losses for TARP.

Large banks said asking them to make up the TARP shortfall is unfair.

“Two-thirds of the TARP investment from banks has already been repaid with a large profit to the taxpayer,” said Steve Bartlett, president of the Financial Services Roundtable, a trade group of large financial firms. “This proposed tax will do nothing more than stifle economic recovery and encumber more pressing concerns, such as covering new regulatory costs. … This tax is strictly political.”