WASHINGTON, D.C. ? Surging energy prices are acting like a double whammy on the country’s economy, crimping growth even as they push up inflation, Federal Reserve Chairman Ben Bernanke said Thursday.

“The increase in energy prices is clearly making the economy worse off both in terms of real activity and in terms of inflation. There is no question about it,” Bernanke told the House Financial Services Committee.

Although Fed policymakers at their June meeting were concerned about higher energy prices and the risk of inflation spreading through the economy, they also seemed hopeful that moderating economic activity could help ease inflation pressures down the road, according to minutes of that closed-door meeting released Thursday.

Oil prices, which set a record closing high of $77.03 a barrel a week ago, have retreated and are now hovering above $73 a barrel.