John R. Allen, a retired four-star Marine general who was the president of the Brookings Institution, had been accused of secretly lobbying for the government of Qatar.