Visits to primary care doctors declined by as much as 60 percent as the COVID-19 outbreak took hold in the United States in early April — and the impact on health has been significant.