US President Donald Trump shakes hands with White House Physician Rear Admiral Dr. Ronny Jackson, following his annual physical at Walter Reed National Military Medical Center in Bethesda, Maryland, January 12, 2018. / AFP PHOTO / SAUL LOEB        (Photo credit should read SAUL LOEB/AFP/Getty Images)
PHOTO: SAUL LOEB/AFP/Getty Images
US President Donald Trump shakes hands with White House Physician Rear Admiral Dr. Ronny Jackson, following his annual physical at Walter Reed National Military Medical Center in Bethesda, Maryland, January 12, 2018. / AFP PHOTO / SAUL LOEB (Photo credit should read SAUL LOEB/AFP/Getty Images)
Now playing
02:49
Trump: Nobody has experience to run VA
Ronny Jackson meets with Sen. Jon Tester on Capitol Hill on April 17, 2018.
PHOTO: Mark Wilson/Getty
Ronny Jackson meets with Sen. Jon Tester on Capitol Hill on April 17, 2018.
Now playing
00:53
Ronny Jackson is no longer Trump's doctor
PHOTO: CNN
Now playing
02:21
Tester: White House called Jackson 'Candy Man'
Ronny Jackson pauses during the daily White House press briefing at the White House on January 16, 2018.
PHOTO: Alex Wong/Getty Images North America/Getty Images
Ronny Jackson pauses during the daily White House press briefing at the White House on January 16, 2018.
Now playing
01:37
WH staffers: Jackson handed out meds 'like candy'
trump rose garden
PHOTO: CNN
trump rose garden
Now playing
01:23
Trump: Ronny Jackson treated very unfairly
Ronny Jackson listens during the daily White House press briefing at the James Brady Press Briefing Room of the White House January 16, 2018.
PHOTO: Alex Wong/Getty
Ronny Jackson listens during the daily White House press briefing at the James Brady Press Briefing Room of the White House January 16, 2018.
Now playing
01:33
Dr. Jackson gives statement on withdrawal
Ronny Jackson meets with Sen. Jon Tester on Capitol Hill on April 17, 2018.
PHOTO: Mark Wilson/Getty
Ronny Jackson meets with Sen. Jon Tester on Capitol Hill on April 17, 2018.
Now playing
01:37
Source: VA pick got drunk during overseas trip
Ronny Jackson meets with Sen. Jon Tester on Capitol Hill on April 17, 2018.
PHOTO: Mark Wilson/Getty
Ronny Jackson meets with Sen. Jon Tester on Capitol Hill on April 17, 2018.
Now playing
01:23
Whistleblowers detail allegations against Jackson
Rick Santorum newday 04252018
PHOTO: CNN
Rick Santorum newday 04252018
Now playing
01:30
Santorum: How could WH have known about Jackson?
armed forces
PHOTO: CNN
armed forces
Now playing
00:38
Senator slams WH for 'sloppily' vetting Jackson
US President Donald Trump (C) and his White House physician Dr. Ronny Jackson (L) listen as US Secretary of Veterans Affairs David J. Shulkin speaks about new technology used by the Department of Veterans Affairs during an event in the Roosevelt Room of the White House August 3, 2017 in Washington, DC. / AFP PHOTO / Brendan Smialowski        (Photo credit should read BRENDAN SMIALOWSKI/AFP/Getty Images)
PHOTO: BRENDAN SMIALOWSKI/AFP/Getty Images
US President Donald Trump (C) and his White House physician Dr. Ronny Jackson (L) listen as US Secretary of Veterans Affairs David J. Shulkin speaks about new technology used by the Department of Veterans Affairs during an event in the Roosevelt Room of the White House August 3, 2017 in Washington, DC. / AFP PHOTO / Brendan Smialowski (Photo credit should read BRENDAN SMIALOWSKI/AFP/Getty Images)
Now playing
02:35
Trump taps White House doctor as VA secretary
White House physician Rear Admiral Ronny Jackson speaks at the press briefing at the White House in Washington, DC, on January 16, 2018. / AFP PHOTO / NICHOLAS KAMM        (Photo credit should read NICHOLAS KAMM/AFP/Getty Images)
PHOTO: NICHOLAS KAMM/AFP/Getty Images
White House physician Rear Admiral Ronny Jackson speaks at the press briefing at the White House in Washington, DC, on January 16, 2018. / AFP PHOTO / NICHOLAS KAMM (Photo credit should read NICHOLAS KAMM/AFP/Getty Images)
Now playing
01:34
Dr. Ronny Jackson praises Trump's health (2018)
PHOTO: CNN
Now playing
01:03
WH doctor: Trump requested cognitive exam
(CNN) —  

President Donald Trump said Thursday morning that he predicted Jackson’s nomination as the next secretary of Veterans Affairs was in serious trouble several days ago.

“I even told him a day or two ago I saw where this was going,” Trump told Fox News’ “Fox & Friends” over the phone, later adding that “it’s a disgrace.”

The President also said all the allegations against Jackson were false, saying the White House physician’s opponents are “trying to destroy a man.”

Jackson withdrew his nomination Thursday morning, minutes before Trump called into the show for an interview. Jackson’s nomination was hampered by a flurry of allegations about his professional conduct.

In a statement, Jackson called the allegations against him as “false” but said they had become a distraction for Trump and veterans’ interests.

Trump on “Fox & Friends” directed his ire over Jackson’s withdrawal at Montana Sen. Jon Tester, the leading Democrat on the Senate Veterans Affairs Committee. Tester discussed the allegations against Jackson this week.

Trump said he thinks Tester will have a “big price to pay in Montana,” adding, “I think this is going to cause him a lot of problems in his state.”