According to a court filing by the Justice Department in a District of Columbia court, the three outlets were issued with a list of "reporting incidents" by the White House ahead of the ban.
The filing cites a number of stories about construction at the White House - including about a security bunker and the building of a new ballroom, as well as a report on an internal information leak investigation.
It goes on to say that "access to the White House is a privilege, not a right".
The three media organisations have argued that the ban breaches their rights under the First Amendment, which forbids the government from "abridging" the freedom of the press.
In a joint statement confirming legal action against the government, they said: "Without notice or process, the White House revoked our journalists' credentials because it objected to our reporting.
"Left unchallenged, this threatens press freedom and the public's right to independent journalism free from government interference."
Ahead of Wednesday's hearing, 49 media organisations - including CBS News, The New York Times and Fox News - filed a legal brief in support of the lawsuit against the White House.
Major TV networks have withdrawn from a media-sharing arrangement of video and images of the president, known as the pool, in protest over the ban.
Shortly after, the White House launched its own streaming channel, Trump TV, which operates a 24/7 feed of clips of the president.
On Tuesday, tensions continued between Trump and some of the news outlets, as Trump told CNN reporter Kaitlin Collins before his speech to the United Nations General Assembly: "I'm surprised that CNN is here covering me. You should not be here covering me. You said you weren't going to cover me."
Collins noted later on air that the network had made no such pledge.
He also took to social media to attack Collins, once again asking why she and others were reporting on the president at the UN. The US president also hit out again at CNN , Politico and MS NOW, calling them "treasonous".