“Access to the White House is a privilege — not a right,” the Trump administration said in a court filing late Tuesday setting out its arguments.