During his presidential campaign Donald Trump proposed the “extreme vetting” of immigrants. Civil libertarians criticized the proposal, not least because the Extreme Vetting Initiative mandated by one of President Trump’s first executive orders sought technology that would use machine learning to determine whether visa applicants would be likely to contribute to society and the national interest. Fortunately, Immigration and Customs Enforcement (ICE) – is no longer pursuing this vetting technology.

In January 2017 President Trump issued Executive Order 13769, which stated in part (emphasis mine):

Sec. 4. Implementing Uniform Screening Standards for All Immigration Programs. (a) The Secretary of State, the Secretary of Homeland Security, the Director of National Intelligence, and the Director of the Federal Bureau of Investigation shall implement a program, as part of the adjudication process for immigration benefits, to identify individuals seeking to enter the United States on a fraudulent basis with the intent to cause harm, or who are at risk of causing harm subsequent to their admission. This program will include the development of a uniform screening standard and procedure, such as […] a process to evaluate the applicant’s likelihood of becoming a positively contributing member of society and the applicant’s ability to make contributions to the national interest; and a mechanism to assess whether or not the applicant has the intent to commit criminal or terrorist acts after entering the United States.

The Extreme Vetting Initiative tasked with implementing (among things) this feature of Trump’s executive order, included the following in its statement of objectives:

ICE must develop processes that determine and evaluate an applicant’s probability of becoming a positively contributing member of society as well as their ability to contribute to national interests in order to meet the EOs outlined by the President.

A background document on the initiative outlined requirements, including the exploitation of publicly available information found on blogs, social media, academic websites, and other online sources. The same backgrounder went on to state that the goal was for the initiative to generate 10,000 investigatory leads each year.

Earlier this year dozens of computer scientists, mathematicians, and engineers wrote a letter to then-Acting Secretary of Homeland Security Elaine Duke, outlining the numerous issued associated with the Extreme Vetting Initiative. As I noted in November last year, the letter highlighted that ICE’s proposal would likely be discriminatory as well as unreliable. From the letter:

According to its Statement of Objectives, the Extreme Vetting Initiative seeks to make “determinations via automation” about whether an individual will become a “positively contributing member of society” and will “contribute to the national interests.” As far as we are aware, neither the federal government nor anyone else has defined, much less attempted to quantify, these characteristics. Algorithms designed to predict these undefined qualities could be used to arbitrarily flag groups of immigrants under a veneer of objectivity.

Inevitably, because these characteristics are difficult (if not impossible) to define and measure, any algorithm will depend on “proxies” that are more easily observed and may bear little or no relationship to the characteristics of interest. For example, developers could stipulate that a Facebook post criticizing U.S. foreign policy would identify a visa applicant as a threat to national interests. They could also treat income as a proxy for a person’s contributions to society, despite the fact that financial compensation fails to adequately capture people’s roles in their communities or the economy.

For more information on the Extreme Vetting Initiative, including original ICE documents, visit the Brennan Center for Justice’s resource page.