The early days of the border patrol operated under the Department of Labor, where border and customs agents had the discretion to decide who could enter the country legally, subjecting migrants to arbitrary requirements at their discretion. Most early border patrolmen were white supremacists, putting non-white migrants at a disadvantage.