At a hearing Monday, U.S. District Judge David Bunning turned down a request to delay the proceedings, and said trial would begin Nov. 27.
Federal agents in May raided several Fischer Homes work sites and arrested nearly 100 people, most of them Mexican or Central American nationals.
Five Fischer Homes supervisors were charged with conspiring to harbor illegal immigrants.