Oompa Loompas were actually just dwarves that Wonka held hostage and painted orange. He forced the other dwarves to mine jewels for him or he'd have the Oompa Loompas tortured and murdered in one of his death machines. The chocolate factory was just one big money laundering scheme.