Nosaj and Sebastian formed New Kingdom after meeting at a New York City clothing store where they both worked. Though both are fans of hip-hop, Sebastian spent some time in hardcore punk bands, while Nosaj was primarily influenced by Curtis Mayfield. They started recording '70s-influenced rap in 1987 but couldn't afford to continue making records. Later, however, engineer Scott Harding heard some demos and introduced the duo to Gee Street Records. After two years on a demo deal, they were officially signed in 1992. Heavy Load appeared one year later, while Paradise Don't Come Cheap surfaced in 1996.