A Birmingham, Alabama native with nine siblings, Yarbrough moved to Southeast Texas in 1970 as general manager for American Valve and Hydrant Manufacturing, a subsidiary of a Birmingham-based company. While leading American Valve, Yarbrough also remained engaged in community issues like economic development, labor relations and education through the Beaumont Chamber of Commerce. Yarbrough received several honors from the business community, including being named the chamber's Businessman of the Year in 1981 and Volunteer of the Year in 1985.