Young grew up in Savannah, Georgia, and Richmond, Virginia; he was originally a trumpeter, but by his professional debut in 1928 he had switched to trombone.
Young växte upp i Savannah, Georgia och i Richmond, Virginia, och var ursprungligen trumpetare, men vid sin professionella debut 1928, hade han bytt till trombon.