After a brief spell with Roy Eldridge's band, he joined Red Saunders' band in New York in September 1946. The band later took up residency at Chicago's Club DeLisa, and Kilbert would remain with the Saunders band until January 1952, when he left to form his own band.
In 1954, he was a member of the Horace Henderson big band and in 1955 and 1956, he participated in a series of "battles of the saxes" with Tom Archia at the C&C Lounge.
In 1960, having recorded the previous year for bandleader Quincy Jones, featuring as soloist on some of the tracks, he toured Europe with Jones' big band[3] (with fellow altoist Phil Woods).[4]