Having grown up in a musical family, Joe was given music lessons from a very young age. He started out playing the piano but later progressed to classical violin, which he formally studied until he was 18. While he was a teenager, Joe discovered jazz through learning the drums and the guitar and was given the opportunity to play in the Southampton Youth Jazz Orchestra, where he performed alongside such musicians as Courtney Pine and Ian Shaw as well as working with members of the Jazz at Lincoln Center Orchestra. He then continued to study jazz at Middlesex University, where he began to play the double bass, ultimately earning his Bachelors.