On 8 October 2020, Warburton signed for National League side Yeovil Town on loan until the end of the 2020–21 season.[7]
On 11 May 2021 it was announced that he would leave Northampton when his contract expired at the end of the season.[8]
On 1 August 2021, Warburton was announced to have signed for National League side F.C. Halifax Town on a free transfer.[9] He scored his first goal for the club in their 3–0 National League win over Stockport County.[10] He was awarded the National League Player of the Month award for December 2021 after three goals across the month.[11] On 21 May 2023, he featured as a substitute in the 2023 FA Trophy Final as Halifax defeated Gateshead to lift the trophy for a second time, proving to be his final appearance for the club.[12]