The 24-year-old has agreed a two-year deal with the O’s, and arrives at the Matchroom Stadium after leaving fellow National League side Woking.
Having started out in the youth ranks at Crystal Palace, Caprice signed his first professional contract with the Eagles in 2011, though was unable to make the breakthrough there and signed for Blackpool a year later.
The defender was unable to make his mark at Bloomfield Road however, as Caprice found his opportunities limited before making his professional debut whilst on loan at Dagenham & Redbridge in December 2012.
The 2013-14 campaign also saw the defender head out on loan, first to Scottish side St Mirren before ending the season at Tamworth.
Following two seasons at Blackpool, Caprice then completed a switch to Lincoln City in August 2014, and quickly became a consistent figure for the Imps as he racked up a total of 37 appearances throughout the 2014-15 season.
After impressing during that season at Sincil Bank, the defender found himself on the move again by agreeing a pre-contract with Woking ahead of the 2015-16 campaign. Handed the number two shirt, the pacey full back wasted little time in making the right back spot his own, and during his two seasons with the Cards made a total of 89 appearances.