Arguably one of the more challenging positions for the reasons you've just stated.
Honestly growing up the fullback position was always seen as the one for failed wingers or not good enough CB's.. Just hide the weakest link there lol.
The importance of fullbacks have definitely changed though and more are expected out of them nowadays. A genuinely great fullback adds so much to a team.