Fit is slang for someone who looks attractive. For saying like “I’m fitter than you” = “I’m more attractive than you”.