Analytical and geometrical properties of statistical connections in information geometry