Novikov algebras were introduced in connection with the Poisson brackets of hydrodynamic type and Hamiltonian operators in the formal variational calculus. The commutator of a Novikov algebra is a Lie algebra in which there exists a special affine structure (connection with zero curvature and torsion) defined by the Novikov algebra. For ensuring the consequences for the group structure, we need consider the more intrinsic connections defined by Novikov algebra structures, that is, the connections which are adapted to the automorphism tructure of a Lie group. The resultant Novikov algebra is called a derivation algebra which satisfies every left multiplication operator is a derivation of its sub-adjacent Lie algebra. In this paper, we commence a study of the Novikov derivation algebras and as a consequence, we can construct Novikov algebras on some 2-solvable Lie algebras.