The compatibility between a fiber optical sensor and concrete structure in the optic fiber smart concrete is studied. The methods of improving the compatibility are proposed based on theory analysing, and a novel fiber optical sensor was developed. The experimental results show that the novel structure of fiber optical sen-sor and the scheme of the protecting layer of epoxy resin bed composite not only enable the sensor to be applied in strict environment, but also can monitor the beginning propagation and breaking of concrete cracks. The results also indicate that the sensor will maintain its properties in the case of large deformation and that it has the high compatibility with concrete structure and can meet special needs of the intelligent materials and structure.