In recent years and according to modern transportation development, rail vehicles are manufactured lighter to achieve higher speed and lower transportation costs. On the other hand, weight reduction of rail vehicles leads to increase the structural vibration. In this study, Active Vibration Control of a rail vehicle using piezoelectric elements is investigated. The optimal control employed as the control approach regard to the first two modes of vibration. A simplified Car body structure is modeled in Matlab using the finite element theory by considering six DOF beam element and then the Eigen functions and mode shapes are derived. The surface roughness of different classes of rail tracks have been obtained using random vibration theory and applied to the secondary suspension as the excitation of the structure; Then piezoelectric mounted where the greatest moments were captured. The effectiveness of Piezoelectric in structural vibrations attenuation of car body is demonstrated through the state space equations and its effect on modal coefficient.