The deterioration of ballast structure due to large dynamic wheel loads is inevitable and lead to the high cost maintenance. Conventional railway structures needs to be renewed to increase its ability in distributing the load. This research used the scrap rubber in the ballast mixture in order to increase the service life and durability of ballast layer, to optimize the utilization of tires waste, and to decrease the construction and maintenance cost of the railway track structures. The compression test by Universal Testing Machine (UTM) was used in this research. The purpose of this research is to analyze the elastic modulus and durability of the ballast mixture modification. The results showed that the elastic modulus of sample 1 (ballast) was 10,10 MPa and 5,38 MPa with the abrasion was 162,1gr or 3,24%. Moreover, the elastic modulus of sample 2 (ballast with 10% of uniformly sized scrap rubber) was 5,74 MPa and 3,68 MPa with the abrasion was 54,2gr or 1,08%. While the elastic modulus of sample 3 (ballast with 10% of continuously graded scrap rubber) was 2,70 MPa and 1,62 MPa with the abrasion was 50,1gr or 1%. Modification of the ballast layer using the scrap rubber could decrease the elastic modulus. However, the scrap rubber utilization would increase the resilience of ballast materials.