One of the forms to evaluate the students’ ability is test. In order to measure accurately, the lecturers should use a good test. Validity is the most important consideration in test evaluation. The concept refers to the appropriateness, meaning, and usefulness of the specific inferences made from the score. As an institution which serves all students of UMY, Pusat Pelatihan Bahasa also uses a test to evaluate students’ achievement in learning English. The test used there is Progress test. The objective of this research is to explore the validity issues of the progress test administered at PPB UMY in terms of content validity and concurrent validity. Therefore, the reserch question is then formulated as “how is the validity of the progress test administered at PPB UMY in terms of content validity and concurent?” Relevant to the aims of the research, this study employed mixed methods of both qualitative and quantitative research design. It is quantitative in a way that it analyses the concurrent validity of the progress test at PPB UMY. It is research that analyzes the data form written sources. Moreover, on the other validity measurements, it applied quantitative research design. The research was conducted at Pusat pelatihan Bahasa Universitas Muhammadiyah Yogyakarta. The data collection method applied expert judgement and documentation. In the expert judgement, the researcher ask for the test result of English progress test level 1 of Pusat Pelatihan Bahasa UMY and asked for the question sheet and the answer key to be analyzed. While the documentations means collecting the files or data of related information that are necessary. There are some data collected by the researcher such as 62 English progress test questions and answer sheets of students’ level 1, the answers key, English syllabus and English vi module. In analizing the data, the researcher analyzed the Content Validity, Construct, Concurrent, and face Validity, Analysis of the level of validity. The findings of the research show that the validity is not valid. There are some test items, which have no compatibility with the indicator but they could represent the skills that would be reached. The validity of English progress test at Pusat Pelatihan Bahasa Universitas Muhammadiyah Yogyakarta has good validity around 80% from the characteristic of a good test according to the two categories of validities that have been analyzed by using existing document and English progress test items.