Developing listening test is compulsory to measure students listening comprehension or practice their listening skill. Pre-service teachers at English Education Department of UMY had a training in developing tests to develop their competences to be an assessor for their future career. This research are aimed to find types of questions used by the pre-service teachers at EED of UMY, the obstacles that pre-service teachers of EED of UMY faced in developing listening test and the solutions that they made to deal with the obstacle. To collect the data, the researcher conducted the research qualitatively; an interview with 5 preservice teachers at EED of UMY batch 2013 was conducted as well. The interview was about 11-15 minutes for each participant. Based on the data, the participants were used multiple choice, fill in the blank, true and false, and matching question types. Moreover, the obstacles that pre-service teachers faced are finding the materials, test text types, speed of speech, accent, noises, and validity reliability. Besides, checking content guidelines, improving listening material, editing audio recordings, and try out are the strategies that pre-service teachers used to overcome the obstacles.