Currently there are still many phenomena on bullying committed by group of teenager especially those who study at school or at dormitory-based Madrasah. This research was aimed at identifying the self-concept of bully victims after being bullied when studying at Madrasah Mu’alimin Muhammadiyah Yogyakarta or during their stay at the dormitory. This research used qualitative approach. Data gathering technique used were observation, in-depth interview, and documentation. Whereas data was analyzed using descriptive qualitative method. In this research, the data was not presented as numeric data but instead those data was compiled through various written elaboration from numerous reputable sources. Therefore, this analysis was aimed at elaborating and describing the condition of bully victims and the influencing factors of bullying. Researcher took as many as 3 respondents and the results were as follow: 1) there were several types of bullying happened at Madrasah Mu’alimin Muhammadiyah Yogyakarta, such as verbal bullying, physical bullying and object destruction. 2) the influencing factors of bullying were character, personality and family; those factors were highly influencing students to be bully victims. 3) self-concept built by bully victims were vary; two out of three subjects had negative self-concept while one out of three subjects had positive self-concept. 4) when every victim had their respective self-concept, they will adapt to the environment of dormitory and school. However, when victims had negative self-concept, they will encounter difficulty in adapting to school and dormitory.