The aim of this paper is to assess the quality of the ranking of institutions obtained with multilevel techniques in presence of different model misspecifications and data structures. Through a Monte Carlo simulation study, we find that it is quite hard to obtain a reliable ranking of the whole effectiveness distribution, while, under various experimental conditions, it is possible to identify institutions with extreme performances. Ranking quality increases with increasing Intra Class Correlation coefficient and/or overall sample size. Furthermore, multilevel models where the between and within cluster components of first-level covariates are distinguished, perform significantly better than both multilevel models where the two effects are set to be equal and the fixed effect models.

Assessing the quality of institutions rankings obtained through multilevel linear regression models

Arpino B.;
2010

Abstract

The aim of this paper is to assess the quality of the ranking of institutions obtained with multilevel techniques in presence of different model misspecifications and data structures. Through a Monte Carlo simulation study, we find that it is quite hard to obtain a reliable ranking of the whole effectiveness distribution, while, under various experimental conditions, it is possible to identify institutions with extreme performances. Ranking quality increases with increasing Intra Class Correlation coefficient and/or overall sample size. Furthermore, multilevel models where the between and within cluster components of first-level covariates are distinguished, perform significantly better than both multilevel models where the two effects are set to be equal and the fixed effect models.
2010
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11577/3485480
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact