Indicadores e Avaliação de Desempenho nas Universidades Públicas Portuguesas: contributo para um problema ainda mal resolvido
Indicadores e Avaliação de Desempenho nas Universidades Públicas Portuguesas: contributo para um problema ainda mal resolvido
Índice
1. Introdução
2. Indicadores de desempenho e universidades públicas – concetualização, contextualização e tendências
3. Indicadores de desempenho – prós e contras
4. Metodologia
5. Resultados e principais conclusões
5. Considerações finais
A importância da avaliação de desempenho e a sua divulgação, quer dentro da organização, quer externamente para efeitos de accountability, é, atualmente, uma convicção no sector público. Porém, por motivos de diversa ordem, verifica-se, um pouco por todo o mundo, alguma incipiência e atraso na implementação de sistemas de indicadores qualitativos e, sobretudo, quantitativos que permitam dar uma imagem completa do desempenho das instituições e ser úteis à sua gestão. Considerando a importância das universidades públicas para o Estado e para a sociedade portuguesa, bem como a complexidade da sua estrutura organizacional e, consequentemente, da sua gestão, desenvolveu-se um estudo empírico que teve como objetivo, entre outros, avaliar a importância atribuída a estes instrumentos de gestão e a sua integração no sistema de controlo interno, bem como a obtenção de um referencial para a implementação deste tipo de instrumentos. Deste estudo, baseado em questionários e entrevistas estruturadas aplicados àquelas entidades complementados com pesquisa nas respetivas páginas web da informação disponível, concluiu-se que apesar da consciência generalizada da importância dos indicadores de gestão a sua existência, num sistema devidamente estruturado, é ainda muito incipiente.
José Biléu Ventura
é Professor Auxiliar do Departamento de Gestão da Universidade de Évora, Portugal, e membro do CEFAGE (Centro de Estudos e Formação Avançada em Gestão e Economia). A sua investigação foca-se predominantemente sobre áreas da gestão pública e do controlo interno; adicionalmente investiga e ensina nas áreas da contabilidade e da auditoria. Nos últimos três anos (mai.2013 a mai.2016) fez parte do Conselho de Administração, como Vogal Executivo, de uma empresa pública do sector da saúde. É também membro da
Ordem dos Contabilistas Certificados.
José Biléu Ventura
is an assistant professor at the management department of University of Évora, Portugal, and member of CEFAGE (Center for Advanced Studies in Management and Economics). His work focuses mainly on public management and internal control; additionally he works and teaches accounting and auditing matters. He was in the last three years (May.2013 to May.2016) CEO of a public company operating in Portuguese health sector. He is also member of Ordem dos Contabilistas Certificados (Portuguese regulatory body of Certified Accountants).
Abbey, C. (2007). What can Performance Indicators do for Higher Education Institutions? A US Perspective. In B. Conraths & A. Trusso (Eds.), Managing the University Community: Exploring Good Practice (pp. 70-74). Belgium: EUA Case Studies.
Arnaboldi, M., & Azzone, G. (2010). Constructing performance measurement in the public sector. Critical Perspectives on Accounting, 21(4), 266-282.
Arnaboldi, M., Lapsley, I., & Steccolini, I. (2015). Performance Mangement in the Public Sector: The Ultimate Challenge. Financial Accountability & Management, 31(1), 1-22.
Bauer, M., & Kogan, M. (1997). Evaluation Systems in the UK and Sweden: successes and difficulties. European Journal of Education, 32(2), 129-143.
Bevan, G., & Hood, C. (2006). What’s Measured is What Matters: Targets and Gaming in the English Public Health Care System. Public Administration, 84(3), 517-538.
Bird, S. M., Cox, D., Farewell, V. T., Goldstein, H., Holt, T., & Smith, P. C. (2005). Performance Indicators: Good, Bad, and Ugly. Journal of the Royal Statistical Society. Series A (Statistics in Society), 168(1), 1-27.
Boer, H. F., Enders, J., & Liudvika, L. (2007). Public Sector Reform in Dutch Higher Education: The Organizational Transformation of the University. Public Administration, 85(1), 27-46.
Bogt, H. J. (2004). Politicians in search of performance information? – Survey research on Dutch aldermen’s use of performance information. Financial Accountability & Management, 20(3), 221-252.
Bouckaert, G., & Halligan, J. (2008). Managing Performance, International comparisons, London: Routledge.
Boyne, G. A. (1998). Public Services Under New Labour: Back to Bureaucracy? Public Money & Management, 18(3), 43-50.
Boyne, G. A. (2002). Concepts and Indicators of Local Authority Performance: An Evaluation of the Statutory Frameworks in England and Wales. Public Money & Management, 22(2), 17-24.
Brignall, S., & Modell, S. (2000). An institutional perspective on performance measurement and management in the ‘new public sector’. Management Accounting Research, 11(3), 281-306.
Broadbent, J. (2007). If You Can’t Measure It, How Can You Manage It? Management and Governance in Higher Educational Institutions. Public Money & Management, 27(3), 193-198.
Bruijn, H. (2007). Managing Performance in the Public Sector, 2nd Edition. London: Routledge. Burke, J. C., & Minassians, H. P. (2002a). The New Accountability: From Regulation to Results. New Directions for Institutional Research, 116, 5-19.
Burke, J. C., & Minassians, H. P. (2002b). Performance Reporting: Promises, Problems, and Prospects. New Directions for Institutional Research, 116, 115-127.
Buschor, E. (2013). Performance Management in the public sector: Past, current and future trends.Tékhne, 11, 4-9.
Cave, M., Kogan, M., & Hanney, S. (1989). Performance Measurement in Higher Education. Public Money & Management, 9(1), 11-16.
Cave, M., Hanney, S., & Henkel, M. (1995). Performance Measurement in Higher Education – Revisited. Public Money & Management, 15(4), 17-23.
Cave, M., Hanney, S., Henkel, M., & Kogan, M. (1997). The Use of Performance Indicators in Higher Education, the challenge of the quality movement, 3rd Edition. London: Jessica Kingsley Publishers.
Christensen, M. (2004). Accounting by words not numbers: the handmaiden of power in the academy. Critical Perspectives on Accounting, 15(4/5), 485-512.
Cohen, M. D., March, J. G., & Olsen, J. P. (1972). A Garbage Can Model of Organizational Choice. Administrative Science Quarterly, 17(1), 1-25.
Cook, T. J., Vansant, J., Stewart, L., & Adrian, J. (1995). Performance Measurement: Lessons Learned for Development Management. World Development, 23(8), 1303-1315.
Coutinho, C. (2011). Metodologia de Investigação em Ciências Sociais e Humanas: Teoria e Prática. Coimbra: Almedina
Cutt, J., Trotter, L., & Lee, C. E. (1993). Performance Management and Accountability in Canadian Universities: Making a start in the area of teaching. Financial Accountability & Management, 9(4), 255-266.
Cutt, J., Bragg, D., Hannis, C., Lalani, A., Murray, V., & Tassie, B. (1997). Do You Have Enough Cost Information to Make Good Decisions? Nonprofit World, 15(6), 41-48.
Deem, R. (1998). ‘New Managerialism’ and Higher Education: the management of performances and cultures in universities in the United Kingdom. International Studies in Sociology of Education, 8(1), 47-70.
Denzin, N. K., & Y. S. Lincoln (2003), “Introduction: The discipline an Practice of Qualitative Research”, em Denzin, N. K., & Y. S. Lincoln (eds.), The Landscape of Qualitative Research – theories and issues, 2.nd edition. Sage, pp. 1-45.
Dull, M. (2009). Results-Model Reform Leadership: Questions of Credible Commitment. Journal of Public Administration Research & Theory, 19(2), 255-284.
Eccles, R. G. (1991). The Performance Measurement Manifesto. Harvard Business Review, 69(1), 131-137.
Epstein, P., Wray, L., & Harding, C. (2006). Citizens as Partners in Performance Management. ICMA Public Management Magazine, 88(10), 18-22.
García-Aracil, A., & Palomares-Montero, D. (2010). Examining benchmark indicator systems for the evaluation of higher institutions. Higher Education, 60(2), 217-234.
Groot, T., & Budding, T. (2008). New Public Management’s Current Issues and Future Prospects. Financial Accountability & Management, 24(1), 1-13.
Harvey, L. (2004). Analytical quality glossary, Quality Research International
Higher Education Statistics Agency (HESA). (2010). Performance indicators in higher education in the UK 2008/09.
Hood, C. (1991). A Public Management for All Seasons? Public Administration, 69(1), 3-19.
Hood, C. (1995). The “New Public Management” in the 1980s: Variations on a Theme. Accounting Organizations and Society, 20(2/3), 93-109.
Hood, C. (2012). Public Management by Numbers as a Performance-Enhancing Drug: Two Hypotheses. Public Administration Review, 72(S1), S85-S92.
Huisman, J., & Currie, J. (2004). Accountability in higher education: Bridge over troubled water?
Higher Education, 48(4), 529-551.
Johnsen, Ǻ. (2005). What Does 25 Years of Experience Tell Us About the State of Performance Measurement in Public Management and Policy. Public Money & Management, 25(1), 9-17.
Johnsrud, L. K. (2002). Measuring the Quality of Faculty and Administrative Worklife: Implications for College and University Campuses. Research in Higher Education, 43(3), 379 – 395.
Kaboolian, L. (1998). The New Public Management: Challenging the Boundaries of the Management vs. Administration Debate. Public Administration Review, 58(3), 189-193.
Kelly, G., Mulgan, G., & Muers, S. (2002). Creating Public Value: An analytical framework for public service reform. UK: Cabinet Office Strategy Unit.
Kelly, J. M. (2005). The Dilemma of the Unsatisfied Consumer in a Market Model of Public Administration. Public Administration Review, 65(1), 79-84.
Lapsley, I., & Miller, P. (2004). Transforming Universities: The Uncertain, Erratic Path. Financial Accountability & Management, 20(2), 103-106.
Lapsley, I. (2008). The NPM Agenda: Back to the Future. Financial Accountability & Management, 24(1), 77-96.
Leitch, M. (2008). Intelligent Internal Control and Risk Management: Designing High-Performance Risk Control Systems. Hampshire, England: Gower Publishing.
Likierman, A. (2006). Measuring Service. Business Strategy Review, 17(2), 75-79.
Maingot, M., & Zeghal, D. (2008). An Analysis of Voluntary Disclosure of Performance Indicators by Canadian Universities. Tertiary Education and Management, 14(4), 269-283.
Melo, A.I., Sarrico, C.S., & Radnor, Z. (2008). The effect of performance management systems on the governance of universities: the case of an English university, comunicação apresentada na Rotterdam Conference 2008, Erasmus University, The Netherlands.
Middleton, C. (2000). Models of State and Market in the ‘Modernisation’ of Higher Education. British Journal of Sociology of Education, 21(4), 537-554.
Modell, S. (2001). Performance measurement and institutional processes: a study of managerial responses to public sector reform. Management Accounting Research, 12(4), 437-464.
Neave, G. R. (1988). On the Cultivation of Quality, Efficiency and Enterprise: An Overview of Recent Trends in Higher Education in Western Europe. European Journal of Education, 23(1/2), 7-23.
Neves, A. (2002). Gestão na Administração Pública. Cascais: Ed. Pergaminho.
Pettersen, I.-J., & Solstad, E. (2007). The Role of Accounting Information in a Reforming Area: A Study of Higher Education Institutions. Financial Accountability & Management, 23(2),
Pollitt, C. (2006). Performance Management in Practice: A Comparative Study of Executive Agencies. Journal of Public Administration Research and Theory, 16(1), 25-44.
Pollitt, C. (2008). ‘Moderation in All Things’: Governance Quality and Performance Measurement, comunicação apresentada em The Structure and Organization of Government (SOG) Meeting, Gotemburgo, Suécia.
Sampieri, R. H., Collado, C. H., & Lucio, P. B. (2006). Metodologia de Pesquisa, 3ª edição. São Paulo: McGraw Hill.
Saravanamuthu, K., & Tinker, T. (2002). The University in the New Corporate World. Critical Perspectives on Accounting, 13(5/6), 545-554.
Sarrico, C. S., & Dyson, R.G. (2000). Using DEA for planning in UK universities – an institutional perspective. Journal of the Operational Research Society, 51(7), 789-800.
Sarrico, C. S., Teixeira, P. N., Rosa, M. J., & Cardoso, M. F. (2009). Subject mix and productivity in Portuguese universities. European Journal of Operational Research, 197(1), 287-295.
Sarrico, C. S. (2010a). Indicadores de desempenho para apoiar os processos de avaliação e acreditação de cursos. Gabinete de Estudos e Análise A3ES.
Sarrico, C. S. (2010b). On Performance in Higher Education: Towards performance governance. Tertiary Education and Management, 16(2), 145-158.
Smith, P. (1993). Outcome-related Performance Indicators and Organizational Control in the Public Sector. British Journal of Management, 4(3), 135-151.
Stewart, J., & Walsh, K. (1994). Performance Measurement: When Performance can Never be Finally Defined. Public Money & Management, 14(2),
Talbot, C. (2005). Performance Management. In E. Ferlie, L. E. Lynn, & C. Pollitt (Eds,), The Oxford Handbook of PUBLIC MANAGEMENT (pp. 7-26). Oxford: Oxford University Press.
Taylor, J. (2001). The Impact of Performance Indicators on the Work of University Academics: Evidence from Australian Universities. Higher Education Quarterly, 55(1), 42-61.
Thiel, S., & Leeuw, F. L. (2002). The Performance Paradox in the Public Sector. Public Performance & Management Review, 25(3), 267-281.
Trow, M. (2005). The decline of diversity, autonomy and trust in post-war British higher education: an American perspective. Perspectives: Policy and Practice in Higher Education, 9(1), 7-11.
Ventura, J. (2012). Governação da Universidade Pública Portuguesa – Modelização de uma resposta às necessidades de informação e controlo ao nível administrativo-financeiro. Dissertação de doutoramento, Instituto de Investigação e Formação Avançada, Universidade de Évora. 449 pp.
Vilalta, J. (2001). University policy and coordination systems between Governments and Universities: The experience of the Catalan University System. Tertiary Education and Management, 7(1), 9- 22.
Wholey, J. S., & Hatry, H. P. (1992). The Case for Performance Monitoring. Public Administration Review, 52(6), 604-610.
Yang, K., & Holzer, M. (2006). The Performance-Trust Link: Implications for Performance Measurement. Public Administration Review, 66(1), 114-126.
Avaliação de Desempenho, Controlo Interno, Indicadores, Universidades Públicas Portuguesas.
