Commenced in January 2007
Frequency: Monthly
Edition: International
Paper Count: 30135
The Role of General Councils in the Supervision of the Organizational Performance of Higher Education Institutions

Authors: Rodrigo T. Lourenço, Margarida Mano

Abstract:

Higher Education Institutions (HEI), and other levels of Education, face important challenges. One of the most relevant one is the ability to adapt to a society that is changing over time, whilst guarantying levels of training that do not merely react to such changes. Thus, interacting with society, particularly with surrounding communities and key stakeholders, has become an essential requirement for the sustainability of these institutions. One of the formal mechanisms implemented in European educational institutions has been the design of organizational structures that include a top governance body sharing its constitution with both internal members, students and external members. Such frame holds the core mission of involving communities in the governance of educational institutions, assuming, both strategic decision-making functions, with the approval of the institutions’ strategic plans, and a supervision function, approved by activity reports. It also plays an essential role in the life of institutions by holding the responsibility of electing its top executives. In Portugal, it has been almost a decade since the publication of RJIES, the legal framework of Higher Education, such bodies being designated by General Councils. Thus, one may highlight that there has been a better understanding of the operative process of these bodies, as well as their added value to the education system. It has also been possible to analyse the extent to which their core mission has been fulfilled and to understand its growing relevance, particularly regarding the autonomy of institutions. This article aims to contribute to this theme by presenting the results of a study on the role of these bodies in the governance of Public Portuguese HEI, with a special focus on the supervisory competence of organizational performance. Through questionnaires made to board members and interviews with chairpersons of the bodies and top managers of the institutions, it was possible to conclude that there is a high concern with the connections to the external environment. However, regarding organizational performance and the role of the Council as a supervisor of that performance, the activity of the bodies has fallen short of what would be expected. Several reasons may be identified. It is important to emphasize the importance of the profile of the external members and the relationship between the organ’s standard functioning and the election of the head of the institution.

Keywords: Governance, stakeholders, supervision, organizational performance.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1315711

Procedia APA BibTeX Chicago EndNote Harvard JSON MLA RIS XML ISO 690 PDF Downloads 354

References:


[1] Rytmeiter, Catherine, Governing University: Perceptions and practice of governance and managements roles, 2009, Tertiary Education and Management, pp. 137-156.
[2] Cheung, Hoi Yan e Chan, Alex Wing Ho, Education and competitive economy: how do cultural dimensions fit in?, 2010, Higher Education, Vol. 59, pp. 525-541.
[3] ENQA, Quality Assurance of Higher Education in Portugal. Helsinki, European Association for Quality Assurance in Higher Education, 2006.
[4] EUA, Portuguese Higher Education: A view from the outside, Brussels, European University Association, 2013.
[5] Cardoso, Sónia Cristina Miranda, Representações Estudantis da Avaliação das Instituições de Ensino Superior Público, Aveiro, Tese de Doutoramento em Ciências Sociais, 2009.
[6] OCDE, Reviews of National Policies for Education - Tertiary Education in Portugal. Paris, Organisation de Coopération et de Développement Economiques, 2006.
[7] Mano, Margarida e Marques, Maria Conceição da Costa Novos Modelos de Governo na Universidade Pública em Portugal, Rio de Janeiro, 2012, Revista de Admistração Pública, pp. 721-36.
[8] Marques, Maria Conceição da Costa, Modelos de Governo e Gestão Universitária, 2012, Rede Internacional de Gênero e Comércio.
[9] Gomes, José Ferreira, Aplicação do RJIES: Considerações sobre o governo universitário. (Online) 7 de Fevereiro de 2008. https://www.google.pt/webhp?sourceid=chrome-instant&ion=1&espv=2&ie=UTF-8#q=Aplica%C3%A7%C3%A3o+do+RJIES%3A+Considera%C3%A7%C3%B5es+sobre+o+governo+universit%C3%A1rio.
[10] Erkkilä, Tero e Piironen, Ossi, Shifting fundaments of European higher education governance: Competition, ranking, autonomy and accountability, 2014, Comparative Education, pp. 177–191.
[11] OCDE, Changing Patterns of Governance in Higher Education. Education Policy Analysis. Paris, Organisation de Coopération et de Développement Economiques, 2003, pp. 59-78.
[12] Eurydice, A Governança do Ensino Superior na Europa. Lisboa, Ministério da Educação, 2008.
[13] Kwiek, Marek, Academic Entrepreneurship vs. Changing Governance and Institutional Management Structures at European Universities, Center for Public Policy Studies, 2008, Policy Futures in Education , pp. 757-770.
[14] Clark, Burton R, The higher education system: Academic organization in cross-national perspective. Berkeley and Los Angeles, University of California Press, 1983.
[15] Brennan, John, Burton Clark’s The Higher Education System: Academic Organization in Cross-National Perspective, 2010, London Review of Education, Vols. Vol. 8, No. 3, pp. 229–237.
[16] De Boer, Harry, Huismanb, Jeroen e Meister-Scheyttc, Claudia, Supervision in ‘modern’ university governance: boards under scrutiny. 2010, Studies in Higher Education, pp. 317–333.
[17] Kwiek, Marek, The University and the State in a Global Age. Renegotiating the Traditional Social Contract in Europe?, Knowledge Production in European Universities: States, Markets, and Academic Entrepreneurialism, Frankfurt and New York, Peter Lang, 2013, pp. 107-150.
[18] Magalhães, Antonio, et al, Governance of Governance in Higher Education: Practices and lessons drawn from the Portuguese case. 2013, Higher Education Quarterly, pp. 295–311.
[19] Martin, M. e Talpaert, R. Coordination: continerntal Europe, (book author) B. Clark e G. Neave, The encyclopedia of higher education, Nova York, Pergamon Press, 1992, Vol. 2, pp. 1347-1352.
[20] King, Roger Patrick, Governance and accountability in the higher education regulatory state, 2007, Higher Education , pp. 411–430.
[21] Charlot, Bernard, 1959-1989: Les mutation du discours éducatif, 1989, Éducation Permanent, Vol. 98, pp. 133-149.
[22] Seixas, Ana Maria. Políticas educativas para o ensino superior: A globalização neoliberal e a emergência de novas formas de regulação estatal, (book author) Luíza Cortesão e José A. Correia Stephen R. Stoer, Transnacionalização da educação: da crise da educação à "educação da crise". Porto, Afrontamento, 2001, Vol. VI, pp. 209-239.
[23] Dobbins, Michael e Knill, Christoph, Higher Education Governance and Policy Change in Western Europe: International challenge for historical institutions. Nova Yorque, Palgrave Macmillan, 2014.
[24] Pedrosa, Júlio, et al, Novo Modelo de Governança e Gestão das Insituições de Ensino Superior em Portugal - Análise dos usos do Modelo em Instituições Públicas. Lisboa, Conselho Nacinal de Educação, 2012.
[25] Ismail, Aziah, Burstow, Bob e Abdullah, Abdul Ghani Kanesan, The Evolution Of England And Malaysian School System Governance: An Analysis From The Perspective Of Clark’s Coordination Triangle, 2014, Integrated Journal of British , Vol. 1, pp. 26-42.
[26] De Boer, Harry. Trust, The Essence of Governance, (book author) Alberto Amaral, Glen A. Jones e Berit Karseth, Governing Higher Education: National Perspective on Institutional Governance. Netherlands, Kluwer Academic Publishers, 2002, pp. 43-61.
[27] Amaral, Alberto, A Reforma do Ensino Superior Português, Lisboa, Conselho Nacional de Educação, 2007. Políticas de Ensino Superior - Quatro Temas em Debate. pp. 17-38.
[28] Essex Report, Workshop on the Principles of Sustainability in Higher Education. Massachusetts : Center for Environmental Management, 1995.
[29] Calder, Wynn e Clugston, Richard M, History and Definitions of Higher Education for Sustainable Development, Association of University Leaders for a Sustainable Future, (Online) 2002. http://www.ulsf.org/dernbach/history.htm#35.
[30] Calder, Wynn e Clugston, Richard M, Progress Toward Sustainability in Higher Education, 2003, Environmental Law Reporter: News & Analysis, pp. 10003-10023.
[31] European Council, Conclusões da Presidência do Conselho Europeu de Lisboa. Lisboa, 2000.
[32] European Commission, Mobilising the brainpower of Europe: enabling universities to make their full contribution to the Lisbon Strategy. Brussels, 2005.
[33] OCDE, Understanding the Regional Contribution of Higher Education Institutions. Paris, Organisation de Coopération et de Développement Economiques, 2007.
[34] Schubert, Torben e Kroll, Henning, Universities’ effects on regional GDP and unemployment: The case of Germany, 2014, Papers in Regional Science, pp. 1-23.
[35] Teixeira, Pedro, et al, Concorrência e Diversificação Espacial no Ensino Superior Europeu: Uma comparação do Contributo dos Setores Público e Privado, (book author) António Caleiro, Carlos Vieira, Isabel Vieira, Mara da Saudade Baltazar Conceição Rego, Redes de Ensino Superior. Évora : Universidade de Évora, 2013, pp. 47-69.
[36] Vught, Frans van, Diversity and Differentiation in Higher Education Systems, Cape Town, 2007, CHET anniversary conference .
[37] Bleiklie, Ivar, Diversification of higher education systems, (book author) UNESCO, Diversification of Higher Education and the Changing Role of Knowledge and Research. Paris, United Nations Educational, Scientific and Cultural Organization, 2004, pp. 16-39.
[38] Pedrosa, Julio e Queiró, João Filipe, Governar a Universidade Portuguesa, Fundação Calouste Gulbenkian, Lisboa, 2005.
[39] Neave, Gary, Institutional Autonomy 2010–2020. A Tale of Elan - Two steps back to make one very Large Leap Forward, (book author) J. Huisman e B. Stensaker B. M. Kehm, The European Higher Education Area: Perspectives on a Moving Target, Rotterdam, Sense Publishers, 2009, pp. 3–22.
[40] Trow, Martin, Trust, Markets and Accountability in Higher Education: A Comparative Perspective, 1996, Higher Education Policy, pp. 309-324.
[41] Kallison, James M. e Cohen, Philip, A New Compact for Higher Education: Funding and Autonomy for Reform and Accountability, 2010, Innov High Educ, pp. 37-49.
[42] Hicks, Diana e Katz, J. Sylvan, Equity and Excellence in Research Funding, 2011, Minerva, pp. 137-151.
[43] Cerdeira, Maria Luisa Machado, O Financiamento do Ensino Superior Português, Lisboa, Faculdade de Psicologia e de Ciências de Educação da Universidade de Lisboa, 2008.
[44] Franz Strehl, Sabine Reisinger, Michael Kalatschan, Funding Systems and their Effects on Higher Education Systems, Paris, OCDE, 2006.
[45] Aarrevaara, Timo e Berg, Elisabeth, Higher Education and Research in Academy – Who Should Pay? Lulea, Luleå University of Technology, 2014.
[46] Frolich, Nicoline, Kalpazidou Schmidt, Evanthia e Rosa, Maria J, Funding Systems for Higher Education and Their Impacts on Institutional Strategies and Academia: A Comparative Perspective. 2010, International Journal of Educational Management, pp. 7-21 .
[47] Salter, Brian e Tapper, Ted, The Politics of Governance in Higher Education: the Case of Quality Assurance, 2000, Political Studies, pp. 66–87.
[48] Sá, Patrícia Moura e e Fernandes, Olívia, Modernização administrativa e gestão da qualidade: um estudo empírico nos municípios portugueses, 2008, Notas Económicas, pp. 57-80.
[49] Borges, Carla Oliveira, Rosa, Maria João e Sarrico, Cláudia S, Implementação da ISO 9001 no Ensino Superior, 2011, TMQ Qualidade: A qualidade numa prespetiva multi e interdisciplinar, pp. 275-300.
[50] Magalhães, António M, A Identidade do Ensino Superior: a Educação Superior e a Universidade, 2006, Revista Lusófona de Educação, pp. 13-40.
[51] Santos, Boaventura Sousa, A Universidade no Século XXI: Para uma reforma democrática e emancipatória da Universidade, São Paulo, Cortez, 2004.
[52] Santiago, Paulo, et al, Tertiary Education for the Knowledge Society, Volume 1, Paris, Organisation de Coopération et de Développement Economiques , 2008.
[53] Mano, Margarida, Proposal for a Governance Decision-Making Model in a Portuguese Public University (PPU), Southampton, University of Southampton, 2007.
[54] De Boer, Harry, Who'a afraid of Red, Yellow and Blue: The colourful world of managements reforms, (book author) Alberto Amaral, V. Lynn Meek e Ingvild M. Larsen, The Higher Education Manegerial Revolution. Dordrecht, Kluwer Academic Publishers, 2003, pp. 89-108.
[55] Santos, Sérgio Machado dos, Os Novos Enquadramentos do Ensino Universitário em Portugal, Vila Nova de Famalicão, 2005. Encontros de Outono.
[56] European Comission, Realizar a Agenda da Modernização das Universidades: Ensino, investigação e inovação, Bruxelas, 2006.
[57] Hunt, Carl M., et al, Strategic planning for private higher education. Nova Iorque, Haworth Press, 1997.
[58] Stoner, James A. F. e Freeman, R. Edward, Administração. Rio de Janeiro, Prentice Hall, 1992.
[59] Johnson, H. Thomas e Kaplan, Robert S, The Rise and Fall of Management Accounting, 1987, Management Accounting, pp. 22-29.
[60] Kennerley, Mike e Neely, Andy, Measuring performance in a changing business environment, 2003, International Journal of Operations & Production Management, pp. 213-229.
[61] Otley, David, Performance management: a framework for management control systems research, 1999, Management Accounting Research, pp. 363-382.
[62] Lebas, Michel J, Performance measurement and performance management, 1995, International Journey of Production Economics, p. 23 35.
[63] Lebas, M e Euske, K, A conceptual and operational delineation of performance, (book author) Andy Neely, Business performance measurement: theory and practice,. Cambridge, Cambridge University Press, 2002, pp. 65-79.
[64] Gião, Paulo Roberto, et al, Modelo Sigma Sustentabilidade Flexível: Uma contribuição rumo a organizações sustentáveis, 2010, FACEF Pesquisa, pp. 232-250.
[65] Santos, Luís Paulo Guimarães, Uma Contribuição à Discussão Sobre a Avaliação de Desempenho das Instituições Federais de Ensino Superior: Uma Abordagem da Gestão Econômica, 2000, Revista Contabilidade & Finanças, pp. 86-99.
[66] Fernandes, António, Metodologia de avaliação da eficácia organizacional para o Ensino Superior, 2008, Revista Portuguesa e Brasileira de Gestão, pp. 77-87.
[67] Sarrico, Cláudia S., et al, Assessing Quality and Evaluating Performance in Higher Education: Worlds Apart or Complementary Views?, 2010, Minerva, pp. 35-54 .
[68] Galvão, Henrique Martins, Corrêa, Hamilton Luiz e Alves, José Luiz, Modelo de Avaliação de Desempenho Global para Instituição de Ensino Superior, 2011, Revista de Administração, pp. 425-441.
[69] Miller, Barbara A, Assessing Organizational Performance in Higher Education. São Francisco, Jossey-Bass, 2007.
[70] UNESCO, Constructing an indicator system or scorecard for higher education: A practical guide, (book author) Michaela Martin e Claude Sauvageot, Paris, United Nations Educational, Scientific and Cultural Organization, 2011.
[71] OCDE, In Search of Results: Performance Management Practiques. Paris, Organisation de Coopération et de Développement Economiques, 1997.
[72] OCDE, Education at a Glance: OECD indicators. Paris, Organisation de Coopération et de Développement Economiques, 2015.
[73] OCDE, The State of Higher Education. Paris, Organisation de Coopération et de Développement Economiques: Higher Education Programme (IMHE), 2014.
[74] Neave, Guy, The Evaluative State Institutional Autonomy and Re-Enginnering Higher Education in Western Europe. Nova Iorque, Palgrave Macmillan, 2012.
[75] EUA. Institutional Evaluation Programme. European University Association. (Online) 03 de 11 de 2015. http://www.eua.be/activities-services/institutional-evaluation-programme.aspx.
[76] Cherchye, Laurens, et al, Efficiency and Equity in Private and Public Education: A nonparametric comparison, 2010, European Journal of Operational Research, Vol. 202, pp. 563–573.
[77] Johnes, Jill e Yu, Li, Measuring the research performance of Chinese higher education institutions using data envelopment analysis, 2008, China Economic Review, pp. 679–696.
[78] Grilo, E. Marçal. Rankings e Avaliações. Jornal Público. 6 de 03 de 2010.
[79] Bhatia, Sukhwant S, Quality Control in Christian Higher Education: The importance of evaluating what we do, 2009, Christian Higher Education, pp. 265–279.
[80] Favinha, Marília Evangelina Sota, Reflexões em Torno da Avaliação dos Professores no Ensino Superior Português - O caso da Universidade de Évora. Macau, 2012. 2ª Conferência FORGES - Fórum da Gestão do Ensino Superior nos Países e Regiões de Lingua Portuguesa.
[81] Franco-Santos, Monica, Rivera, Pilar e Bourne, Mike, Performance Management in UK Higher Education Institutions: The need for a hybrid approach. Londres, Leadership Foundation for Higher Education, 2014.
[82] Rabovsky, Thomas M., Using Performance Data to Manage at Public Universities. Madison, 2013. Public Management Research Conference.
[83] Crispim, Sérgio e Lugoboni, Leonardo, Avaliação de desempenho organizacional: Análise comparativa dos modelos teóricos e pesquisa de aplicação nas Instituições de Ensino Superior da Região Metropolitana de São Paulo, 2012, Revista Portuguesa e Brasileira de Gestão, pp. 41-54.
[84] Sarrico, Cláudia S., Videira, Pedro M. e Isabel Machado, Pedro N. Teixeira, The Use of Performance Information in Higher Education Institutions, Lisboa, 2015. CHER 28th Annual Conference.
[85] Mano, Margarida, Roteiro do Plane(j)amento Estratégico: Percursos e Encruzilhadas do Ensino Superior no Espaço da Língua Portuguesa. Coimbra, Imprensa da Universidade de Coimbra, 2015.
[86] Silva, Ascendino F. D, A universidade: conhecimento e desenvolvimento, (book author) Aécio Gomes de Matos, Para que serve a universidade pública? Recife, EdUFPE, 2013, pp. 23-44.
[87] Lourtie, Pedro, Tendências da educação terciária: Diversidade, relevância e qualidade (e rankings), Recife, 2013, 3ª Conferência Forges: Políticas e gestão da educação superior nos países e regiões de língua portuguesa.
[88] Pordata. Alunos estrangeiros matriculados no ensino superior. Pordata. (Online) 19 de 11 de 2014e. http://www.pordata.pt/Europa/Alunos+estrangeiros+matriculados+no+ensino+superior+(ISCED+5+8)-1313.
[89] Shah, Dhawal. MOOCs in 2014: Breaking Down the Numbers. EdSurge. (Online) 26 de 12 de 2014. https://www.edsurge.com/news/2014-12-26-moocs-in-2014-breaking-down-the-numbers.
[90] Mainardes, Emerson Wagner, Alves, Helena e Raposo, Mário, An Exploratory Research on the Stakeholders of a University, 2010, Journal of Management and Strategy, pp. 76-88.
[91] DGEEC, Ciência, Tecnologia e Inovação: Comparações internacionais. Direção-Geral de Estatísticas da Educação e Ciência, (Online) 03 de 06 de 2013. http://www.dgeec.mec.pt/np4/260/.
[92] Bolton, Dianne e Nie, Rui, Creating Value in Transnational Higher Education The Role of Stakeholder Management, 2010, Academy of Management Learning & Education, Vols. 9, nº4, pp. 701–714.
[93] Pordata. Publicações científicas em co-autoria com instituições de outros países: total e por país – Contagem global - Portugal. (Online) 24 de 11 de 2014g. http://www.pordata.pt/Portugal/Publica%C3%A7%C3%B5es+cient%C3%ADficas+em+co+autoria+com+institui%C3%A7%C3%B5es+de+outros+pa%C3%ADses+total+e+por+pa%C3%ADs+%E2%80%93+Contagem+global-1136.
[94] Gibbons, Michael, et al, The new production of knowledge. The dynamics of science and research in comtemporary societies, Londres, Sage, 1994.
[95] Gibbons, Michael, Higher Education Relevance in the 21st Century, Paris, World Bank, 1998, UNESCO World Conference on Higher Education.
[96] Nóvoa, António Sampio, Os desafios da educação superior, Recife, 2013, 3ª Conferencia FORGES: Políticas e gestão da educação superior nos países e regiões de língua portuguesa.
[97] Jongbloed, Ben, Enders, Jurgen e Salerno, Carlo, Higher education and its communities: Interconnections, interdependencies and a research agenda, 2008, Higher Education, pp. 303-323.
[98] Jorge, Manuel Larrán, Hernánde, Antonio López e Cejas, Mª Yolanda Calzado, Stakeholder Expectations in Spanish Public Universities: An Empirical Study, 2012, International Journal of Humanities and Social Science, pp. 1-13.
[99] Magalhães, António e Amaral, Alberto, Portuguese Higer Education and the Imaginary Friend: The stakeholder´s role in institutional governance, 2000, European Journal Of Education, pp. 439-448.
[100] Jacobson, David L, A New Agenda for Education Partnerships, 2001, Change, pp. 44-53.
[101] Freeman, R. Edward, Strategic Management: A Stakeholder Approach. Cambridge, Cambridge University Press, 1984.
[102] Donaldson, Thomas e Preston, Lee E, The stakeholder theory of the corporation concepts, evidence, and implications, 1995, Academy of Management Review, pp. 65-91.
[103] Mitchell, Ronald K., Agle, Bradley R. e Wood, Donna J, Toward a Theory of Stakeholder Identification and Salience - Defining the principle of who and what really counts, 1997, Academy of Management Review, pp. 853-886.
[104] Sousa, António, Introdução à Gestão: Uma abordagens sistémica. Lisboa, Verbo, 1990.
[105] Chapleo, Chris e Simms, Christopher, Stakeholder analysis in higher education A case study of the University of Portsmouth, 2010, Perspectives: Policy and Practice in Higher Education, Vols. 14, nº1, pp. 12-20.
[106] Mainardes, Emerson Wagner, Alves, Helena e Raposo, Mário, Domingues, Maria José , Categorização por importância dos Stakeholders das universidades, 2010, Revista Ibero-Americana de Estratégia, pp. 05-40.
[107] Singh, Karamjeet e Weligamage, Susima, Thinking towards stakeholder satisfaction in Higher Education: an application of performance prism., University of Kelaniya, Sri Lanka, 2010. International Conference on Business & information.
[108] Universidade de Coimbra, Plano estratégico e de ação UC 2011-2015. Coimbra, 2011.
[109] Bradley, Leo H, Total Quality Management for Schools. Lancaster, Technomic Publishing Company, 1993.
[110] Lawrence, John J e McCollough, Michael A., A conceptual framework for guaranteeing higher education, 2001, Quality Assurance in Education, pp. 139-152.
[111] Miranda, Jorge, Sobre o Governo das Universidades Públicas, Porto, s.n., 2012. Conferencia na Universidade do Porto.
[112] Hasan, Abrar, Independent Legal Status and Universities as Foundations. Paris, UNESCO, 2007.
[113] Aires, Luisa, Paradigma Qualitativo e Práticas de Investigação Educacional, Lisboa, Universidade Aberta, 2011.
[114] Coutinho, Clara Pereira, Metodologia de Investigação em Ciências Sociais e Humanas: Teoria e prática, Coimbra, Almedina, 2015.
[115] Creswell, John W, Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, Londres, Sage Publications, 2013.
[116] Thomas, GAry, How to do Your Reseahcg Project, Londres, Sage Publications, 2013. 978-1-4462-5886-6.
[117] Hill, Manuela M. e Hill, Andrew, Investigação por questionário, Lisboa, Sílabo, 2005. 972-618-223-9.
[118] Fortin, Marie-Fabienne, Fundamentos e etapas do processo de investigação, Loures, Lusodidacta, 2006.
[119] Nulty, Duncan D., The adequacy of response rates to online and paper surveys: what can be done?, 2008, Assessment & Evaluation in Higher Education , pp. 301–314.
[120] Alreck, Pamela e Seetle, Robert, Survey research handbook, Boston, Richard D. Irwin, 2004.
[121] Campos, Pedro e Brito, Pedro Quelhas, Novas Tendencias em Marketing Intelligence, Coimbra, Conjuntura Atual, 2013.
[122] Cohen, Jacob, Statistical power analysis for the behavioral sciences, Hillsdale, New Jersey, Lawrence Erbaum, 1988.
[123] Flick, Uwe, Métodos Qualitativos na Investigação Científica, Lisboa, Monitor, 2002. 972-9413-67-3.
[124] Guerra, Isabel. C, Pesquisa Qualitativa e Análise de Conteúdo - Sentidos e formas de uso, Parede, Principia, 2006. 978-972-8818-66-1.