Project

Reflexive Monitoring in Action

Reflexive Monitoring in Action (RMA) is an integrated methodology to encourage learning within multi-actor groups or networks as well as institutional change in order to deal with complex problems. Key is to trigger recurrent collective reflection on the results of actions undertaken in the light of systemic barriers as well as opportunities. These system change initiatives will thus be able to change their practices, relations and rules and contribute to the long term ambition of sustainability.

reflexive monitoring in action.jpeg

Over the past decade, the methodology has been applied in many initiatives for system change and programmes in a diversity of domains, such as sustainable agriculture, health, international development, the knowledge infrastructure, and learning for sustainability. It has developed into a coherent body of basic starting points, principles and intervention strategies. On this site, you find the basic guide, additional tools, practical results and the main scientific articles about RMA.

Guide and tools

The guide on Reflexive Monitoring in Action offers principles, practical guidelines as well as theory and tools. Additional tools, developed more recently, are provided separately.

RMA guide

English
Nederlands
Portugués
Deutsch (adapted)
Learning Mirror New tool RMA, supplement to the RMA guide.

Examples

Explanation

Short introduction to the masterclass Reflexive Monitoring, by PJ Beers, in Dutch

RMA as part of a co-innovation approach by Denise Bewsell. 2020
The value of RMA, short interview Barbara van Mierlo, 2019. In Dutch
Interview Barbara van Mierlo at CDI Conference 'M&E for Responsible Innovation', 2015

Shared presentation slides on RMA by Marlen Arkesteijn for HumidTropics. 2014

Reflexive monitoring in action from ILRI

Scientific articles

Key articles

Van Mierlo, B., Beers, P. J., & Hoes, A. C. (2020). Inclusion in responsible innovation: revisiting the desirability of opening up. Journal of Responsible Innovation, 7(3), 361-383.

Klaassen, P., Verwoerd, L., Kupper, F., & Regeer, B. (2020). Chapter 9 Reflexive monitoring in action as a methodology for learning and enacting Responsible Research and Innovation. Assessment of Responsible Innovation: Methods and Practices, 222 - 243.

Verwoerd, L., Klaassen, P., & Regeer, B. J. (2020). How to normalize reflexive evaluation? Navigating between legitimacy and integrity. Evaluation, 1356389020969721.

Beers, P. J., Turner, J. A., Rijswijk, K., Williams, T., Barnard, T., & Beechener, S. (2019). Learning or evaluating? Towards a negotiation-of-meaning approach to learning in transition governance. Technological Forecasting and Social Change, 145, 229-239.

van Mierlo, B. & P.J. Beers. (2018). Understanding and governing learning in sustainability transitions: A review. Environmental innovation and societal transitions. In press. https://doi.org/10.1016/j.eist.2018.08.002

Beers, P. J., & van Mierlo, B. (2017). Reflexivity and Learning in System Innovation Processes. Sociologia Ruralis, 57(3), 415-436.

Beers, P. J., Mierlo, B., & Hoes, A. C. (2016). Toward an integrative perspective on social learning in system innovation initiatives. Ecology and Society, 21(1): 33.

Regeer, B. J., de Wildt-Liesveld, R., van Mierlo, B., & Bunders, J. F. (2016). Exploring ways to reconcile accountability and learning in the evaluation of niche experiments. Evaluation, 22(1), 6-28.

Arkesteijn, M., B. van Mierlo and C. Leeuwis (2015). The need for reflexive evaluation approaches in development cooperation. Evaluation 21(1): 99-115.

Veen, S. C. V., R. D. Wildt–Liesveld, J. F. Bunders and B. J. Regeer (2014). Supporting reflective practices in social change processes with the dynamic learning agenda: an example of learning about the process towards disability inclusive development. International Journal of Learning and Change, 7(3-4): 211-233.

van Mierlo, B., M. Arkesteijn and C. Leeuwis (2010). Enhancing the reflexivity of system innovation projects with system analyses. American Journal of Evaluation 31(2): 143-161.

Fielke, S.J., Nelson, T., Blackett, P., Bewsell, D., Bayne, K., Park, . N, Rijswijk, K., and Small, B. (2017). Hitting the bullseye: The role of a reflexive monitor in New Zealand agricultural innovation systems. Outlook on Agriculture, 46(2) 117–124

Sol, J. Merel M. van der Wal, Pieter Jelle Beers & Arjen E.J. Wals (2017): Reframing the future: the role of reflexivity in governance networks in sustainability transitions. Environmental Education Research, DOI: 10.1080/13504622.2017.1402171

Hoes, A. C., Beers, P. J., & van Mierlo, B. (2016). Communicating tensions among incumbents about system innovation in the Dutch dairy sector. Environmental Innovation and Societal Transitions 21: 113-122.

Rijswijk, K., Bewsell, D., Small, B., & Blackett, P. (2015). Reflexive monitoring in New Zealand: evaluation lessons in supporting transformative change. Evaluation Journal of Australasia, 15(4), 38-4.

Turner, J. A., Klerkx, L., Rijswijk, K., Williams, T., & Barnard, T. (2015). Systemic problems affecting co-innovation in the New Zealand Agricultural Innovation System: Identification of blocking mechanisms and underlying institutional logics. NJAS – Wageningen Journal of Life Science, 76, 99-112.

van Mierlo, Barbara, van Amstel, M., Arkesteijn, M., and Elzen, B. (2010). Keeping the ambition high. The value of reflexive monitoring in action for system innovation projects. SISA Workshop. 2010.

van Mierlo, B., C. Leeuwis, R. Smits and R. K. Woolthuis (2010). Learning towards system innovation: Evaluating a systemic instrument. Technological Forecasting and social Change 77(2): 318-334

Regeer, B. J., A.-C. Hoes, M. van Amstel-van Saane, F. F. Caron-Flinterman and J. F. Bunders (2009). Six guiding principles for evaluating mode-2 strategies for sustainable development. American Journal of Evaluation 30(4): 515-537

Network activities

Future and past network activities dedicated to share experiences and insights with people interested, to foster competence building among reflexive monitors and to develop RMA further.

Future network activities

In May 2024 we will organise a meeting for the Community of Practice of Reflexive Monitors. It is on invitation.

Past network activities

September 1, we had a lively dialogue with practitioners of Reflexive Monitoring (researchers as well as others) and people interested at the International Sustainability Transitions Conference.

In gesprek.jpeg

It was the first activity of the recently established CoP RMA. We discussed what it meant to operate at the boundaries of a system change initiative and its institutional setting and how practitioners navigate both in- and external resistance. We learned about the need to involve middle management, how to start subtly if conditions for making room for change are not yet in place, how to relate to commissioners and much more. Thanks to my co-chair TJ Schuitmaker-Warnaar, the audience and the panel members Corine Quarles van Ufford, Carolien de Vries, Eva Kunseler, PJ Beers, Barbara Regeer, Anne Loeber, Kris Kok and Lieselot Vandenbussche.

Seminar Reflexive monitoring for transformative change, 9 April 2014.
Theatre debate Sustainable Agriculture Innovation, 17 April 2015

Trainings

Future and past trainings for competence building. We also provide tailored in-company training and coaching.

Future trainings

The Masterclass Reflexive Monitoring of 2023 (in Dutch) is fully booked. A new edition is expected in 2024. If you are interested, register for News on RMA (2-3 times a year).

Past trainings

Module in UvA Academy Masterclass Policy Research - Dutch, 2021 - 2023

In-company training Municipality Heerhugowaard (2020), Freie Universität Berlin (2020)

Masterclass Advanced Course Transitiemonitoring, 14 januari en 4 februari 2016, for the VNG (Association of Dutch municipalities), Utrecht