Quarterly Publication

Document Type : Original Article

Authors

1 Ph.D. Candidate, Management and Accounting, University of Tehran, College of Farabi, Ghom, Iran.

2 Assistant Professor, Management and Accounting, University of Tehran, College of Farabi,Ghom, iran. Email: reza.fathi@ut.ac.ir

3 Assistant Professor, Department of Industrial Management, University of Tehran, Tehran, Iran.

4 Assistant Professor, Department, of Business Development, Technology Management Division, Research Institute of Petroleum Industry.

Abstract

One of the governmental research organizations is Research and Technology Organization (RTO), whose primary is to harness science and technology in the service of innovation or public bodies and industry, to improve the quality of life and build economic competitiveness. Despite the importance and role of research and technology organizations in the innovation system, previous studies have not addressed the concept of technology development projects' effectiveness implemented in RTOs.
This study attempts to investigate this concept from two aspects: "the concept of effectiveness in research projects" and "the concept of effectiveness in RTOs" to define this concept in a research and technology organization (RIPI). To evaluate and implement the proposed framework, eight technology development projects are studied at the Research Institute of Petroleum Industry. Based on the developed indicators and their weights, the effectiveness of eight technology development projects has been evaluated using ARAS, COPRAS, MOORA, and TOPSIS multi-criteria decision-making methods.

Keywords

Main Subjects

Agostino, D., Arena, M., Azzone, G., Molin, M. D., & Masella, C. (2012). Developing a Performance Measurement System for public Research Centres. International Journal of Business Science & Applied Management, 7(1).
Agostino, D., Arena, M., Azzone, G., Molin, M. D., & Masella, C. (2012). Developing a performance Measurement System for Public Research Centres. International Journal of Business Science & Applied Management, 7(1).
Arnold, E., Clark, J., & Jávorka, Z. (2010). Impacts of European RTOs: A Study of Social and Economic Impacts of Research and Technology Organisations: a Report to EARTO.
Ashraf, G. (2012). A Review on the Models of Organizational Effectiveness: A Look at Cameron's Model in Higher Education. International Education Studies, 5(2), 80-87
Ashraf Ganjouie, F. (2012). The Effect of Intellectual and Social Capital on knowledge Management and its Role on Organizational Effectiveness in Iranian Sports Organizations (dissertation in persion). Tehran, Iran: univ. Faculty of Physical Education and Sports Science Central Tehran Branch.
Bai, C. (2016). The Pioneer Initiative: a New Era in Chinese Research. Small, 12(16), 2115-2117
Balduck, A. L., & Buelens, M. (2008). A Two-level Competing Values Approach to Measure Non-Profit Organizational Effectiveness. Faculteit Economie en Bedrijfskunde, Univ. Gent.
Bandarian, R. (2016). Strategic Management of Research and Technology (in persion). Houshmand tadbir Publications.
Barton Cunningham. J; 1978. A Systems-Resource Approach for Evaluating Organizational Effectiveness
Boyne, G. A. (2003a). Sources of Public Service Improvement: A Critical Review and Research Agenda. Journal of Public Administration Research and Theory, 13, 367-394
Boyne, G. A. (2003b). What is Public Service Improvement? Public Administration, 81, 211- 227.
Brauers, W. K. M., Zavadskas, E. K., Peldschus, F., & Turskis, Z. (2008). Multi-objective Decision-Making for Road Design. Transport, 23(3), 183–193.
Brauers, W. K., & Zavadskas, E. K. (2006). The MOORA Method and its Application to Privatization in a Transition Economy. Control and Cybernetics, 35(2), 445–469
Brown, M. G., & Svenson, R. A. (1988). Measuring r&d Productivity. Research-Technology Management, 31(4), 11-15.
Brown, W. B., & Gobeli, D. (1992). Observations on the Measurement of R&D Productivity: A Case Study. IEEE Transactions on Engineering Management, 39(4), 325-331.
Cameron, K. (1981). Domains of Organizational Effectiveness in Colleges and Universities. Academy of Management
Chakraborty, S. (2011). Applications of the MOORA Method for Decision Making in Manufacturing Environment. The International Journal of Advanced Manufacturing Technology, 54(9-12), 1155–1166.
Charles, D., & Ciampi Stancova, K. (2015). Research and Technology Organisations and Smart Specialisation. available at https://s3platform.jrc.ec.europa.eu/documents/20182/114948/JRC97781_RTOs_and_S3.pdf/294c1b81-75d3-4fdb-9238-69f693d0ca66
Coccia, M. (2004). New Models for Measuring the R&D Performance and Identifying the Productivity of Public Research Institutes. R&D Management, 34(3), 267-280.
Coccia, M. (2005). A Scientometric Model for the Assessment of Scientific Research Performance Within Public Institutes. Scientometrics, 65(3), 307-321.
Coccia, M. (2006). Analysis and Classification of Public Research Institutes. World Review of Science, Technology and Sustainable Development, 3(1), 1-16.
Connolly, T., Conlon, E. J., & Deutsch, S. J. (1980). Organizational Effectiveness: A Multipleconstituency Approach. Academy of Management Review, 5, 211-218
De Fuentes, C., & Dutrénit, G. (2012). Best Channels of Academia–industry Interaction for long-term Benefit. Research Policy, 41(9), 1666-1682.
Dymova, L., Sevastjanov, P., & Tikhonenko, A. (2013). A Direct Interval Extension of TOPSIS Method. Expert Systems with Applications, 40(12), 4841–4847.
EARTO – European Association of Research and Technology Organisations. (2018). Economic Footprint of 9 European RTOs in 2015-2016. Available at https://www.earto.eu/wp-Content/uploads/EARTO-Economic-Footprint-Study-Impact-of-9-RTOs-in-2015-2016-Final-Report.pdf
European Association of Research and Technology Organisations
Friedlander, F., & Pickle, H. (1968). Components of Effectiveness in Small Organizations. Administrative Science Quarterly, 13, 289-304.
García‐Valderrama, T., & Mulero‐Mendigorri, E. (2005). Content Validation of a Measure of R&D Effectiveness. R&D Management, 35(3), 311-331.
Hajkowicz, S., & Collins, K. (2007). A review of Multiple Criteria analysis for Water Resource Planning and Management. Water Resources Management, 21(9),1553– 1566.
Heidary Dahooie, J., Mohammadi, N., Vanaki, A., Ghafari, S. (2016). Selecting the appropriate Method for Predicting Iranian Aircraft Engine Technology (in persion). Journal of Technology Development Management, 4(3).
Herman, R. D., & Renz, D. O. (1999). Theses on non-Profit Organizational Effectiveness. Non-profit and Voluntary Sector Quarterly, 28, 107-126.
Hobbs, B. F., Chankong, V., Hamadeh, W., & Stakhiv, E. Z. (1992). Does Choice of Multi-Criteria Method Matter? An Experiment in water Resources Planning. Water Resources Research, 28(7), 1767–1779.
Jahan, A., Ismail, M. Y., Shuib, S., Norfazidah, D., & Edwards, K. L. (2011). An Aggregation Technique for Optimal Decision-Making in Materials Selection. Materials & Design, 32(10), 4918–4924
Kleijnen, J., Dolmans, D., Muijtjens, A., Willems, J., & Van Hout, H. (2009). Organisational Values in Higher
Kolar Bryan. T; (2018). Toward a Contingency Model for the Relationship Between Capacity and Effectiveness in Non-profit Organizations
Krishna, D., Mohan, S. R., Murthy, B. S. N., & Rao, A. R. (2002). Performance Evaluation of Public Research Institutes Using Principal Component Analysis
Laliene, R., & Sakalas, A. (2014). Conceptual Structure of R&D Productivity Assessment in Public Research Organizations. Economics and Management, 19(1), 25-35.
Larichev, О. 2000. Decision-Making Theory and Methods. Мoscow: Logos (in Russian).
Lazzarotti, V., Manzini, R., & Mari, L. (2011). A model for R&D Performance Measurement. International Journal of Production Economics, 134(1), 212-223.
Liu, X., & White, S. (2001). Comparing Innovation Systems: A Framework and Application to China’s Transitional Context. Research policy, 30(7), 1091-1114.
Loikkanen, T., Hyytinen, K. and J. Konttinen, 2011. “Public Research and Technology Organisations in Transition – The Case of Finland.” Science, Technology and Society Vol. 16, No. 1, pp. 75 – 98.
Mitchell, G. E. (2015). The Attributes of Effective NGO’s and the Leadership Values Associated with a Reputation for Organizational Effectiveness. Nonprofit Management & Leadership, 26, 39-57.
Moore, M. H. (2003). The Public Value Scorecard: A Rejoinder and an Alternative to “Strategic Performance Measurement and Management in Non-Profit Organizations” by Robert Kaplan. Retrieved from http://www.exinfm.com/workshop_files/public_sector_scorecard. Pdf
Olson, D. L., Moshkovich, H. M., Schellenberger, R., & Mechitov, A. I. (1995). Consistency and Accuracy in Decision Aids: Experiments with four Multiattribute Systems. Decision Sciences, 26(6), 723–747
Orozco, J., & Ruiz, K. (2010). Quality of Interactions Between Public Research organisations and Firms: Lessons from Costa Rica. Science and Public Policy, 37(7), 527-540.
Samsonowa, T. (2011). Industrial Research Performance Management: Key Performance Indicators in the ICT industry. Springer Science & Business Media.
Scandura, A. (2016). University–Industry Collaboration and Firms’ R&D Effort. Research Policy, 45(9), 1907-1922.
Shanian, A., & Savadogo, O. (2009). A methodological Concept for Material Selection of Highly Sensitive Components Based on Multiple Criteria Decision Analysis. Expert Systems with Applications, 36(2), 1362–1370.
Technopolis group. (2019). Evaluation of the Luxembourg Institute of Science and Technology (LIST) – Synthesis Report on the Institute Level, Available at http://www.mesr.public.lu/publications/rapports-evaluations/Mars2019/Eval_Lxb_CRP_LIST_Institute_20190219.pdf
Thurner, T. W., & Zaichenko, S. (2014). Research and Technology Organizations (RTOs) in the Primary Sector: Providing Innovation to Russia's Mines and Corn fields. European Journal of Innovation Management, 17(3), 292-310.
Uygun, Y., 2015. “The Fraunhofer System: A Critical Analysis.” Unpublished. MIT Industrial Performance Center.
Varmazyar, M., Dehghanbaghi, M., & Afkhami, M. (2016). A novel Hybrid MCDM Model for Performance Evaluation of Research and Technology Organizations Based on BSC Approach. Evaluation and Program Planning, 58, 125-140.
Vijayalakshmi, S., & Iyer, N. R. (2011, July). Mapping Strategies and Performance Evaluation of Research Organizations. In Proceedings of the 5th WSEAS International Conference on Communications and Information Technology (pp. 50-53). World Scientific and Engineering Academy and Society (WSEAS).
Wang, Y. M., Yang, J. B., & Xu, D. L. (2005). A Preference Aggregation Method Through the Estimation of Utility Intervals. Computers & Operations Research, 32(8), 2027–2049.
Welsh, R., Glenna, L., Lacy, W., & Biscotti, D. (2008). Close Enough but not too far: Assessing the Effects of University–Industry Research Relationships and the Rise of Academic Capitalism. Research policy, 37(10), 1854-1864.
Willems, J., Jegers, M., & Faulk, L. (2016). Organizational Effectiveness Reputation in the Non-Profit Sector. Public Performance & Management Review, 39, 454-475.
Yoon, B., Shin, J., & Lee, S. (2018). Technology Assessment Model for Sustainable Development of LNG Terminals. Journal of Cleaner Production, 172, 927-937.
Yoon, K., & Hwang, C. L. (1981). TOPSIS (technique for Order Preference by Similarity to ideal solution)–a Multiple Attribute Decision Making, w: Multiple Attribute Decision Making–Methods and Applications, a State-of-the-at Survey. a State-of-the-at Survey, 128-140.
Yuchtman, E., & Seashore, S. E. (1967). A System Resource Approach to Organizational Effectiveness. American Sociological Review, 32, 891-903.
Zammuto, R. F. (1984). A Comparison of Multiple Constituency Models of Organizational-Effectiveness. Academy of Management Review, 9, 606-616.
Zavadskas, E. K., & Kaklauskas, A. (1996). Determination of an Efficient Contractor by Using the new Method of Multi-Criteria Assessment. International Symposium for the Organization and Management of Construction. Shaping Theory and Practice, Vol. 2, 94–104.
Zavadskas, E. K., & Turskis, Z. (2010). A New Additive Ratio Assessment (ARAS) Method in Multi-criteria Decision-Making. Technological and Economic Development of Economy, 16(2), 159–172. http://dx.doi.org/10.3846/ tede.2010.10.
Zhang, C., Bengio, S., Hardt, M., Recht, B., & Vinyals, O. (2016). Understanding deep Learning Requires Rethinking Generalization. arXiv Preprint arXiv:1611.03530