Abstract
The field of engineering management usually involves evaluation issues, such as program selection, team performance evaluation, technology selection, and supplier evaluation. The traditional self-evaluation data envelopment analysis (DEA) method usually exaggerates the effects of several inputs or outputs of the evaluated decision-making unit (DMU), resulting in unrealistic results. To address this problem, scholars have proposed the cross-efficiency evaluation (CREE) method. Compared with the DEA method, CREE can rank DMUs more completely by using reasonable weights. With the extensive application of this technique, several problems, such as non-unique weights and non-Pareto optimal results, have arisen in CREE methods. Therefore, the improvement of CREE has attracted the attention of many scholars. This paper reviews the theory and applications of CREE, including the non-uniqueness problem, the aggregation of cross-efficiency data, and applications in engineering management. It also discusses the directions for future research on CREE.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Alcaraz J, Ramón N, Ruiz J L, Sirvent I (2013). Ranking ranges in cross-efficiency evaluations. European Journal of Operational Research, 226(3): 516–521
Andersen P, Petersen N C (1993). A procedure for ranking efficient units in data envelopment analysis. Management Science, 39(10): 1261–1264
Anderson T R, Hollingsworth K, Inman L (2002). The fixed weighting nature of a cross-evaluation model. Journal of Productivity Analysis, 17(3): 249–255
Baker P C, Talluri S (1997). A closer look at the use of data envelopment analysis for technology selection. Computers & Industrial Engineering, 32(1): 101–108
Barros C P (2006). A benchmark analysis of Italian seaports using data envelopment analysis. Maritime Economics & Logistics, 8(4): 347–365
Boussofiane A, Dyson R G, Thanassoulis E (1991). Applied data envelopment analysis. European Journal of Operational Research, 52 (1): 1–15
Braglia M, Petroni A (1999). Evaluating and selecting investments in industrial robots. International Journal of Production Research, 37 (18): 4157–4178
Brannick M T, Salas E, Prince C W (1997). Team Performance Assessment and Measurement: Theory, Methods, and Applications. Hove, East Sussex: Psychology Press
Chang C M (2008). Engineering management in developing economies: The EMIDE approaches to meet the new challenges. International Journal of Innovation & Technology Management, 5(4): 381–400
Charnes A, Cooper W W, Rhodes E (1978). Measuring the efficiency of decision making units. European Journal of Operational Research, 2 (6): 429–444
Chen J X (2011). Peer-estimation for multiple criteria ABC inventory classification. Computers & Operations Research, 38(12): 1784–1791
Chen L, Wang Y M (2016). Data envelopment analysis cross-efficiency model in fuzzy environments. Journal of Intelligent & Fuzzy Systems, 30(5): 2601–2609
Chen L, Wang Y M (2020). DEA target setting approach within the cross efficiency framework. Omega, 96: 102072
Chen W, Zhou K, Yang S (2017). Evaluation of China’s electric energy efficiency under environmental constraints: A DEA cross efficiency model based on game relationship. Journal of Cleaner Production, 164: 38–44
Chu M T, Shyu J Z, Khosla R (2008). Measuring the relative performance for leading fabless firms by using data envelopment analysis. Journal of Intelligent Manufacturing, 19(3): 257–272
Cook W D, Seiford L M (2009). Data envelopment analysis (DEA) — Thirty years on. European Journal of Operational Research, 192(1): 1–17
Cui Q, Li Y (2015). Evaluating energy efficiency for airlines: An application of VFB-DEA. Journal of Air Transport Management, 44–45: 34–41
Despotis D K (2002). Improving the discriminating power of DEA: Focus on globally efficient units. Journal of the Operational Research Society, 53(3): 314–323
Ding L, Yang Y, Wang W, Calin A C (2019). Regional carbon emission efficiency and its dynamic evolution in China: A novel cross efficiency-malmquist productivity index. Journal of Cleaner Production, 241: 118260
Dotoli M, Epicoco N, Falagario M, Sciancalepore F (2016). A stochastic cross-efficiency data envelopment analysis approach for supplier selection under uncertainty. International Transactions in Operational Research, 23(4): 725–748
Doyle J, Green R (1994). Efficiency and cross-efficiency in DEA: Derivations, meanings and uses. Journal of the Operational Research Society, 45(5): 567–578
Du J, Cook W D, Liang L, Zhu J (2014). Fixed cost and resource allocation based on DEA cross-efficiency. European Journal of Operational Research, 235(1): 206–214
Dyson R G, Thanassoulis E (1988). Reducing weight flexibility in data envelopment analysis. Journal of the Operational Research Society, 39(6): 563–576
Enberg C (2012). Enabling knowledge integration in coopetitive R&D projects — The management of conflicting logics. International Journal of Project Management, 30(7): 771–780
Ertay T, Ruan D (2005). Data envelopment analysis based decision model for optimal operator allocation in CMS. European Journal of Operational Research, 164(3): 800–810
Färe R, Grosskopf S, Norris M, Zhang Z (1994). Productivity growth, technical progress, and efficiency change in industrialized countries. The American Economic Review, 84(1): 66–83
Geng Z, Dong J, Han Y, Zhu Q (2017). Energy and environment efficiency analysis based on an improved environment DEA cross-model: Case study of complex chemical processes. Applied Energy, 205: 465–476
Guo D, Wu J (2013). A complete ranking of DMUs with undesirable outputs using restrictions in DEA models. Mathematical and Computer Modelling, 58(5–6): 1102–1109
Hatami-Marbini A, Agrell P J, Tavana M, Khoshnevis P (2017). A flexible cross-efficiency fuzzy data envelopment analysis model for sustainable sourcing. Journal of Cleaner Production, 142: 2761–2779
Hong J D, Jeong K Y (2017). Cross efficiency based heuristics to rank decision making units in data envelopment analysis. Computers & Industrial Engineering, 111: 320–330
Jahanshahloo G R, Khodabakhshi M, Hosseinzadeh Lotfi F, Moazami Goudarzi M R (2011). A cross-efficiency model based on super-efficiency for ranking units through the TOPSIS approach and its extension to the interval case. Mathematical and Computer Modelling, 53(9–10): 1946–1955
Kao C, Liu S T (2019). Cross efficiency measurement and decomposition in two basic network systems. Omega, 83: 70–79
Lam K F (2010). In the determination of weight sets to compute cross-efficiency ratios in DEA. Journal of the Operational Research Society, 61(1): 134–143
Lannes W J (2001). What is engineering management? IEEE Transactions on Engineering Management, 48(1): 107–115
Lee K H, Farzipoor Saen R (2012). Measuring corporate sustainability management: A data envelopment analysis approach. International Journal of Production Economics, 140(1): 219–226
Li F, Zhu Q, Chen Z, Xue H (2018). A balanced data envelopment analysis cross-efficiency evaluation approach. Expert Systems with Applications, 106: 154–168
Li H B, Lei L (2007). DEA-based project knowledge management performance evaluation. In: International Conference on Management Science & Engineering. Harbin, 1561–1566
Liang L, Wu J, Cook W D, Zhu J (2008a). Alternative secondary goals in DEA cross-efficiency evaluation. International Journal of Production Economics, 113(2): 1025–1030
Liang L, Wu J, Cook W D, Zhu J (2008b). The DEA game cross-efficiency model and its Nash equilibrium. Operations Research, 56 (5): 1278–1288
Lim S (2012a). Context-dependent data envelopment analysis with cross-efficiency evaluation. Journal of the Operational Research Society, 63(1): 38–46
Lim S (2012b). Minimax and maximin formulations of cross-efficiency in DEA. Computers & Industrial Engineering, 62(3): 726–731
Lim S, Oh KW, Zhu J (2014). Use of DEA cross-efficiency evaluation in portfolio selection: An application to Korean stock market. European Journal of Operational Research, 236(1): 361–368
Lim S, Zhu J (2015). DEA cross-efficiency evaluation under variable returns to scale. Journal of the Operational Research Society, 66(3): 476–487
Lin L C, Tseng C C (2007). Operational performance evaluation of major container ports in the Asia-Pacific region. Maritime Policy & Management, 34(6): 535–551
Lin R, Chen Z, Xiong W (2016). An iterative method for determining weights in cross efficiency evaluation. Computers & Industrial Engineering, 101: 91–102
Liu B, Tian C, Li Y, Song H, Ma Z (2018). Research on the effects of urbanization on carbon emissions efficiency of urban agglomerations in China. Journal of Cleaner Production, 197: 1374–1381
Liu H H, Song Y Y, Yang G L (2019). Cross-efficiency evaluation in data envelopment analysis based on prospect theory. European Journal of Operational Research, 273(1): 364–375
Liu S T (2018). A DEA ranking method based on cross-efficiency intervals and signal-to-noise ratio. Annals of Operations Research, 261(1–2): 207–232
Liu W, Wang Y M, Lv S (2017a). An aggressive game cross-efficiency evaluation in data envelopment analysis. Annals of Operations Research, 259(1–2): 241–258
Liu X, Chu J, Yin P, Sun J (2017b). DEA cross-efficiency evaluation considering undesirable output and ranking priority: A case study of eco-efficiency analysis of coal-fired power plants. Journal of Cleaner Production, 142: 877–885
Lo Storto C (2016). Ecological efficiency based ranking of cities: A combined DEA cross-efficiency and Shannon’s entropy method. Sustainability, 8(2): 124
Lu W M, Lo S F (2007). A closer look at the economic-environmental disparities for regional development in China. European Journal of Operational Research, 183(2): 882–894
Ma R, Yao L, Jin M, Ren P (2014). The DEA game cross-efficiency model for supplier selection problem under competition. Applied Mathematics & Information Sciences, 8(2): 811–818
Mahdiloo M, Farzipoor Saen R, Lee K H (2015). Technical, environmental and eco-efficiency measurement for supplier selection: An extension and application of data envelopment analysis. International Journal of Production Economics, 168: 279–289
Noorizadeh A, Mahdiloo M, Farzipoor Saen R (2013). Using DEA cross-efficiency evaluation for suppliers ranking in the presence of non-discretionary inputs. International Journal of Shipping and Transport Logistics, 5(1): 95–111
Örkcü H H, Bal H (2011). Goal programming approaches for data envelopment analysis cross efficiency evaluation. Applied Mathematics and Computation, 218(2): 346–356
Oukil A (2019). Embedding OWA under preference ranking for DEA cross-efficiency aggregation: Issues and procedures. International Journal of Intelligent Systems, 34(5): 947–965
Park J, Bae H, Bae J (2014). Cross-evaluation-based weighted linear optimization for multi-criteria ABC inventory classification. Computers & Industrial Engineering, 76: 40–48
Ramón N, Ruiz J L, Sirvent I (2010a). A multiplier bound approach to assess relative efficiency in DEA without slacks. European Journal of Operational Research, 203(1): 261–269
Ramón N, Ruiz J L, Sirvent I (2010b). On the choice of weights profiles in cross-efficiency evaluations. European Journal of Operational Research, 207(3): 1564–1572
Ramón N, Ruiz J L, Sirvent I (2011). Reducing differences between profiles of weights: A “peer-restricted” cross-efficiency evaluation. Omega, 39(6): 634–641
Ramón N, Ruiz J L, Sirvent I (2014). Dominance relations and ranking of units by using interval number ordering with cross-efficiency intervals. Journal of the Operational Research Society, 65(9): 1336–1343
Rezaee M J, Izadbakhsh H, Yousefi S (2016). An improvement approach based on DEA-game theory for comparison of operational and spatial efficiencies in urban transportation systems. KSCE Journal of Civil Engineering, 20(4): 1526–1531
Rödder W, Reucher E (2011). A consensual peer-based DEA-model with optimized cross-efficiencies — Input allocation instead of radial reduction. European Journal of Operational Research, 212(1): 148–154
Ruiz J L (2013). Cross-efficiency evaluation with directional distance functions. European Journal of Operational Research, 228(1): 181–189
Sarkis J (2000). An analysis of the operational efficiency of major airports in the United States. Journal of Operations Management, 18 (3): 335–351
Sarkis J, Talluri S (2004). Performance based clustering for benchmarking of US airports. Transportation Research Part A, Policy and Practice, 38(5): 329–346
Sarkis J, Weinrach J (2001). Using data envelopment analysis to evaluate environmentally conscious waste treatment technology. Journal of Cleaner Production, 9(5): 417–427
Sexton T R, Silkman R H, Hogan A J (1986). Data envelopment analysis: Critique and extensions. New Directions for Program Evaluation, (32): 73–105
Shang J, Sueyoshi T (1995). A unified framework for the selection of a flexible manufacturing system. European Journal of Operational Research, 85(2): 297–315
Shi H, Wang Y, Chen L (2019). Neutral cross-efficiency evaluation regarding an ideal frontier and anti-ideal frontier as evaluation criteria. Computers & Industrial Engineering, 132: 385–394
Song L, Liu F (2018). An improvement in DEA cross-efficiency aggregation based on the Shannon entropy. International Transactions in Operational Research, 25(2): 705–714
Song M, Zhang J, Wang S (2015). Review of the network environmental efficiencies of listed petroleum enterprises in China. Renewable & Sustainable Energy Reviews, 43: 65–71
Song M, Zhu Q, Peng J, Santibanez Gonzalez E D R (2017). Improving the evaluation of cross efficiencies: A method based on Shannon entropy weight. Computers & Industrial Engineering, 112: 99–106
Sun J, Fu Y, Ji X, Zhong R Y (2017a). Allocation of emission permits using DEA-game-theoretic model. Operations Research, 17(3): 867–884
Sun J, Li G, Wang Z (2018a). Optimizing China’s energy consumption structure under energy and carbon constraints. Structural Change and Economic Dynamics, 47: 57–72
Sun J, Li G, Wang Z (2019). Technology heterogeneity and efficiency of China’s circular economic systems: A game meta-frontier DEA approach. Resources, Conservation and Recycling, 146: 337–347
Sun J, Wang Z, Li G (2018b). Measuring emission-reduction and energy-conservation efficiency of Chinese cities considering management and technology heterogeneity. Journal of Cleaner Production, 175: 561–571
Sun J, Wu J, Guo D (2013). Performance ranking of units considering ideal and anti-ideal DMU with common weights. Applied Mathematical Modelling, 37(9): 6301–6310
Sun J, Wu J, Wang Y, Li L, Wang Y (2018c). Cross-efficiency evaluation method based on the conservative point of view. Expert Systems, e12336
Sun J, Yang R, Ji X, Wu J (2017b). Evaluation of decision-making units based on the weight-optimized DEA model. Kybernetika, 53(2): 244–262
Sun J, Yuan Y, Yang R, Ji X, Wu J (2017c). Performance evaluation of Chinese port enterprises under significant environmental concerns: An extended DEA-based analysis. Transport Policy, 60: 75–86
Sun S (2002). Assessing computer numerical control machines using data envelopment analysis. International Journal of Production Research, 40(9): 2011–2039
Talluri S, Paul Yoon K (2000). A cone-ratio DEA approach for AMT justification. International Journal of Production Economics, 66(2): 119–129
Tan Y, Zhang Y, Khodaverdi R (2017). Service performance evaluation using data envelopment analysis and balance scorecard approach: An application to automotive industry. Annals of Operations Research, 248(1–2): 449–470
von Geymueller P (2009). Static versus dynamic DEA in electricity regulation: The case of US transmission system operators. Central European Journal of Operations Research, 17(4): 397–413
Wang Y M, Chin K S (2010a). Some alternative models for DEA cross-efficiency evaluation. International Journal of Production Economics, 128(1): 332–338
Wang Y M, Chin K S (2010b). A neutral DEA model for cross-efficiency evaluation and its extension. Expert Systems with Applications, 37 (5): 3666–3675
Wang Y M, Chin K S (2011). The use of OWA operator weights for cross-efficiency aggregation. Omega, 39(5): 493–503
Wang Y M, Chin K S, Jiang P (2011a). Weight determination in the cross-efficiency evaluation. Computers & Industrial Engineering, 61 (3): 497–502
Wang Y M, Chin K S, Luo Y (2011b). Cross-efficiency evaluation based on ideal and anti-ideal decision making units. Expert Systems with Applications, 38(8): 10312–10319
Wang Y M, Chin K S, Wang S (2012). DEA models for minimizing weight disparity in cross-efficiency evaluation. Journal of the Operational Research Society, 63(8): 1079–1088
Wang Y M, Greatbanks R, Yang J B (2005). Interval efficiency assessment using data envelopment analysis. Fuzzy Sets and Systems, 153(3): 347–370
Wang Y M, Wang S (2013). Approaches to determining the relative importance weights for cross-efficiency aggregation in data envelopment analysis. Journal of the Operational Research Society, 64(1): 60–69
Wong Y H, Beasley J E (1990). Restricting weight flexibility in data envelopment analysis. Journal of the Operational Research Society, 41(9): 829–835
Wu J, Chu J, Sun J, Zhu Q (2016a). DEA cross-efficiency evaluation based on Pareto improvement. European Journal of Operational Research, 248(2): 571–579
Wu J, Chu J, Sun J, Zhu Q, Liang L (2016b). Extended secondary goal models for weights selection in DEA cross-efficiency evaluation. Computers & Industrial Engineering, 93: 143–151
Wu J, Chu J, Zhu Q, Yin P, Liang L (2016c). DEA cross-efficiency evaluation based on satisfaction degree: An application to technology selection. International Journal of Production Research, 54(20): 5990–6007
Wu J, Huang D, Zhou Z, Zhu Q (2020). The regional green growth and sustainable development of China in the presence of sustainable resources recovered from pollutions. Annals of Operations Research, 290: 27–45
Wu J, Li M, Zhu Q, Zhou Z, Liang L (2019a). Energy and environmental efficiency measurement of China’s industrial sectors: A DEA model with non-homogeneous inputs and outputs. Energy Economics, 78: 468–480
Wu J, Liang L (2012). A multiple criteria ranking method based on game cross-evaluation approach. Annals of Operations Research, 197(1): 191–200
Wu J, Liang L, Chen Y (2009a). DEA game cross-efficiency approach to Olympic rankings. Omega, 37(4): 909–918
Wu J, Liang L, Song M (2010). Performance based clustering for benchmarking of container ports: An application of DEA and cluster analysis technique. International Journal of Computational Intelligence Systems, 3(6): 709–722
Wu J, Liang L, Yang F (2009b). Achievement and benchmarking of countries at the Summer Olympics using cross efficiency evaluation method. European Journal of Operational Research, 197(2): 722–730
Wu J, Liang L, Yang F (2009c). Determination of the weights for the ultimate cross efficiency using Shapley value in cooperative game. Expert Systems with Applications, 36(1): 872–876
Wu J, Liang L, Yang F, Yan H (2009d). Bargaining game model in the evaluation of decision making units. Expert Systems with Applications, 36(3): 4357–4362
Wu J, Liang L, Zha Y (2009e). Preference voting and ranking using DEA game cross efficiency model. Journal of the Operations Research Society of Japan, 52(2): 105–111
Wu J, Liang L, Zha Y, Yang F (2009f). Determination of cross-efficiency under the principle of rank priority in cross-evaluation. Expert Systems with Applications, 36(3): 4826–4829
Wu J, Sun J, Liang L (2012a). Cross efficiency evaluation method based on weight-balanced data envelopment analysis model. Computers & Industrial Engineering, 63(2): 513–519
Wu J, Sun J, Liang L (2012b). DEA cross-efficiency aggregation method based upon Shannon entropy. International Journal of Production Research, 50(23): 6726–6736
Wu J, Sun J, Liang L, Zha Y (2011a). Determination of weights for ultimate cross efficiency using Shannon entropy. Expert Systems with Applications, 38(5): 5162–5165
Wu J, Sun J, Song M, Liang L (2013). A ranking method for DMUs with interval data based on DEA cross-efficiency evaluation and TOPSIS. Journal of Systems Science and Systems Engineering, 22(2): 191–201
Wu J, Sun J, Zha Y, Liang L (2011b). Ranking approach of cross-efficiency based on improved TOPSIS technique. Journal of Systems Engineering and Electronics, 22(4): 604–608
Wu J, Xia P, Zhu Q, Chu J (2019b). Measuring environmental efficiency of thermoelectric power plants: A common equilibrium efficient frontier DEA approach with fixed-sum undesirable output. Annals of Operations Research, 275(2): 731–749
Wu J, Yan H, Liu J (2009g). Groups in DEA based cross-evaluation: An application to Asian container ports. Maritime Policy & Management, 36(6): 545–558
Wu Y C J, Goh M (2010). Container port efficiency in emerging and more advanced markets. Transportation Research Part E, Logistics and Transportation Review, 46(6): 1030–1042
Xu J, Li Z (2012). A review on ecological engineering based engineering management. Omega, 40(3): 368–378
Yang F, Ang S, Xia Q, Yang C (2012). Ranking DMUs by using interval DEA cross efficiency matrix with acceptability analysis. European Journal of Operational Research, 223(2): 483–488
Yang G L, Yang J B, Liu W B, Li X X (2013). Cross-efficiency aggregation in DEA models using the evidential-reasoning approach. European Journal of Operational Research, 231(2): 393–404
Yu M M, Ting S C, Chen M C (2010). Evaluating the cross-efficiency of information sharing in supply chains. Expert Systems with Applications, 37(4): 2891–2897
Yu V F, Hu K J (2014). An integrated approach for resource allocation in manufacturing plants. Applied Mathematics and Computation, 245: 416–426
Zerafat Angiz M, Mustafa A, Kamali M J (2013). Cross-ranking of decision making units in data envelopment analysis. Applied Mathematical Modelling, 37(1–2): 398–405
Zopounidis C, Doumpos M (2002). Multicriteria classification and sorting methods: A literature review. European Journal of Operational Research, 138(2): 229–246
Zoroofchi K H, Farzipoor Saen R, Lari P B, Azadi M (2018). A combination of range-adjusted measure, cross-efficiency and assurance region for assessing sustainability of suppliers in the presence of undesirable factors. International Journal of Industrial and Systems Engineering, 29(2): 163–176
Zoroufchi K H, Azadi M, Farzipoor Saen R (2012). Developing a new cross-efficiency model with undesirable outputs for supplier selection. International Journal of Industrial and Systems Engineering, 12 (4): 470–484
Author information
Authors and Affiliations
Corresponding author
Additional information
This work is financially supported by National Natural Science Foundation of China (Grant Nos. 71971203, 71871153, 71571173, 71501139, and 71921001), the Four Batch Talent Programs of China, and the Fundamental Research Funds for the Central Universities (Grant No. WK2040160028).
Rights and permissions
About this article
Cite this article
Wu, J., Sun, J. & Liang, L. Methods and applications of DEA cross-efficiency: Review and future perspectives. Front. Eng. Manag. 8, 199–211 (2021). https://doi.org/10.1007/s42524-020-0133-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s42524-020-0133-1