Have a personal or library account? Click to login
Towards Ensuring Software Interoperability Between Deep Learning Frameworks Cover

Towards Ensuring Software Interoperability Between Deep Learning Frameworks

Open Access
|Oct 2023

References

  1. G. Nguyen, S. Dlugolinsky, M. Bobák, V. Tran,Á. López García, I. Heredia, P. Malík, and L. Hluchý, Machine learning and deep learning frameworks and libraries for large-scale data mining: a survey, Artificial Intelligence Review, 52, 2019, pages 77-124.
  2. S. Pouyanfar, S. Sadiq, Y. Yan, H. Tian, Y. Tao, M.P. Reyes, M.L. Shyu, S.C. Chen, S.S. and Iyengar, A survey on deep learning: Algorithms, techniques, and applications, ACM Computing Surveys (CSUR), 51(5), 2018, pages 1-36.
  3. M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G.S. Corrado, A. Davis, J. Dean, M. Devin, and S. Ghemawat, Tensorflow: Large-scale machine learning on heterogeneous distributed systems, 2016, arXiv:1603.04467.
  4. F. Chollet, Keras: The python deep learning library, 2015, https://github.com/fchollet/keras.
  5. A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, L. Antiga, and A. Desmaison, Pytorch: An imperative style, high-performance deep learning library, Advances in neural information processing systems, 32, 2019.
  6. Y. Cheng, D. Wang, P. Zhou, and T. Zhang, A survey of model compression and acceleration for deep neural networks, 2017, arXiv:1710.09282.
  7. T.G. Dietterich, Ensemble learning, In: The handbook of brain theory and neural networks, The MIT Press, 2002, pages 110-125.
  8. J. Gao, P. Li, Z. Chen, and J. Zhang, A survey on deep learning for multimodal data fusion, Neural Computation, 32(5), 2020, pages 829-864.
  9. Facebook and Microsoft, ONNX: Open Neural Network Exchange, 2017, https://github.com/onnx/onnx.
  10. The Khronos Group, Neural Network Exchange Format (NNEF), 2016, https://www.khronos.org/nnef.
  11. Y. Liu, C. Chen, R. Zhang, T. Qin, X. Ji, H. Lin, and M. Yang, Enhancing the interoperability between deep learning frameworks by model conversion, In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 2020, pages 1320-1330.
  12. Hahnyuan, Neural network tools: Converter and analyzer, 2017, https://github.com/hahnyuan/nntools.
  13. Gmalivenko, pytorch2keras: Pytorch to keras model convertor, 2019, https://github.com/gmalivenko/pytorch2keras.
  14. Z. Chen, Y. Cao, Y. Liu, H. Wang, T. Xie, and X. Liu, A comprehensive study on challenges in deploying deep learning based software, In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 2020, pages 750-762.
  15. M. Openja, A. Nikanjam, A.H. Yahmed, F. Khomh, and Z.M.J. Jiang, An empirical study of challenges in converting deep learning models, In 2022 IEEE International Conference on Software Maintenance and Evolution (ICSME), 2022, pages 13-23.
  16. H. Pham, Software reliability, Springer Science& Business Media, 2000.
  17. J. Schumann, P. Gupta, and S. Nelson, On verification & validation of neural network based controllers, EANN’03, 2003.
  18. Facebook, CAFFE2, 2017, https://caffe2.ai/.
  19. Apache Software Foundation, A flexible and efficient library for Deep Learning, 2017, https://mxnet.apache.org/versions/1.9.1/.
  20. Y. Jia, E. Shelhamer, F. Donahue, S. Karayev, K. Long, R. Girshick, S. Guadarrama, and T. Darrell, Caffe: Convolutional architecture for fast feature embedding, In Proceedings of the 22nd ACM international conference on Multimedia, 2014, pages 675-678.
  21. Woodsgao, pytorch2caffe, 2010, https://github.com/woodsgao/pytorch2caffe.
  22. Darshan, Torch to ONNX conversion going wrong, 2021, https://discuss.pytorch.org/t/torch-to-onnx-conversion-going-wrong/121596.
  23. ys.yusaito, Inference result is different between Pytorch and ONNX model, 2022, https://discuss.pytorch.org/t/inference-result-is-different-between-pytorch-and-onnx-model/147228/1.
  24. J. Schumann, and K. Goseva-Popstojanova, Verification and validation approaches for model-based software engineering, In 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C), 2019, pages 514-518.
  25. L. Roeder, Netron, 2020, https://netron.app/.
  26. T. Fawcett, An introduction to ROC analysis. Pattern recognition letters, 27(8), 2006, pages 861-874.
  27. Y. Jiang, Prediction of monthly mean daily diffuse solar radiation using artificial neural networks and comparison with other empirical models, Energy policy, 36(10), 2008, pages 3833-3837.
  28. S. Zeiml, U. Seiler, K. Altendorfer, and T. Felber-bauer, Simulation evaluation of automated forecast error correction based on mean percentage error, In 2020 Winter Simulation Conference (WSC), 2020, pages 1572-1583.
  29. M. Nejadgholi, and J. Yang, A study of oracle approximations in testing deep learning libraries, In 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE), 2019, pages 785-796.
  30. M.V. Shcherbakov, A. Brebels, N.L. Shcherbakova, A.P. Tyukov, T.A. Janovsky, and V.A.E. Kamaev, A survey of forecast error measures, World applied sciences journal, 24(24), 2013, pages 171-176.
  31. H. Li, W. Ma, Y. Lian, and X. Wang, Estimating daily global solar radiation by day of year in China, Applied Energy, 87(10), 2010, pages 3011-3017.
  32. K. Simonyan, and A. Zisserman, Very deep convolutional networks for large-scale image recognition, 2014, arXiv:1409.1556.
  33. L. Deng, The mnist database of handwritten digit images for machine learning research [best of the web], IEEE signal processing magazine, 29(6), 2012, pages 141-142.
  34. A. Krizhevsky, I. Sutskever, and G.E. Hinton, Imagenet classification with deep convolutional neural networks, Communications of the ACM, 60(6), 2017, pages 84-90.
  35. Android Google, Keeping your app responsive, 2017, https://developer.android.com/training/articles/perfanr.html.
  36. G. Kechit, Top 10 deep learning frameworks in 2022 you can’t ignore, 2022, https://www.upgrad.com/blog/top-deep-learning-frameworks.
  37. O.G. Yalçın, Top 5 Deep Learning Frameworks to Watch in 2021 and Why TensorFlow, 2021, https://towardsdatascience.com/top-5-deep-learning-frameworks-to-watch-in-2021-and-whytensorflow-98d8d6667351.
Language: English
Page range: 215 - 228
Submitted on: Jun 26, 2023
Accepted on: Sep 11, 2023
Published on: Oct 30, 2023
Published by: SAN University
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2023 Youn Kyu Lee, Seong Hee Park, Min Young Lim, Soo-Hyun Lee, Jongwook Jeong, published by SAN University
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.