Forecasting material quantity using machine learning and times series techniques

Zermane, Hanane; Madjour, Hassina; Ziar, Ahcene; Zermane, Abderrahim

doi:10.2478/jee-2024-0029

Abstract

The current research is dedicated to harnessing cutting-edge technologies within the paradigm of Industry 5.0. The objective is to capitalize on advancements in Machine and Deep Learning techniques. This research endeavors to construct robust predictive models, utilizing historical data, for precise real-time predictions in estimating material quantities within a cement workshop. Machine Learning regressors evaluated based on several metrics, SVR (R-squared 0.9739, MAE 0.0403), Random Forest (R-squared 0.9990, MAE 0.0026), MLP (R-squared 0.9890, MAE 0.0255), Gradient Boosting (R-squared 0.9989, MAE 0.0042). The time series models LSTM and GRU yielded R-squared 0.9978, MAE 0.0100, and R-squared 0.9980, MAE 0.0099, respectively. The ultimate outcomes include improved and efficient production, optimization of production processes, streamlined operations, reduced downtime, mitigation of potential disruptions, and the facilitation of the factory’s evolution towards intelligent manufacturing processes embedded within the framework of Industry 5.0. These achievements underscore the potential impact of leveraging advanced machine learning techniques for enhancing the operational dynamics and overall efficiency of manufacturing facilities

References

Y. Li, S. Carabelli, E. Fadda, D. Manerba, R. Tadei, and O. Terzo, “Machine learning and optimization for production rescheduling in Industry 4.0,” Int. J. Adv. Manuf. Technol., vol. 110, no. 9–10, pp. 2445–2463, 2020.
Search in Google Scholar Back to article
L. Wang, Z. Liu, A. Liu, and F. Tao, “Artificial intelligence in product lifecycle management,” Int. J. Adv. Manuf. Technol., vol. 114, no. 3–4, pp. 771–796, 2021.
Search in Google Scholar Back to article
A. Sharma, Z. Zhang, and R. Rai, “The interpretive model of manufacturing: a theoretical framework and research agenda for machine learning in manufacturing,” Int. J. Prod. Res., vol. 59, no. 16, pp. 4960–4994, 2021.
Search in Google Scholar Back to article
A. Kusiak, “Smart manufacturing,” Int. J. Prod. Res., vol. 56, no. 1–2, pp. 508–517, 2018.
Search in Google Scholar Back to article
I. Van Heerden and A. Bas, “Viewpoint: Ai as author - bridging the gap between machine learning and literary theory,” J. Artif. Intell. Res., vol. 71, pp. 175–189, 2021.
Search in Google Scholar Back to article
V. A. Spyros Makridakis, Evangelos Spiliotis, “Statistical and Machine Learning forecasting methods: Concerns and ways forward Spyros,” PLoS One, vol. 13, no. 3, pp. 1–26, 2018.
Search in Google Scholar Back to article
L. Breiman, “Random forests,” Mach. Learn., vol. 45, no. 1, pp. 5–32, 2001.
Search in Google Scholar Back to article
A. Zermane, M. Z. Mohd Tohir, H. Zermane, M. R. Baharudin, and H. Mohamed Yusoff, “Predicting fatal fall from heights accidents using random forest classification machine learning model,” Saf. Sci., vol. 159, no. November 2022, p. 106023, 2023.
Search in Google Scholar Back to article
T. Han, B. K. Aylas-Paredes, J. Huang, A. Goel, N. Neithalath, and A. Kumar, “On the Prediction of the Mechanical Properties of Limestone Calcined Clay Cement: A Random Forest Approach Tailored to Cement Chemistry,” Minerals, vol. 13, no. 10, pp. 1–19, 2023.
Search in Google Scholar Back to article
H. Ma, J. Liu, J. Zhang, and J. Huang, “Estimating the Compressive Strength of Cement-Based Materials with Mining Waste Using Support Vector Machine, Decision Tree, and Random Forest Models,” Adv. Civ. Eng., vol. 2021, 2021.
Search in Google Scholar Back to article
B. Lim and S. Zohren, “Time-series forecasting with deep learning: A survey,” Philos. Trans. R. Soc. A Math. Phys. Eng. Sci., vol. 379, no. 2194, 2021.
Search in Google Scholar Back to article
H. Bousnguar, A. Battou, and L. Najdi, “Gated Recurrent units (GRU) for Time Series Forecasting in Higher Education,” Int. J. Eng. Res. Technol., vol. 12, no. 03, pp. 152–154, 2023.
Search in Google Scholar Back to article
R. Dey and F. M. Salemt, “Gate-variants of Gated Recurrent Unit (GRU) neural networks,” in Midwest Symposium on Circuits and Systems, 2017, pp. 1597–1600.
Search in Google Scholar Back to article
Y. Wu et al., “Google’s Neural Machine Translation System: Bridging the Gap between Human and Machine Translation,” arXiv, pp. 1–23, 2016.
Search in Google Scholar Back to article
H. Sak, A. Senior, and F. Beaufays, “Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition,” arXiv, 2014.
Search in Google Scholar Back to article
K. Cho et al., “Learning phrase representations using RNN encoder-decoder for statistical machine translation,” in EMNLP 2014 - 2014 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference, 2014, pp. 1724–1734.
Search in Google Scholar Back to article
J. Chung, C. Gulcehre, K. Cho, and Y. Bengio, “Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling,” pp. 1–9, 2014.
Search in Google Scholar Back to article
S. Hochreiter and J. Schmidhuber, “Long Short-Term Memory,” Neural Comput., vol. 9, pp. 1735–1780, 1997.
Search in Google Scholar Back to article
R. W. S. Makridakis, A. Andersen, R. Carbone, R. Fildes, M. Hibon, R. Lewandowski, J. Newton, E. Parzen, “The Forecasting Accuracy of Major Time Series Methods,” J. Am. Stat. Assoc., vol. 81, no. 393, pp. 262–263, 1986.
Search in Google Scholar Back to article
S. Minami, “Predicting Equity Price with Corporate Action Events Using LSTM-RNN,” J. Math. Financ., vol. 08, no. 01, pp. 58–63, 2018.
Search in Google Scholar Back to article
Y. Xie, “Student Performance Prediction via Attention-Based Multi-Layer Long-Short Term Memory,” J. Comput. Commun., vol. 09, no. 08, pp. 61–79, 2021.
Search in Google Scholar Back to article
G. M. S. Hossain, M. H. O. Rashid, M. R. Islam, A. Sarker, and M. A. Yasmin, “Towards Mining Public Opinion: An Attention-Based Long Short Term Memory Network Using Transfer Learning,” J. Comput. Commun., vol. 10, no. 06, pp. 112–131, 2022.
Search in Google Scholar Back to article
I. Obisakin and C. V. Ekeanyanwu, “State of Health Estimation of Lithium-Ion Batteries Using Support Vector Regression and Long Short-Term Memory,” Open J. Appl. Sci., vol. 12, no. 08, pp. 1366–1382, 2022.
Search in Google Scholar Back to article
Z. Yu, Y. Sun, J. Zhang, Y. Zhang, and Z. Liu, “Gated recurrent unit neural network (GRU) based on quantile regression (QR) predicts reservoir parameters through well logging data,” Front. Earth Sci., vol. 11, no. January, pp. 1–8, 2023.
Search in Google Scholar Back to article
M. Abumohsen, A. Y. Owda, and M. Owda, “Electrical Load Forecasting Using LSTM, GRU, and RNN Algorithms,” Energies, vol. 16, no. 5, pp. 1–31, 2023.
Search in Google Scholar Back to article
S. H. Ahmadi and M. J. Khosrowjerdi, “Fault detection Automation in Distributed Control Systems using Data-driven methods : SVM and KNN,” TechRxiv. Prepr., pp. 0–7, 2021.
Search in Google Scholar Back to article
C. Corinna and V. Vapnik, “Support-Vector Networks,” Mach. Leaming, vol. 20, pp. 273–297, 1995.
Search in Google Scholar Back to article
H. Zermane and A. Drardja, “Development of an efficient cement production monitoring system based on the improved random forest algorithm,” Int. J. Adv. Manuf. Technol., vol. 120, no. 3–4, pp. 1853–1866, 2022.
Search in Google Scholar Back to article
J. P. Usuga Cadavid, S. Lamouri, B. Grabot, R. Pellerin, and A. Fortin, “Machine learning applied in production planning and control: a state-of-the-art in the era of industry 4.0,” J. Intell. Manuf., vol. 31, no. 6, pp. 1531–1558, 2020.
Search in Google Scholar Back to article
T. Mohana-Priya, M. Punithavall, and R. Rajesh-Kanna, “Conceptual Review on Machine Learning Algorithms for Classification Techniques,” Int. J. Sci. Res. Comput. Sci. Eng. Inf. Technol., vol. 7, no. 1, pp. 215–222, 2021.
Search in Google Scholar Back to article
K. Greff, R. K. Srivastava, J. Koutnik, B. R. Steunebrink, and J. Schmidhuber, “LSTM: A Search Space Odyssey,” IEEE Trans. Neural Networks Learn. Syst., vol. 28, no. 10, pp. 2222–2232, 2017.
Search in Google Scholar Back to article
K. Zarzycki and M. Ławryńczuk, “LSTM and GRU neural networks as models of dynamical processes used in predictive control: A comparison of models developed for two chemical reactors,” Sensors, vol. 21, no. 16, 2021.
Search in Google Scholar Back to article
G. Van Houdt, C. Mosquera, and G. Nápoles, “A review on the long short-term memory model,” Artif. Intell. Rev., vol. 53, no. 8, pp. 5929–5955, 2020.
Search in Google Scholar Back to article
N. Zafar, I. U. Haq, J. U. R. Chughtai, and O. Shafiq, “Applying Hybrid Lstm-Gru Model Based on Heterogeneous Data Sources for Traffic Speed Prediction in Urban Areas,” Sensors, vol. 22, no. 9, pp. 1–20, 2022.
Search in Google Scholar Back to article
T. B. Shahi, A. Shrestha, A. Neupane, and W. Guo, “Stock price forecasting with deep learning: A comparative study,” Mathematics, vol. 8, no. 9, pp. 1–15, 2020.
Search in Google Scholar Back to article
R. Fu, Z. Zhang, and L. Li, “Using LSTM and GRU neural network methods for traffic flow prediction,” in Proceedings - 2016 31st Youth Academic Annual Conference of Chinese Association of Automation, YAC 2016, 2017, no. November 2016, pp. 324–328.
Search in Google Scholar Back to article

Forecasting material quantity using machine learning and times series techniques

Abstract

Paradigm

My account