Article section
Assessing Rural Water Suitability for Small-Scale Aquaculture Using Proximal Policy Optimization: A Deep Reinforcement Learning Case Study from North Macedonia
Abstract
Water quality plays a vital role in aquaculture sustainability, particularly for sensitive freshwater species such as Salmo letnica, which require strict physicochemical conditions for survival. This study evaluates the suitability of household water sources from eight rural villages in North Macedonia for supporting Salmo letnica in home-based tank environments. Seven key water quality parameters were measured and compared against biological thresholds derived from ecological literature. A Deep Reinforcement Learning (DRL) agent, trained using the Proximal Policy Optimization (PPO) algorithm, was developed to classify the suitability of water samples based on these parameters. While the DRL model exhibited low precision and recall due to the limited sample size, it provided a framework for interpretability through reward dynamics and parameter correlations. Among the eight villages, Forino and Gradec were found to meet all critical biological thresholds, while Kamenjane and Vrapçishte were identified as marginally suitable. The remaining locations exhibited insufficient oxygen levels or excessive nutrient concentrations. These findings demonstrate the potential of AI-based classification models in supporting aquaculture planning and ecological risk assessment. Future work will focus on data expansion, reward function refinement, and field-level model deployment. Unlike traditional supervised classifiers, the DRL agent enables autonomous learning and decision-making without requiring large labeled datasets. This makes the approach suitable for real-time, remote water quality monitoring in resource-limited rural areas.
Keywords:
Aquaculture Suitability Deep Reinforcement Learning Rural Sustainability Salmo Letnica Smart Aquaculture Water Quality
Article information
Journal
Journal of Computer, Software, and Program
Volume (Issue)
2(1), (2025)
Pages
30-38
Published
Copyright
Copyright (c) 2025 Enes Bajrami (Author)
Open access

This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
References
Abyaneh, H. Z. (2014). Evaluation of multivariate linear regression and artificial neural networks in prediction of water quality parameters. Journal of Environmental Health Science and Engineering, 12, 1-8. https://doi.org/10.1186/2052-336X-12-40
Amir Hamzeh Haghiabi, A. H. (2018). Water quality prediction using machine learning methods. Water Quality Research Journal, 3-13. https://doi.org/10.2166/wqrj.2018.025
Bagheri, M. A. (2019). Advanced control of membrane fouling in filtration systems using artificial intelligence and machine learning techniques: A critical review. Process Safety and Environmental Protection, 123, 229–252. https://doi.org/10.1016/j.psep.2019.01.013
Chen, S. F. (2018). Water Quality Prediction Model of a Water Diversion Project Based on the Improved Artificial Bee Colony–Backpropagation Neural Network. Water, 806. https://doi.org/10.3390/w10060806
Du, Y., Chen, F., Zhou, L., Qiu, T., & Sun, J. (2020). Effects of different layouts of fine-pore aeration tubes on sewage collection and aeration in rectangular water tanks. Aquacultural Engineering, 89, 102060. https://doi.org/10.1016/j.aquaeng.2020.102060
Fijani, E., Barzegar, R., Deo, R., Tziritis, E., & Skordas, K. (2019). Design and implementation of a hybrid model based on two-layer decomposition method coupled with extreme learning machines to support real-time environmental monitoring of water quality parameters. Science of the total environment, 648, 839-853. https://doi.org/10.1016/j.scitotenv.2018.08.221
Freyhof, M. K. (2007). Handbook of European freshwater fishes. Ichthyological Research, 99. https://doi.org/10.1007/s10228-007-0012-3
Gazzaz, N. M., Yusoff, M. K., Aris, A. Z., Juahir, H., & Ramli, M. F. (2012). Artificial neural network modeling of the water quality index for Kinta River (Malaysia) using water quality variables as predictors. Marine pollution bulletin, 64(11), 2409-2420. https://doi.org/10.1016/j.marpolbul.2012.08.005
Huo, S., He, Z., Su, J., Xi, B., & Zhu, C. (2013). Using artificial neural network models for eutrophication prediction. Procedia Environmental Sciences, 18, 310-316. https://doi.org/10.1016/j.proenv.2013.04.040
Kiran Tota-Maharaj, M. S. (2011). Artificial Neural Network Simulation of Combined Permeable Pavement and Earth Energy Systems Treating Storm Water. Journal of Environmental Engineering, 138(4), 499-509. https://doi.org/10.1061/(ASCE)EE.1943-7870.0000497
N. S. Pagadala, M. M. (2023). Water Quality Prediction Using Machine Learning Techniques. 10th International Conference on Signal Processing and Integrated Networks (SPIN) (pp. 358-362). Noida, India: IEEE. https://doi.org/10.1109/SPIN57001.2023.10117415
Nallakaruppan, M. K., Gangadevi, E., Shri, M. L., Balusamy, B., Bhattacharya, S., & Selvarajan, S. (2024). Reliable water quality prediction and parametric analysis using explainable AI models. Scientific Reports, 14(1), 7520. https://doi.org/10.1038/s41598-024-56775-y
Nasir, N., Kansal, A., Alshaltone, O., Barneih, F., Sameer, M., Shanableh, A., & Al-Shamma’a, A. (2022). Water quality classification using machine learning algorithms. Journal of Water Process Engineering, 48, 102920.
Shams, M. Y., Elshewey, A. M., El-Kenawy, E. S. M., Ibrahim, A., Talaat, F. M., & Tarek, Z. (2024). Water quality prediction using machine learning models based on grid search method. Multimedia Tools and Applications, 83(12), 35307-35334. https://doi.org/10.1007/s11042-023-16737-4
Xizhi Nong, Y. H. (2025). Machine learning-based evolution of water quality prediction model: An integrated robust framework for comparative application on periodic return and jitter data. Environmental Pollution, 125834. https://doi.org/10.1016/j.envpol.2025.125834