Research Article

Assessing Rural Water Suitability for Small-Scale Aquaculture Using Proximal Policy Optimization: A Deep Reinforcement Learning Case Study from North Macedonia

Authors

Abstract

Water quality plays a vital role in aquaculture sustainability, particularly for sensitive freshwater species such as Salmo letnica, which require strict physicochemical conditions for survival. This study evaluates the suitability of household water sources from eight rural villages in North Macedonia for supporting Salmo letnica in home-based tank environments. Seven key water quality parameters were measured and compared against biological thresholds derived from ecological literature. A Deep Reinforcement Learning (DRL) agent, trained using the Proximal Policy Optimization (PPO) algorithm, was developed to classify the suitability of water samples based on these parameters. While the DRL model exhibited low precision and recall due to the limited sample size, it provided a framework for interpretability through reward dynamics and parameter correlations. Among the eight villages, Forino and Gradec were found to meet all critical biological thresholds, while Kamenjane and Vrapçishte were identified as marginally suitable. The remaining locations exhibited insufficient oxygen levels or excessive nutrient concentrations. These findings demonstrate the potential of AI-based classification models in supporting aquaculture planning and ecological risk assessment. Future work will focus on data expansion, reward function refinement, and field-level model deployment. Unlike traditional supervised classifiers, the DRL agent enables autonomous learning and decision-making without requiring large labeled datasets. This makes the approach suitable for real-time, remote water quality monitoring in resource-limited rural areas.

Keywords:

Aquaculture Suitability Deep Reinforcement Learning Rural Sustainability Salmo Letnica Smart Aquaculture Water Quality

Article information

Journal

Journal of Computer, Software, and Program

Volume (Issue)

2(1), (2025)

Pages

30-38

Published

17-06-2025

How to Cite

Bajrami, E. (2025). Assessing Rural Water Suitability for Small-Scale Aquaculture Using Proximal Policy Optimization: A Deep Reinforcement Learning Case Study from North Macedonia. Journal of Computer, Software, and Program, 2(1), 30-38. https://doi.org/10.69739/jcsp.v2i1.556

References

Abyaneh, H. Z. (2014). Evaluation of multivariate linear regression and artificial neural networks in prediction of water quality parameters. Journal of Environmental Health Science and Engineering, 12, 1-8. https://doi.org/10.1186/2052-336X-12-40

Amir Hamzeh Haghiabi, A. H. (2018). Water quality prediction using machine learning methods. Water Quality Research Journal, 3-13. https://doi.org/10.2166/wqrj.2018.025

Bagheri, M. A. (2019). Advanced control of membrane fouling in filtration systems using artificial intelligence and machine learning techniques: A critical review. Process Safety and Environmental Protection, 123, 229–252. https://doi.org/10.1016/j.psep.2019.01.013

Chen, S. F. (2018). Water Quality Prediction Model of a Water Diversion Project Based on the Improved Artificial Bee Colony–Backpropagation Neural Network. Water, 806. https://doi.org/10.3390/w10060806

Du, Y., Chen, F., Zhou, L., Qiu, T., & Sun, J. (2020). Effects of different layouts of fine-pore aeration tubes on sewage collection and aeration in rectangular water tanks. Aquacultural Engineering, 89, 102060. https://doi.org/10.1016/j.aquaeng.2020.102060

Fijani, E., Barzegar, R., Deo, R., Tziritis, E., & Skordas, K. (2019). Design and implementation of a hybrid model based on two-layer decomposition method coupled with extreme learning machines to support real-time environmental monitoring of water quality parameters. Science of the total environment, 648, 839-853. https://doi.org/10.1016/j.scitotenv.2018.08.221

Freyhof, M. K. (2007). Handbook of European freshwater fishes. Ichthyological Research, 99. https://doi.org/10.1007/s10228-007-0012-3

Gazzaz, N. M., Yusoff, M. K., Aris, A. Z., Juahir, H., & Ramli, M. F. (2012). Artificial neural network modeling of the water quality index for Kinta River (Malaysia) using water quality variables as predictors. Marine pollution bulletin, 64(11), 2409-2420. https://doi.org/10.1016/j.marpolbul.2012.08.005

Huo, S., He, Z., Su, J., Xi, B., & Zhu, C. (2013). Using artificial neural network models for eutrophication prediction. Procedia Environmental Sciences, 18, 310-316. https://doi.org/10.1016/j.proenv.2013.04.040

Kiran Tota-Maharaj, M. S. (2011). Artificial Neural Network Simulation of Combined Permeable Pavement and Earth Energy Systems Treating Storm Water. Journal of Environmental Engineering, 138(4), 499-509. https://doi.org/10.1061/(ASCE)EE.1943-7870.0000497

N. S. Pagadala, M. M. (2023). Water Quality Prediction Using Machine Learning Techniques. 10th International Conference on Signal Processing and Integrated Networks (SPIN) (pp. 358-362). Noida, India: IEEE. https://doi.org/10.1109/SPIN57001.2023.10117415

Nallakaruppan, M. K., Gangadevi, E., Shri, M. L., Balusamy, B., Bhattacharya, S., & Selvarajan, S. (2024). Reliable water quality prediction and parametric analysis using explainable AI models. Scientific Reports, 14(1), 7520. https://doi.org/10.1038/s41598-024-56775-y

Nasir, N., Kansal, A., Alshaltone, O., Barneih, F., Sameer, M., Shanableh, A., & Al-Shamma’a, A. (2022). Water quality classification using machine learning algorithms. Journal of Water Process Engineering, 48, 102920.

Shams, M. Y., Elshewey, A. M., El-Kenawy, E. S. M., Ibrahim, A., Talaat, F. M., & Tarek, Z. (2024). Water quality prediction using machine learning models based on grid search method. Multimedia Tools and Applications, 83(12), 35307-35334. https://doi.org/10.1007/s11042-023-16737-4

Xizhi Nong, Y. H. (2025). Machine learning-based evolution of water quality prediction model: An integrated robust framework for comparative application on periodic return and jitter data. Environmental Pollution, 125834. https://doi.org/10.1016/j.envpol.2025.125834

Downloads

Views

54

Downloads

13