Self-Supervised Vision Transformers Improve Crop Yield Prediction from Satellite Imagery
PDF

Keywords

self-supervised learning
vision transformer
satellite imagery
crop yield prediction
Sentinel-2
masked autoencoding
remote sensing
precision agriculture

Abstract

Accurate and timely crop yield prediction is critical for global food security, agricultural resource allocation, and early warning systems for potential supply disruptions. Conventional approaches based on process-based simulation models and handcrafted spectral features struggle to scale across diverse geographies and are heavily reliant on large volumes of labeled ground-truth data, which are expensive and laborious to collect. Recent advances in deep learning, particularly vision transformers (ViTs) and self-supervised learning (SSL), offer a promising avenue to overcome these limitations by enabling models to learn powerful spatiotemporal representations from abundant unlabeled satellite imagery. This paper proposes a framework that leverages SSL-pretrained ViTs fine-tuned on multi-temporal Sentinel-2 satellite imagery for county-level crop yield prediction across the U.S. Corn Belt. We systematically evaluate the proposed approach against supervised CNN baselines and LSTM networks. Experimental results demonstrate that SSL pre-training significantly reduces prediction error and improves data efficiency, achieving an RMSE of 4.71 bushels per acre and an R² of 0.89 for maize yield prediction with only 20% of available labeled data. This study underscores the potential of self-supervised ViT-based models to advance large-scale precision agriculture through scalable, label-efficient learning from satellite observations.

PDF

References

Pant, J., Pant, R. P., Singh, M. K., Singh, D. P., & Pant, H. (2021). Analysis of agricultural crop yield prediction using statistical techniques of machine learning. Materials Today: Proceedings, 46, 10922-10926.

Ge, Y., Wang, Y., Liu, J., & Wang, J. (2025). GAN-enhanced implied volatility surface reconstruction for option pricing error mitigation. IEEE Access.

Chen, Z., Liu, J., & Chen, J. (2025). Machine Learning Methods for Financial Forecasting in Enterprise Planning: Transitioning from Rule-Based Models to Predictive Analytics. Frontiers in Artificial Intelligence Research, 2(3), 541-564.

Liu, J., Wang, J., Chen, H., Guinness, J., Martin, R., & Kulkarni, C. S. (2019). Optimal Level Crossing Predictions for Electronic Prognostics. In AIAA Scitech 2019 Forum (p. 1962).

Liu, J., Wang, Y., & Lin, H. (2025). Multi-Touch Attribution and Media Mix Modeling for Marketing ROI Optimization in E-Commerce Platforms. Frontiers in Business and Finance, 2(02), 378-398.

Yang, Y., Wang, M., Wang, J., Li, P., & Zhou, M. (2025). Multi-agent deep reinforcement learning for integrated demand forecasting and inventory optimization in sensor-enabled retail supply chains. Sensors, 25(8), 2428.

Zhang, X., Li, P., Han, X., Yang, Y., & Cui, Y. (2024). Enhancing time series product demand forecasting with hybrid attention-based deep learning models. IEEE Access, 12, 190079-190091.

Li, P., Ren, S., Zhang, Q., Wang, X., & Liu, Y. (2024). Think4SCND: Reinforcement learning with thinking model for dynamic supply chain network design. IEEE Access, 12, 195974-195985.

Yang, J., Li, P., Cui, Y., Han, X., & Zhou, M. (2025). Multi-sensor temporal fusion transformer for stock performance prediction: An adaptive Sharpe ratio approach. Sensors, 25(3), 976.

Zhang, X., Sun, T., Han, X., Yang, Y., & Li, P. (2025). Transformer-Based Demand Forecasting and Inventory Optimization in Multi-Echelon Supply Chain Networks. Journal of Banking and Financial Dynamics, 9(12), 1-9.

Liu, Y., Ren, S., Wang, X., & Zhou, M. (2024). Temporal logical attention network for log-based anomaly detection in distributed systems. Sensors, 24(24), 7949.

Liu, Y., Hu, X., & Chen, S. (2024). Multi-material 3D printing and computational design in pharmaceutical tablet manufacturing. J. Comput. Sci. Artif. Intell, 1(1), 34-38.

Liu, C. L., Tseng, C. J., Huang, T. H., Yang, J. S., & Huang, K. B. (2023). A multi-task learning model for building electrical load prediction. Energy and Buildings, 278, 112601.

Liu, C. L., Chang, T. Y., Yang, J. S., & Huang, K. B. (2023). A deep learning sequence model based on self-attention and convolution for wind power prediction. Renewable Energy, 219, 119399.

Xing, S., & Wang, Y. (2025). Proactive data placement in heterogeneous storage systems via predictive multi-objective reinforcement learning. IEEE Access.

Xing, S., Wang, Y., & Liu, W. (2025). Self-adapting CPU scheduling for mixed database workloads via hierarchical deep reinforcement learning. Symmetry, 17(7), 1109.

Sun, T., Yang, J., Li, J., Chen, J., Liu, M., Fan, L., & Wang, X. (2024). Enhancing auto insurance risk evaluation with transformer and SHAP. IEEE Access, 12, 116546-116557.

Ma, Z., Chen, X., Sun, T., Wang, X., Wu, Y. C., & Zhou, M. (2024). Blockchain-based zero-trust supply chain security integrated with deep reinforcement learning for inventory optimization. Future Internet, 16(5), 163.

Li, J., Fan, L., Wang, X., Sun, T., & Zhou, M. (2024). Product demand prediction with spatial graph neural networks. Applied Sciences, 14(16), 6989.

Wei, Z., Sun, T., & Zhou, M. (2024). LIRL: Latent Imagination-Based Reinforcement Learning for Efficient Coverage Path Planning. Symmetry, 16(11), 1537.

Wang, M. (2024). AI technologies in modern taxation: Applications, challenges, and strategic directions. International Journal of Finance and Investment, 1(1), 42-46.

Liu, J., Wang, J., & Lin, H. (2025). Coordinated Physics-Informed Multi-Agent Reinforcement Learning for Risk-Aware Supply Chain Optimization. IEEE Access, 13, 190980-190993.

Wang, J., Liu, J., Zheng, W., & Ge, Y. (2025). Temporal heterogeneous graph contrastive learning for fraud detection in credit card transactions. IEEE Access.

Tseng, G., Cartuyvels, R., Zvonkov, I., Purohit, M., Rolnick, D., & Kerner, H. (2023). Lightweight, pre-trained transformers for remote sensing timeseries. arXiv preprint arXiv:2304.14065.

Garnot, V. S. F., & Landrieu, L. (2021). Panoptic segmentation of satellite image time series with convolutional temporal attention networks. In Proceedings of the IEEE/CVF International Conference on Computer Vision (pp. 4872-4881).

Jakubik, J., Roy, S., Phillips, C. E., Fraccaro, P., Godwin, D., Zadrozny, B., ... & Ramachandran, R. (2023). Foundation models for generalist geospatial artificial intelligence. arXiv preprint arXiv:2310.18660.

Kussul, N., Shelestov, A., Yailymova, H., Shumilo, L., & Drozd, S. (2022, July). Agriculture land appraisal with use of remote sensing and infrastructure data. In IGARSS 2022-2022 IEEE International Geoscience and Remote Sensing Symposium (pp. 2785-2788). IEEE.

Han, J., Shi, L., Yang, Q., Huang, K., Zha, Y., & Yu, J. (2021). Real-time detection of rice phenology through convolutional neural network using handheld camera images. Precision Agriculture, 22(1), 154-178.

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright (c) 2026 Haoran Meng, Zixu Pan, Sofia Lindström (Author)

Downloads

Download data is not yet available.