Estimating the urban atmospheric boundary layer height from remote sensing applying machine learning techniques

This study proposes a new methodology to estimate the Atmospheric Boundary Layer Height (ABLH), discriminating between Convective Boundary Layer and Stable Boundary Layer heights, based on the machine learning algorithm known as Gradient Boosting Regression Tree. The algorithm proposed here uses a first estimation of the ABLH derived applying the gradient method to a ceilometer signal and several meteorological variables to obtain ABLH values comparable to those derived from a microwave radiometer. A deep analysis of the model configuration and its inputs has been performed in order to avoid the model overfitting and ensure its applicability. The hourly and seasonal values and variability of the ABLH values obtained with the new algorithm have been analyzed and compared with the initial estimations obtained using only the ceilometer signal. Mean Relative Errors (MRE) between the ABLH estimated with the new algorithm and microwave radiometer show a daily pattern with their highest values during the night-time (stable situations) and their lowest values along the day-time (convective situations). This pattern has been observed for all the seasons with MRE ranging between-5% and 35%. This result notably improves those ABLH values derived by applying the gradient method to ceilometer data during convective situations and enables the Stable Boundary Layer height detection at night and early morning, instead of only Residual Layer top height. Finally, the model performance has been directly validated in three particular cases: clear-sky day, presence of low-clouds and dust outbreak event. In these three particular situations, ABLH values obtained with the new algorithm follow the pattern obtained with the microwave radiometer presenting very similar values, thus confirming the good model performance. In this way it is feasible by the combination of the proposed method with gradient method, to estimate Convective, Stable and Residual Boundary Layer height from ceilometer data and surface meteorological data in extended network that include ceilometer profiling.

Automated summary

This study proposes a new methodology to estimate Atmospheric Boundary Layer Height (ABLH) using the machine learning algorithm Gradient Boosting Regression Tree. The proposed algorithm utilizes a first estimation of ABLH derived from a ceilometer signal and meteorological variables. The model's configuration and inputs are analyzed to prevent overfitting and ensure applicability. The ABLH values obtained from the algorithm are compared to those derived from a microwave radiometer, showing a daily pattern and seasonal variability. The model has been validated in different situations, confirming its good performance.