The Haihe River is a typical sluice-controlled river in the north of China. The construction and operation of sluice dams change the flow and other hydrological factors of rivers, which have adverse effects on water, making it difficult to study the characteristics of water quality change and water environment control in northern rivers. In recent years, remote sensing has been widely used in water quality monitoring. However, due to the low signal-to-noise ratio (SNR) and the limitation of instrument resolution, satellite remote sensing is still a challenge to inland water quality monitoring. Ground-based hyperspectral remote sensing has a high temporal-spatial resolution and can be simply fixed in the water edge to achieve real-time continuous detection. A combination of hyperspectral remote sensing devices and BP neural networks is used in the current research to invert water quality parameters. The measured values and remote sensing reflectance of eight water quality parameters (chlorophyll-a (Chl-a), phycocyanin (PC), total suspended sediments (TSS), total nitrogen (TN), total phosphorus (TP), ammonia nitrogen (NH4-N), nitrate-nitrogen (NO3-N), and pH) were modeled and verified. The results show that the performance R-2 of the training model is above 80%, and the performance R-2 of the verification model is above 70%. In the training model, the highest fitting degree is TN (R-2 = 1, RMSE = 0.0012 mg/L), and the lowest fitting degree is PC (R-2 = 0.87, RMSE = 0.0011 mg/L). Therefore, the application of hyperspectral remote sensing technology to water quality detection in the Haihe River is a feasible method. The model built in the hyperspectral remote sensing equipment can help decision-makers to easily understand the real-time changes of water quality parameters.