The water and sediment characteristics of the Yellow River are related to the development of the river basin and have great significance in determining the future trends in sediment load. In this study, the water and sediment characteristics and influencing factors were analyzed. The correlations among hydrological and sediment parameters were further analyzed. The results showed that the annual average sediment concentration (AASC), the annual sediment load (ASL), the median grain size of sediment (MGSS) and the annual sediment transport modulus (ASTM) decreased. Therefore, the sediment control effect of the tributaries was significant. The annual runoff (AR) of the hydrological stations in the Yellow River increased from 2002 to 2019. Altogether, AASC and ASL of the Yellow River showed a downward trend. The sediment was reduced by water storage and sediment detention of reservoirs. AASC and ASL increased significantly due to water and sediment regulation tests and floods. However, the silt in the river channel could be washed with the help of current scouring and flood to slow down the silt. There was a strong correlation between AASC and ASL, whether the Yellow River or its tributaries. Besides, there was a significant impact of AASC and ASL of the tributaries on the sediment of the Yellow River, showing that the sediment control of the tributaries was essential. The sediment in the main tributaries and the Yellow River showed a decreasing trend from 2002 to 2019, which is conducive to the ecological harmony and stability of the Yellow River.