[Objective] The water holding characteristics of soil and litter in low-efficiency of Chinese fir trees with different gap sizes and ages were investigated to provide a theoretical basis for improving the tree quality in low-efficiency Chinese fir forests. [Methods] Gap ages of 4, 15, 30, and 50 years were selected based on the results of the space-time substitution method, and the climax community was used as the control. Four treatments were set for each gap age: small (≤50 m²), medium (50—100 m²), and large (≥100 m²) gaps, as well as a non-gap control. The water holding characteristics of soil and litter were determined using the cutting-ring method, oven drying method, and litter soaking methods, respectively. [Results] ① Only the gap age had a significant effect on the water-holding characteristics of soil and litter, whereas the gap size and the interaction between gap age and size had no significant effect. ② The best soil water holding capacity was observed in the 4-year-forest gap, and the best standing crop, maximum water-holding capacity, maximum water-holding rate, natural water holding capacity, and effective storage capacity of semi-decomposed litter was observed in the 15-year-forest gap. ③ The water holding rate of litter in different gap ages changed with soaking time; the middle and large gaps performed the best, and the water-holding capacity of the semi-decomposed layer was stronger than that of the undecomposed layer. ④ The natural water-holding capacity of semi-decomposed litter was significantly positively correlated with soil capillary porosity, field water-holding capacity, and capillary water-holding capacity. [Conclusion] The water-holding capacity of soil and litter was good in the 4 and 15-year-forest gaps. Based on our results, the artificial opening of a medium-sized forest gap could be used as an important technical means to improve the quality of low-efficiency Chinese fir forest.