The resource and environmental problems are compelling the building sector to transition towards a more sustainable and eco-friendly approach. Energy conservation and emission reduction are facilitated by green technology innovation, which is a critical approach to achieving low-carbon transformation. This study uses a two-way fixed effects model to explore the relationship between green technology innovation and carbon emissions. We employ data from listed companies in China's construction sector from 2003 to 2021. Additionally, this paper examines the impact of the government's environmental attention mechanism by employing the moderating effects model. The research findings suggest that there is a negative correlation between carbon emission intensity and the innovation of green technologies. This result remains valid after rigorous testing, considering endogeneity and robustness. The influence of green technology innovation on carbon emissions is enhanced by government environmental concerns. Examining heterogeneity reveals that only firms located in the eastern area exhibit substantial carbon reduction benefits. Furthermore, it is seen that the magnitude of the enterprise's size and the level of marketization positively correlate with the carbon reduction effect of green technology innovation. Ultimately, specific suggestions are provided for the government, industry, and heterogeneity, respectively.