Subsistence agriculture, the cultivation of subsistence cereals including millets, oilseeds, and pulses, is the major occupation and source of livelihood for people in the Garhwal region. Over time, the production and yield of subsistence agriculture have drastically reduced. This study examines the practices of subsistence agriculture, the major drivers of declining agriculture, and its implications on the livelihood of marginal farmers. Data were gathered from eight villages in four districts, using a household-level survey. A total of 376 households inhabit these villages. We surveyed 207 households (55%) who were fully engaged in practicing subsistence agriculture purposively. A structured questionnaire was constructed, and questions were asked to the heads of households regarding the area, production, and productivity of principal crops during 2000–2020. Data were analyzed using statistical methods. This study depicted that traditional agriculture has been declining, with a 50% decrease in the area, production, and productivity of crops noticed during the last 20 years. The decrease was mainly attributed to climate change, extreme geo-hydrological disasters, crop damage by wildlife, increasing population, decreasing landholdings, low soil fertility, low output from arable land, mono-cropping, and a lack of use of modern technology. The implications of declining subsistence agriculture include out-migration, land abandonment, and livelihood insecurity.