Everyday activities are jointly shaped by people and artefacts. This points to the need for tools that designers can use to examine the joint agency of people and artefacts. This paper reports progress in developing Activity Scenario Modelling (ASM), a design approach that can be used for such purpose. ASM combines techniques of video analysis, discourse analysis and social network analysis. The paper provides an overview of the theoretical foundations of ASM and illustrates it by modelling an activity scenario from an online tutorial on tea-making. The paper also describes a research agenda to apply ASM in design for sustainability efforts.