VUIs are trendy and highly available, but challenges such as privacy, understanding the dialogue, and its context remain. Therefore, we see a demand for UX assessment for VUIs considering the context of use. We identified and categorized 32 UX aspects for VUIs and constructed voice quality scales. Furthermore, we split the VUI context of use into quantifiable parts, which we mapped to relevant UX qualities. Our method considered contextual UX by combining the concepts of the context of use and UX. This approach helps to describe the VUI context of use for realizing the context-dependent UX measurement recommendations for VUIs.