Massive open online courses (MOOCs) are gaining popularity, yet they are rarely evaluated using mixed methods that consider the complexity of participants’ demographics, geographic spread, and MOOC design and curricula. In this article, we critically reflect on evaluating the Mixed Methods International Research Association (MMIRA) MOOC. A literature review on MOOCs and how they are evaluated is presented along with a logic model. After a description of the MMIRA MOOC and the multi-phase mixed methods evaluation design, the logic model is used to reflect on conducting a mixed methods evaluation. We conclude with the challenges experienced when evaluating amidst a MOOC’s complexities.