Impact and Evaluation Manager or Director, Learning Equality

Learning Equality - Remote - Full time

Hundreds of millions of children, youth, and adults around the globe lack access to quality education. Learning Equality strives to address this inequity by creating products and tools that can be adapted and contextualized to meet learning needs, with or without Internet access.

Founded as a nonprofit organization in 2013 by a group of students, Learning Equality first launched KA Lite, our first-generation platform which brought the Khan Academy videos and exercises offline. Learning Equality expanded on that product in 2017 to createKolibri, an adaptable end-to-end suite of open-source tools, educational resources, and support materials designed for offline-first teaching and learning. To date, Kolibri has been translated into 23 languages and is being used in over 200 countries and territories.

Learning Equality is directly supporting the implementation of Kolibri with collaborators in more than 30 countries, including UN Women, Vodafone Foundation, UNICEF, and UNHCR, as well as a global network of organic adopters advocating for learning opportunities in their communities. With the support of organizations such as Google.org, the Hewlett Foundation, and the nonprofit tech accelerator Fast Forward, we are continuing to grow our products to be able to reach more communities around the world.

We are seeking an Impact and Evaluation Manager or Director to help us measure and communicate the impact of our work. This is a new, full-time position, and we’re looking for someone who is excited by the challenge of driving innovation in monitoring, evaluation, and research practices and whose methodology strongly aligns with Learning Equality's mission to bring quality education to under-resourced communities around the world.

What does monitoring, evaluation, research, and learning look like at Learning Equality?

Learning Equality develops a product ecosystem and supports its effective use through specialized services, but we don’t design or implement interventions featuring our products and tools ourselves. Instead, we collaborate with different types of organizations who rely on our work for their own programs, from individual users, to small collectives, to school districts, to international NGOs and UN agencies. In this role, your responsibilities will include developing processes for collecting informal feedback, informing impact evaluation plans for our collaborations, and sharing recommendations both internally and externally.

Some of the projects you could be working on or advising others about in a given month include:

  • Creating guides and evaluation instruments for implementing organizations around the world who are leveraging Kolibri, to help understand the impact of their specific interventions (for example, creating survey instruments for a three-year program improving literacy and numeracy skills for children with disabilities, in a country with limited or no prior Kolibri implementations)
  • Evaluating the effectiveness of a Kolibri training of trainers workshop and providing guidance on program design for a multi-country intervention, in which Learning Equality is only one of the partners
  • Using evaluation findings to revisit the design of a specific new feature on one of our products and measure its effect on teaching and learning
  • Devising a strategy with your teammates to help communicate the value of a new, as yet hypothetical approach we’re suggesting around selecting learning materials, adjusting our training approach, or resolving a capacity issue
  • Querying one of our internal databases to gather data to understand how Kolibri is being used in different learning environments as it relates to syncing, installation, teaching practices or content engagement patterns
  • Making your way through a highly technical, jargon-filled interaction with other professional evaluators or enthusiasts (about choosing a quasi-experimental or randomized controlled trial sampling method for a new grant) and then translating the industry terminology for interested teammates

What does evidence look like at Learning Equality and what sources of data do you have access to?

We derive insights about our model, products, and initiatives from:

  • Learning and teaching data. We receive information about learning-related engagement for both learners and educators - such as the number of active learners or educators, number of lessons created by a teacher, and completion or mastery of exercises - via our Kolibri Learning Platform, but because we operate in challenging offline environments, our learning data isn’t always of the scale and scope you might expect from online learning platforms. With your help, we’ll also be further developing the Kolibri Data Portal, a central online platform for the aggregation, exploration, and reporting of learner data.
  • Content analytics. We learn more about our content inventory - such as an analysis of the most popular content sources, or how many sources are user-generated - via Kolibri Studio, our web-based curriculum tool which gives users control over the organization of their materials.
  • Qualitative user research. As an organization and in collaboration with others, we develop instruments for, and receive outputs from, qualitative user research methods, including focus groups and interviews, usability tests, classroom observations, surveys, and more.
  • Partner and peer collaborations. We learn from subject matter experts in all our collaborations and often produce and receive needs assessments, theories of change, log frames, indicators, and other reporting and policy-based instruments.

Through your work with these data sources, you’ll help us build better products, support our user community, and contribute to overall organizational sustainability.

This position might be for you if...

You have:

  • Led program evaluations using your research skills. You have experience exploring and presenting actionable findings about communicating effectiveness, refining efficiency, isolating effects, defining program models, and sharing these outputs for both technical and non-technical audiences
  • Used evaluation findings to drive tangible and practical change at an organization, internally and externally. This might look like recommending changes to a strategy, demonstrating effects to funders, shaping a collaboration, or making product and program adjustments
  • Created and used research protocols with vulnerable populations, especially in the Global South, and can upskill us in equitable research and evaluation practices (such as research with non-native English speakers, human subjects research protocols, participatory action research, anonymization and privacy, safeguarding, and trauma informed research methods)
  • Experience conducting applied research with more than one of our sources of information (learning data, content analytics, qualitative research, user research, policy research with partners)

You are:

  • Always making research and evaluation methods more equitable. You understand how inequity and power can manifest themselves through certain research practices or conventions, and you have practical suggestions - whether from formal training, previous projects, personal experience, or trial and error - on how we can start improving our own practices.
  • A persuasive communicator. You believe data can amplify storytelling; you enjoy both evaluating interventions and communicating impact with evidence-based reports, presentations, short briefs, blogs, concept notes, and more.
  • Comfortable with a variety of evidence “languages.” Although you may have a preference for certain analytical methods, reporting formats, or evaluative frameworks, you’re comfortable with receiving and sharing information even if others aren’t able to share their contributions in the format that you prefer. You love making these conventions intelligible to others and enabling them to contribute, including partners or teammates with different experiences.
  • Conversant across tech, education, and sustainable international development. Whatever your own background and training - and though you may not be an expert in each - you’re able to understand the vocabulary of, navigate common evaluation conventions within, and build community with researchers and practitioners from the worlds of software and technology, education, and sustainable international development.
  • A life-long learner. You thrive in a fast-paced, entrepreneurial, collaborative environment with regular opportunities to learn and apply new skill sets. You’re excited about developing your own research and evaluation practices to address the unique challenges of understanding impact in settings without internet access.

Compensation & Benefits

Our core values guide our compensation and benefits package, just like they guide the rest of our work. We provide pay and benefits designed to support all aspects of wellness for you and your family.

  • Salary Range
    • Each team member’s pay is determined based on their job category (e.g., program implementations), the experience they bring to the team, and their location. The estimated salary range for this position is $74,000 - $91,000, depending on your skills, previous experience, and the location you work from.
  • Health
    • We cover 100% of your and your dependents’ health insurance and 99% of vision and dental insurance. We also offer a monthly wellness benefit to support all aspects of your health - you can put it towards purchases like a gym subscription, a mindfulness app, or yoga classes.
  • Finances
    • Learning Equality offers a 401(k) plan with a 3% contribution to help you plan for your future.
  • Scheduling
    • We offer flexible work schedules, 5 weeks paid vacation, 13 paid holidays, and 4 months paid parental leave.
  • Remote Work
    • While most of our team is based in San Diego, California, we are a distributed team and collaborate online through Slack and video meetings. We share a meal “together” in small groups over Zoom once a month, and regularly spend time together with other virtual activities, like video coffee breaks for chit-chat, and game nights.
  • Growth
    • We’re a team of life-long learners and we want you to have the workspace set up that is best for you. We budget $2,400 a year per employee to a Constant Improvement fund. You can decide whether to use this budget to upgrade your physical WFH space, purchase technological tools to support your work, or continue to develop through reading or perhaps attending a webinar to learn alongside peers.

At Learning Equality we work towards a world where everyone can achieve their full potential through access to quality education. To achieve this goal we seek and support a diverse team representative of the cultures and ethnicities, genders and sexual orientations, religious beliefs and abilities that are reflective of our global community of users. We are passionate about diversity because it brings strength, creativity, perspective and joy to our team. 

Apply for this job

Apply for this job

Role

Data Analysis

Experience Level

Senior Level

Learning Equality

Hundreds of millions of children, youth, and adults around the globe lack access to quality education. Learning Equality strives to address this inequity by creating products and tools that can be adapted and contextualized to meet learning needs, with or without Internet access.
Share this job
Get our email newsletterSign me up
Keep up to date with our email newsletterSign me up