Lindsey Wang is a Program Analyst at the Luminos Fund where she is instrumental in program monitoring, evaluation, and reporting. She joined Luminos in 2016 as a Mechanical Engineering graduate of MITand is currently pursuing a Master in Public Policy at Harvard Kennedy School.
Why build a data dashboard?
COVID-19 has interrupted students’ learning all around the world. Now, more than ever, the international education community needs effective tools to analyze data in real time and spur equitable solutions to close learning gaps. As Luminos’ Program Analyst, I ensure that rigorous data collection and analysis are at the foundation of program management and support efficient service delivery because, in the end, each data point represents an individual or a community. With over 1 billion students slowly returning to school due to COVID-19 (UNESCO), we need faster feedback loops to identify and address learning gaps and better meet the needs of every student and family.
One year ago, I set out to develop a tool for program managers to leverage the wealth of data collected from the field to drive program delivery. I sought to capture a real-time snapshot of the state of our Second Chance program by integrating both quantitative and qualitative data into our model, thus ensuring that vital institutional knowledge and first-hand observations could be shared across far-reaching geographies. Our solution: a data dashboard for program management with three simple objectives to help us monitor program results in real-time and deploy program resources more efficiently:
Monitor Key Performance Indicators (KPIs)
Capture a holistic view of the program and drill down to granular insights
Identify struggling students and facilitators
A dashboard for program management
Given my past experience as an engineer applying user-centered design principles to develop products to support low-resource communities, I believed it critical that we prioritize our intended users (program staff) throughout the dashboard development process to ensure we built a tool that met their needs. To do so, I built iteration and feedback into the design process: at each stage of development, I solicited feedback and co-created elements alongside program staff.
My constant engagement with program staff in Liberia and within the Luminos HQ informed the creation of four distinct dashboard reports:
The Program Overview captures an up-to-date snapshot of the program by pairing student enrollment information with internal field reports and spot checks. Program staff can drill down and filter data by program year, region, and implementing partner.
The Student Assessments dashboard captures the distribution of scores for literacy, numeracy, and words per minute (WPM) in each phase and allows users to disaggregate data by region, implementing partner, student demographics, or classroom rating.
The Classroom Observations dashboard enables users to review a log of classroom observations from field visits conducted by program coordinators. KPIs include facilitator performance and internal measurements of attendance and words read per minute.
The Baseline and Endline dashboard compares the results from our external baseline and endline EGRA/EGMA surveys from the program level down to the individual student level.
Dashboards in practice
The potential applications of the dashboard are vast. Here is a taste of what I hope to achieve once this new tool is implemented:
Diagnose barriers: Imagine we notice a classroom in which most students scored below the program average. The dashboard allows us to examine this datapoint in context. Has there been an economic shock in the community that caused parents to withdraw their students to work? We can compare the performance of the classroom in question against other classrooms in the same or neighboring communities to determine if this is a shared phenomenon. Perhaps the issue lies with the facilitator. We can review the classroom observations logged by program coordinators over the prior weeks to determine if the facilitator is struggling to grasp the principles of Second Chance’s activity-based pedagogy.
Map trends: With data stored in a centralized database, we can combine external baseline and endline data with internal midline and phase-level assessments to create a picture of students’ learning trajectories.
Promote equity: Luminos disaggregates data by region, implementing partner, and student demographic information — such as gender — to promote equity in program delivery. The success of our Second Chance program has always depended on strong partnerships with leaders and advocates in the community who help us localize the program to meet students and families where they are. With this dashboard, we can easily assess how different sub-populations are performing and address their specific barriers to learning.
As Second Chance classes gradually reopen from months of school closures and interim distance learning efforts, our team is committed to supporting our students, classroom facilitators, and communities. I am currently training our program coordinators to use the dashboard to inform their management practices in anticipation of classes resume. We have already begun the orientation process and will dive deeper into each of the dashboard visualizations in the coming months. My hope is that eventually our program staff will bring their own creativity and curiosity to the dashboard and derive unique insights from the data.
So, you want to build a data dashboard….
Design is fundamentally an iterative process. Here are some of the lessons we have learned through many rounds of feedback:
Build for your end users: Who will use the dashboard, and how will they engage with the tool? User interviews and feedback testing are great ways to make sure you build something your users need rather than what you think they need.
Identify KPIs early: It is easy to try and incorporate too much into one dashboard. Enumerating your KPIs early will help avoid scope creep.
Address varying levels of data literacy: Make sure to assess the data literacy of your end users and tailor your dashboard to their comfort level with data visualizations.
Track your data sources: Especially as you begin to combine datasets, it is critical to track where your data come from, how and by whom they were collected and cleaned, and how often the data are updated.
If you’re interested in learning more about the development of the Luminos dashboard, please contact email@example.com.
On September 24, the Luminos Fund hosted our fourth annual U.N. General Assembly (UNGA) week event. Given the ongoing coronavirus pandemic, this year we went virtual. View the full webinar online here.
Hosted by the Luminos Fund’s Managing Director Mubuso Zamchiya, the webinar featured a diverse panel of education experts including:
Neerav Kingsland, Managing Partner of The City Fund and former CEO of New Schools for New Orleans
George Werner, Former Minister of Education in Liberia
Dr. Rebecca Winthrop, Co-Director of the Center for Universal Education at Brookings Institution
Luminos CEO Caitlin Barron kicked off the event by welcoming everyone into the space and acknowledging that we find ourselves in an unprecedented moment. At the height of the COVID-19 crisis, nine out of ten children around the world were out of school. As she noted, “Our world, and everyone else’s, had been turned upside down.” And yet, education leaders around the world have experienced crises before, from the Ebola epidemic to Hurricane Katrina.
Mubuso led several rounds of questions for the panelists, framing the discussion around three themes from President Nelson Mandela’s 2005 speech at the 46664 Arctic concert in Tromsø, Norway: leadership, vision, and political courage. Below are a few highlights from each speaker.
As the CEO of New Schools for New Orleans after Hurricane Katrina, Neerav has witnessed crises first hand. In his experience, the two most important factors that allowed New Orleans schools to become so successful after the hurricane were having adequate political cover and the public will to not go back to the way things were. Hurricane Katrina demonstrated the unique ability of the nonprofit world to work together as a team. When asked whether crises of leadership follow other crises, Neerav noted, “It does create a window when you’re in a moment of crisis—for people to question who and how people should lead. A crisis creates the space for unbelievable leaders to create a new vision, and I think that’s what happened in New Orleans.” His advice to the education world:
“Create systems that allow for innovation, that allow for some failure, and when you see things that start to work, grow them as thoughtfully as you can.”
Dr. Rebecca Winthrop
Painting the larger picture, Rebecca noted that although most children are out of school right now, there is a great deal of remote learning. The big divide lies between which children are able to do remote learning and which are not. As Rebecca said, “When school buildings…shut their doors…it lays bare the inequalities in society.” On a positive note, Rebecca also believes that the COVID-19 pandemic has exposed the “dormant, latent capacity of education innovation,” and posited that perhaps this can provide us with a recipe of how to act moving forward. She hopes that some changes, such as the emergence of new allies to support education and the recognition of schools as important institutions, will continue beyond the crisis. Moving forward, Rebecca sees society entering an age were, “values are going to be the name of the game.” Her advice:
“We need to get people to think about, ‘Where do we want to head?’ Keep that north star, that vision in your mind, because that will influence how you reopen and what you will allow, what partnerships you will allow.”
Dr. Rebecca Winthrop
George is no stranger to school closures either. When Ebola hit Liberia, schools across the country closed for nearly six months, forcing him to think outside of the box for solutions. “Like Ebola,” George noted, “I believe COVID-19 has given us another opportunity to think outside the boxes we have been given.” The event left us feeling inspired for the road ahead: to help children and education systems recover stronger than ever. As George Werner said,
“In every crisis, you find a silver lining or two. It’s up to leadership to see it and have the courage to bring others along.”
The webinar also marked the launch of Education Leadership through Crisis, a new video series where diverse education leaders share personal lessons learned on navigating crises. In this COVID-19 moment, these dialogues will shed light on the world’s opportunity to get education delivery right.
Below is a peek into a few of the interviews we will feature in the weeks ahead:
We look forward to continuing the discussion and invite you to contact us by email or on social media. For more information on this series, visit our series landing page and be sure to follow us on social media for the latest interviews. Stay tuned for new interviews every Monday and Wednesday, and check out the interview with Arne Duncan, former U.S. Secretary of Education!
With over one billion children out of school, education leaders today are experiencing the challenge of a generation. How can historically slow-moving education systems turn on a dime? What can leaders across the public and private sector do to help children recover from COVID-19 learning loss—and lift children out of learning poverty?
The Coronavirus pandemic is not the first calamity to put learning at risk. Powerful lessons can be drawn from recent history—such as in New Orleans after Hurricane Katrina or Liberia after Ebola—to inform today’s pathways to relief, recovery, reform, and resilience in education delivery.
On September 24 at 11 a.m. EDT, please join the Luminos Fund for the launch event of “Education Leadership through Crisis,” a new video series where diverse education leaders share personal lessons learned on navigating crises. In this COVID-19 moment, these dialogues will shed light on the world’s opportunity to get education delivery right. We are honored to launch with this webinar featuring three unique education leaders.
Neerav Kingsland, Managing Partner, The City Fund
George Werner, Former Minister of Education, Liberia
Dr. Rebecca Winthrop, Co-Director of the Center for Universal Education, Brookings Institution
Mubuso Zamchiya, Managing Director, The Luminos Fund
Now in its fourth year, the Luminos Fund’s UN General Assembly (UNGA) week event convenes key funders, thought leaders, implementers, and allies around the subjects of education and international development.
In August, the Luminos Fund was featured in a new report published by Education Above All in partnership with HundrED, highlighting innovations from a select group of education organizations that are effectively supporting marginalized learners during the COVID-19 pandemic. Based in Doha, Qatar, Education Above All (EAA) is a foundation launched in 2012 whose mission is to ensure inclusive and equitable quality education for vulnerable and marginalized people especially in the developing world, as an enabler of human development.
The report, “Beyond School Walls: Inspiration from Disruption,” recognizes that we must ensure learning continuity for all children during a crisis, especially those in underserved and marginalized communities. For many of these children, COVID-19 is just one incident in a series of events disrupting their education. At Luminos, as an organization that exists to support children affected by poverty, crisis, and discrimination, including the most marginalized learners, we could not agree more. The vast majority of marginalized learners we serve are in remote rural communities without access to online learning and were consequently left behind as the world pivoted to distance-learning solutions during COVID-19.
In response to the urgency for learning continuity, “Beyond School Walls” prioritizes the need for a variety of alternative learning systems using a range of infrastructures (from no tech to high tech) designed for unique and challenging contexts. The eleven case studies featured in the report, including Luminos’s Second Chance program, aim to support organizations and implementers globally in ensuring learning continuity for marginalized learners in places where schools remain closed for an extended period. The case studies are organized by several criteria (technological readiness, content availability, personalization, interactivity, cost, preparedness of teachers and parents, effort to replicate, etc.), with the hope of supporting others to adapt the ideas and practices featured to their own unique context.
“To support Luminos children and families during COVID-19 school closures, Luminos provided its communities with handwashing stations and supplies, food relief, and vital health information and guidance regarding COVID-19. Given that only 12% of the population in Liberia has access to electricity, Luminos employed a low-tech approach to ensure that all students/families would be reached. Luminos leveraged its network of facilitators, who live within the same communities as Luminos students, to conduct socially-distanced home visits to check in on student health, nutrition, wellbeing, and learning. Paper-based worksheets, aligned to the program curriculum, were created and distributed to students. Facilitators also held micro-classes with 4-5 children/batch to ensure that students remained engaged in learning through the school closures. Given that 1 in 4 children did not return to school following the Ebola outbreak in Liberia, Luminos’ primary aim through the school closures has been to ensure that children remain safe and connected to learning so that every child returns to school once schools reopen.”
“Beyond School Walls” by Education Above All
Alongside EAA, Luminos looks forward to continuing to ensure that all learners, especially those in underserved and marginalized communities, continue learning despite school closures. We are honored to be featured alongside Amala Education, Dost Education, Ek Tara, iACT, M-Shule, Power99 Foundation, Pratham Education Foundation, Rising Academy Network, The First Assalam School, and the Zakoura Foundation. “Beyond School Walls: Inspiration from Disruption” is available online here.
The Luminos Fund is delighted to publish our 2019 Annual Report. To date, we’ve enabled 136,502 vulnerable children to receive a second chance at education – and this year was unlike any other. Our team is more committed than ever to ensuring children everywhere have the opportunity to learn and thrive, and to helping educators and governments in low-income countries develop the resiliency to weather powerful storms like COVID-19.
With over 1 billion youths out of school globally due to the pandemic, the Luminos Fund’s mission to help children get back to school is more important than ever. Our work was made for the task ahead.