On Wednesday, December 8th, the Luminos Fund had the honor of leading a virtual panel discussion at the 2021 WISE Summit titled, “Easy as 1-2-3: Innovative Community-Driven Collaborations for Helping Out-of-School Children Catch Up.” Luminos was honored with a WISE Award in 2017 and remains a proud member of the WISE community.
Moderated by Luminos CEO, Caitlin Baron, the session explored Luminos’ model of deep partnership with community-based organizations and shared lessons for the broader education community to drive greater positive impact for some of the most marginalized children and communities. Panelists included:
Dr. Kwame Akyeampong, Professor of International Education and Development, the Open University | Luminos Advisory Board member
Benjamin M. Freeman Jr., Executive Director, Liberia Institute for the Promotion of Academic Excellence (LIPACE) | Luminos partner
Abba G. Karnga Jr., Liberia Program Manager, Luminos Fund
Nikita Khosla, Senior Director of Programs, Luminos Fund
Why Luminos works with community-based organizations
Luminos works in partnership with community-based organizations (CBOs) and governments through a hub-and-spoke operating model to deliver our catch-up education programs. In each country we work in, a small, expert Luminos team is responsible for curriculum, pedagogy, training, monitoring and evaluation, and government adoption, and Luminos funds local CBOs to implement the program. Second Chance, our catch-up education program, is delivered through these local partners whose capabilities Luminos helps build, support, and oversee throughout the program. Each community Luminos operates in is unique with different traditions, dialects, and needs. As such, it is critical that we contextualize our work to align with these varying circumstances. Who better to know and deeply understand these needs than the people who live and work there? This is why we partner with local organizations like LIPACE in Liberia, led by panelist Benjamin M. Freeman Jr. (Ben).
As Nikita Khosla explained, thanks to CBOs, Luminos is able to rapidly adapt to new geographies and quickly learn how to help meet children where they are. These community partnerships allow Luminos to be highly responsive to local conditions and needs and teach in children’s local language using contextually relevant stories and experiences to enrich learning. In addition, this community-based model helps build local capacity and creates a sustainable model for the future. As Nikita noted, Luminos hopes that our holistic, community-based approach to catch-up education for out-of-school children will grow beyond our organization.
Navigating the power dynamics
There is an inherent dynamic between larger, international NGOs and smaller CBOs. Nikita explained that to navigate this dynamic, Luminos intentionally creates a flat hierarchy from the start. We co-establish a common goal—ensuring all children are learning—and work towards that together. In addition, Luminos conducts quarterly learning sessions with our partners where we ask, “How can we improve the program?”
The first time Ben needed to provide constructive feedback to Luminos, he was hesitant. Ben shared that it was through the quarterly learning sessions that he grew to trust Luminos as an organization that valued the voices and opinions of its partners. Now, providing feedback comes more easily.
Luminos Liberia Program Manager, Abba G. Karnga Jr., noted that this was a crucial part of the puzzle to get right.
“We have to talk about the things that are working, and the things that are not working,” he said.
With that information in hand, Luminos can actively problem-solve. For instance, Nikita shared a recent example from Liberia where Luminos provides midday meals. After receiving feedback from our partners that students did not like the new fortified porridge, we changed the hot meals back to rice and beans.
Working with CBOs during COVID
For Luminos, working with CBOs allowed learning to continue for our students during the pandemic. Because our teachers are local, we were able to hold outdoor micro-classes that parents felt comfortable sending their children to attend. Through our partners, we distributed at-home learning resources and provided emergency food supplies to families in need. On the partner side, Ben noted that the CBO network Luminos created “ensured that we could go beyond the technological gaps that we were experiencing to bring effective COVID awareness and continue to ensure children were learning.”
What can the global community learn?
To wrap up the session, Caitlin posed the question, “What might the Luminos team be getting right, what are the shortcomings, and what might the global community take away more broadly?” to Dr. Kwame Akyeampong, a long-time evaluator of Luminos’ program and member of our Advisory Board.
Kwame reflected that the research shows Luminos’ model can close learning gaps for out-of-school children; it is essential for the global community to look at models like these that can close those learning gaps rapidly. Working with CBOs who have deep knowledge and investments in communities means that Luminos can recruit teachers and make a meaningful difference. “We tend to think about the program much more in terms of the child,” said Kwame, “but it also about the community. It takes a village to educate the child.”
Thank you to WISE and all the participants for such a dynamic and engaging session, and all our community partners. Learn more about WISE and the 2021 WISE Summit here, and read more about Luminos’ community teaching model here.
After a long, dark year, 2021 promises hope, joy, and possibility—the chance to start imagining the world both as what it used to be and what it can become. When the Luminos team gathered virtually for the first time this year, CEO Caitlin Baron asked everyone to share one reflection or insight from 2020 that we wanted to carry forward in 2021. Team members shared diverse reflections, including the joy of reconnecting with old friends and building deeper relationships with our colleagues around the world thanks to video platforms and texting apps.
Nikita Khosla, our Senior Director of Programs, noted that even with all its challenges, 2020 enabled us to support our Luminos students and their families more deeply and holistically. When stay-at-home orders rolled out in the communities we serve, Luminos stayed close every step of the way to understand the impacts of this new reality: lower incomes, less food, and psychological strain in addition to the COVID-19 health crisis. How would our programs in Ethiopia, Lebanon, and Liberia adapt to better serve their needs while remaining true to our mission of unlocking the light of learning in all children? As Liberia Program Manager, Abba Karnga Jr., reflected, this year strengthened Luminos’ ability to adapt rapidly in changing contexts. Thanks to our Liberian team’s innovation and generous, flexible support from our supporters, we were able to assist communities with sanitizing stations and emergency food relief, in addition to providing distance learning.
Yet throughout this period of emergency response, the future of the children we serve loomed heavy in our minds. Education is critical to ensuring today’s children are prepared and empowered for the future. Learning to read unlocks the door to progression through education and on to achieving their full potential. For every extra year of schooling, there is a 9% increase in an individual’s hourly earnings. Yet for every three months out of school, children can lose up to a year of learning. And according to a recent World Bank report, COVID-related school closures risk pushing an additional 72 million primary school children into “learning poverty”—being unable to read and comprehend a simple text by age 10—exacerbating a learning crisis that existed long before COVID-19. At Luminos, our mission to ensure children everywhere get the chance to experience joyful learning is now more urgent than ever before, and we have the tools to help.
As Michelle Kaffenberger of the Research on Improving Systems of Education (RISE) Programme noted to CNN recently, “The crisis doesn’t end when schools reopen. The crisis is going to keep going, if adequate remediation is not taken when children come back.” As schools reopen, it is critical that educators meet children where they are. In our Second Chance classrooms, this means continually assessing students to ensure everyone is progressing and providing extra support to those who are struggling. For example, in Liberia, in addition to twice-weekly hour-long sessions where teachers help students who are struggling, we are also holding short weekend classes to help students keep up with the curriculum in this uniquely shortened 2020-21 school year. Our focus on basic literacy and numeracy skills ensures that students have the foundation to thrive in the future. Critically, our program teaches students how to learn, a skill that can be applied both in their continuing education and throughout their lives.
As we look to the year ahead with a sense of hope and optimism, our students remind us that they are eager to learn. Before our Second Chance classrooms reopened earlier this month, a Liberian student named Charles told us, “School is preparing me for tomorrow. I love this school because they are helping me be good for tomorrow.” Our students have hopes and dreams for incredibly bright tomorrows. In a recent Luminos survey, over 35% of Second Chance students in Liberia dreamed of going into a medical profession to help those around them. Others dreamed of becoming president and holding public office, traveling the world, or becoming business professionals. We can’t wait to see what they do.
As our Communications Director, Maretta Silverman, noted in our team’s round-robin reflection, 2020 reminded us how important it is to show others what they mean to us and how much we care, through new ways and old. So, as we head into 2021, we at Luminos would like to thank you—our supporters, partners, advisors, and friends—for joining us on this journey. When we envision what could be, we see a world where children everywhere experience joyful learning, and no child is ever denied the chance to learn. Let’s get to work.
With over one billion children out of school, education leaders today are experiencing the challenge of a generation. How can historically slow-moving education systems turn on a dime? What can leaders across the public and private sector do to help children recover from COVID-19 learning loss—and lift children out of learning poverty?
The Coronavirus pandemic is not the first calamity to put learning at risk. Powerful lessons can be drawn from recent history—such as in New Orleans after Hurricane Katrina or Liberia after Ebola—to inform today’s pathways to relief, recovery, reform, and resilience in education delivery.
On September 24 at 11 a.m. EDT, please join the Luminos Fund for the launch event of “Education Leadership through Crisis,” a new video series where diverse education leaders share personal lessons learned on navigating crises. In this COVID-19 moment, these dialogues will shed light on the world’s opportunity to get education delivery right. We are honored to launch with this webinar featuring three unique education leaders.
Neerav Kingsland, Managing Partner, The City Fund
George Werner, Former Minister of Education, Liberia
Dr. Rebecca Winthrop, Co-Director of the Center for Universal Education, Brookings Institution
Mubuso Zamchiya, Managing Director, The Luminos Fund
Now in its fourth year, the Luminos Fund’s UN General Assembly (UNGA) week event convenes key funders, thought leaders, implementers, and allies around the subjects of education and international development.
The Luminos Fund is delighted to publish our 2019 Annual Report. To date, we’ve enabled 136,502 vulnerable children to receive a second chance at education – and this year was unlike any other. Our team is more committed than ever to ensuring children everywhere have the opportunity to learn and thrive, and to helping educators and governments in low-income countries develop the resiliency to weather powerful storms like COVID-19.
With over 1 billion youths out of school globally due to the pandemic, the Luminos Fund’s mission to help children get back to school is more important than ever. Our work was made for the task ahead.
Lindsey Wang is Program Analyst at the Luminos Fund where she is instrumental in program monitoring, evaluation, and reporting. She joined Luminos in 2016 as a Mechanical Engineering graduate of MIT and is entering Harvard Kennedy School this autumn.
I would like to tell you a story. In the Dargweh community of Liberia, West Africa, an 11-year-old girl steps into a classroom for the first time in two years. She attended school previously and can name a few letters of the alphabet but is unable to read even two-letter words. Years helping her mother in the market taught her to perform simple sums in her head, but she doesn’t know how to write any numbers. In her new classroom, she chants and claps alongside her peers, repeating the names of letters, their sounds, and words beginning with those letters. A. Ah. Africa. B. Buh. Bird. A letter. A sound. A word. She memorizes the pattern and steps to the front of the class to lead her classmates in song. Outside, she can hear toddlers from her community chanting along, drawn to the boisterous chorus rising from the cinder block building.
Ten months later, imagine returning to this one-room classroom in Dargweh to find that this 11-year-old girl now can not only identify all 26 letters, she can read entire paragraphs about Sammy and his sister Satta. She’s more than happy to tell you that if Yatta has 8 pencils and Abdul has 5 pencils, Yatta has 3 more pencils than Abdul. When she encounters an unfamiliar word, she holds out her left arm and taps it with her right hand, moving from her shoulder to her wrist, one tap for each phonetic sound: shuh, oh, puh. Shop.
In 10 months, thanks to her own tenacity and the Luminos Second Chance program, this girl jumped from near illiteracy to acing a second-grade reading comprehension assessment. Her progress is real, and we have the data to prove it.
As the Luminos Fund’s Program Analyst, I had the great fortune to attend the first week of Luminos Second Chance classes in Liberia in September 2018 and the final week of classes in June 2019. I observed similar advances in dozens of the children I met as I supervised the baseline and endline EGRA and EGMA assessments that measure the learning levels of a sample of students before and after our program. Our Liberian program team—Program Manager Abba Karnga and Program Coordinator Alphanso Menyon—diligently arranged for enumerators (the third-party professionals who conduct evaluations and capture raw data) to randomly sample five students from each of our Second Chance classes during the first week of school. At the end of the 10-month program, those same five students were given the same test by the same enumerator. These kinds of data enable Luminos to identify program strengths and the weaknesses we need to rectify for the next cohort of students. The baseline and endline evaluations are our report card, so to speak.
Everyone in international development knows that external, independent evaluations are essential, but we may underestimate what it takes to get it right. Leading up to my trip and on my flight to Liberia, I buried myself in lecture notes and slide decks from an evaluation management training I had attended until finally, somewhere over the Atlantic Ocean, I realized that no workshop would prepare me completely for the boots-on-the-ground experience of supervising an evaluation.
The lessons that have fundamentally shaped my approach to managing independent evaluations came not from lectures but from visiting classrooms and speaking with enumerators. Now, with the June 2019 endline evaluation completed, I can reflect on the entire process and share a few of those lessons here.
Pilot the survey instrument. Pilots may not always be possible due to time or resource constraints, but the experience of testing a survey with subjects before it launches is invaluable and will strengthen the actual evaluation. We were fortunate to pilot our survey instrument at a Monrovia government school a few days before the baseline evaluation began. Looking over my field notes, I have pages of scribbles even though our pilot took place during just one afternoon. I jotted down every mistake that enumerators came across in the survey and every set of instructions that students did not understand. I noted the names of enumerators I thought were particularly skilled at putting children at ease. Receiving test data collected during the pilot also made it easier for me to prepare an R script to run data checks on the actual evaluation data as they were received from enumerators each evening. This script was a critical time-saver and allowed me to respond swiftly to data discrepancies and issues that arose in the field.
The enumerator training prior to the September 2018 baseline evaluation
Build relationships with your enumerators. While piloting the survey instrument, I received the most insightful feedback from the twelve enumerators preparing to evaluate our students. Rufus noted that students seemed to struggle to read words, not because they didn’t know the words but because the font was too small. Sarah suggested that marking incorrect responses on a paper in front of the child may be discouraging which prompted the other enumerators to change their own processes and mark their papers under the table. During evaluations, enumerators have a front row seat to the students and can share more qualitative insights into students’ knowledge and behavior. At the endline, Margaret shared with me—with a beaming smile—that students seem much more confident in their abilities than they did at the start of the program year, something that wouldn’t have been clear from the data alone. One student, she reported, even corrected her as she tried to demonstrate how to break up a word into its phonetic sounds. Without this direct line of communication to the enumerators, I would have a less nuanced understanding of Luminos results.
Raise concerns early and often. I was nervous going into the baseline evaluation. Was I ready to be an authority on the Luminos program and supervise the enumerator team in the field? I had the Luminos leadership team’s support and they reminded me that, in that room, no one knew more about the program than I did. “Don’t hesitate to raise concerns,” they told me, so I didn’t. I disputed the phrasing of one of the questions. I stressed to enumerators the importance of putting students at ease and reassuring the children that their performance would not impact their enrollment in our program. It surprises me even now how easily the survey team and I fell into a good rhythm. I would observe the enumerators and recommend a change to the survey. The survey firm’s manager would adjust the instrument and the cycle would begin again. This ease is a testament to the survey firm’s professionalism and investment in conducting a rigorous, informative evaluation in service of Luminos’ mission.
Dive in (and be prepared to sweat the details). Did we edit the survey so that both addition and subtraction questions require numeric responses? Does every enumerator know that we will no longer be reading the examples for question 5? The night before the baseline evaluation launched, I caught myself drafting an email to the field coordinators with a few more observations from the pilot only to realize that the enumerators and field coordinators were probably asleep and wouldn’t respond to my emails at 3:00 a.m.! In the end, despite some sleep deprivation, the exhilaration of accompanying the survey into the field kept me motivated. After four hours of driving over pothole-ridden dirt roads – the same pace of work our Liberian colleagues keep every week – I would return to my room to start running data checks, keeping an eye out for enumerator errors and data inconsistencies. In evaluations, as in our Second Chance program as a whole, success lies in the details.
Sleepless nights, constant survey revisions, and many miles logged on bumpy dirt roads. Conducting evaluations can be tedious and time-consuming, expensive and exacting. Why do we do it?
Data drives decision-making and real-time program enhancements. When mid-year internal monitoring reports flagged that our students were struggling with language arts, the Luminos program team in Liberia acted immediately and restructured the curriculum around phonics. A few weeks later, when facilitators met for our semi-annual training, Luminos staff and curriculum consultants delivered a new training module in phonics that led to increased emphasis on literacy in the classroom. Real-time data collection and analysis enables efficient and agile program improvements. This process helps Luminos fulfill our commitment to deliver high-quality education to students in joyful, welcoming, safe, and instructive classrooms.
Lindsey crunching the evaluation data back in Boston
Data is key to achieving impact at scale. At Luminos, I have seen firsthand how a lean NGO-operated education program can evolve into broad, government-funded, and implemented education policies. In Ethiopia, where Luminos also runs classrooms, our academic research partners at the University of Sussex Centre for International Education have rigorously evaluated that program’s pedagogy, implementation, and long-term impact on students’ educational prospects. Excitingly, Ethiopia’s Ministry of Education has now adopted the Second Chance program model as a national strategy to reach out-of-school children, largely due to the rich body of evidence demonstrating our program’s impact. Going into the baseline/endline process in Liberia, I understood that for our Liberia program to follow a similar path to scale, we must produce another compelling body of evidence — beginning with this evaluation.
Not all NGOs are fortunate enough to have strong evaluation partners. Even when they do, evaluations can be expensive, especially for small teams. But, without data, how does an organization self-reflect, implement better strategies, and, frankly, attract more investment? Only through data-driven action, dialogue, and policymaking can the global community address systemic inequalities with sustainable solutions.
When you’re deep in the analysis process—trying to make sense of one thousand data points—it’s easy to lose sight of why data matter. Data is important because our decisions and policies have implications for real people. Data should be the foundation for policymaking, not only to scale effective programs more efficiently but because, in the end, each of those data points represents a person or a community. Remember the young girl who aced the second-grade reading comprehension test? I know her only as Student B014, but she is a reminder that these data we collect are more than a series of numbers. She is a person with dreams and aspirations of her own. She is a daughter. She is a friend.
This autumn, I am taking my experience with data-driven program management to Harvard Kennedy School in pursuit of a Master in Public Policy and will continue working at Luminos on a project basis. In my academic studies and career so far, I have approached international development as an implementor. At HKS, I look forward to bringing my implementer’s lens to the policymaking table. As I transition to this next chapter, I proudly carry with me the humanity and dignity that the Luminos Fund brings to its work, whether around a conference table in Boston or in a one-room classroom in Liberia.