Methodology

    How we turn a conversation into evidence a funder can trust

    We collect structured evidence directly from the people your programme reached — built to meet the standards institutional funders and policymakers require. Here is exactly how, from first question to final indicator.

    The starting point

    Most methods reach the reachable. We built ours for everyone else.

    Traditional approaches rely on small samples — and samples are drawn from the people easiest to reach. Fortell enables direct, continuous engagement with entire populations, including the ones a written survey systematically loses.

    Sample-based survey

    What it captures

    • A stratified few hundred, generalised to a whole
    • Only the literate and the connected
    • The answers to questions already written down
    The Fortell conversation

    What we capture

    • Everyone reached — complete enumeration
    • The non-literate, on any phone, in any language
    • What people raise unprompted — coded and counted
    Our framework

    The VoicePrint Framework

    Three layers of evidence, captured in a single engagement — structured around what happened, what changed, and what it meant.

    LAYER 01

    Profile

    Who was reached. Demographic and outreach data establishing who the programme served, and whether it reached its intended population.

    “Who did we reach?”

    LAYER 02

    Outcomes

    What changed. Structured indicator data mapped to whatever framework you already report against — OECD DAC, IRIS+, UNEG, a national logframe, or the European Pillar of Social Rights — collected directly from the people your programme reached, in any language.

    “What changed?”

    LAYER 03

    Voice

    What it meant. Open-ended responses in people's own words — the change that lives beyond the measurable indicators.

    “What did it mean to them?”

    We map to the framework you already report against.

    You don't adopt our indicators. We map to the reporting framework your funders already recognise — so your results read as evidence they trust, not a scorecard they have to take on faith. Wherever you work, and whoever you answer to.

    The most demanding framework we've mapped end-to-end is the European Pillar of Social Rights — 41 indicators across three tiers, in a live evaluation of a Spanish microcredit programme. If we can satisfy Europe's own social-rights audit, we can map to yours.

    OECD DACIRIS+UNEGEuropean Pillar of Social RightsYour own logframe
    Inside the pipeline

    How we process the data.

    Before collection begins, we map the instrument to the framework you report against. From there, every response moves through the same pipeline — so raw voice becomes structured, auditable evidence.

    01

    Transcription

    Speech-to-text tuned for low-resource languages and regional accents. Timestamped, and traceable back to the source audio.

    02

    Translation

    Translated for analysis, with the original-language transcript preserved. Every language is verified by a native speaker.

    03

    Coding

    Responses coded against your framework — OECD DAC, IRIS+, EPSR, or your own logframe. AI first pass, human adjudication, inter-rater agreement reported.

    04

    Analysis

    Closed answers aggregated into indicators. Open answers clustered into themes with verbatim quotes, segmented by the cohorts that matter.

    05

    Reporting

    A live dashboard while it runs, a written report when it's done. Everything exportable — no black box.

    06

    Quality assurance

    Every stage spot-checked against the layer below. Discrepancies logged and resolved before anything reaches the report.

    Independent validation

    Held to an academic standard.

    AI-coded voice data matched human expert analysis at κ = 0.75 — substantial agreement under peer-grade conditions, comfortably above the 0.61 academic threshold.

    Fortell Impact reports contribution, not attribution — the appropriate evidentiary standard for programmes of this type and scale in the European context.

    Ethics & consent

    Built for the people at the other end of the line.

    Informed consent

    Every participant understands who is asking, why, and how their words will be used — before they answer a single question.

    Data protection

    Responses are handled to institutional data-protection standards, with anonymised reporting and secure storage throughout.

    Dignity by design

    Avatars are built to feel culturally close — the right language, the right accent — so people speak freely, without judgement.

    Ready to discuss your evaluation approach?

    Tell us about your programme, and we'll explain how the VoicePrint Framework applies to your context.