5 The steps in MAPS cost, effectiveness and cost-effectiveness modelling
5.1 The steps in estimating baseline prevalence of micronutrient deficiency
5.1.1 Apparent intake per AFE approach
1. For each food in the food list, we convert the reported quantity of food consumed by the household during the recall period (typically the past seven days) to grams and, where relevant, adjusted for the edible portion. Estimates of the edible portion of foods are taken from a locally-relevant food composition table (FCT), where possible, and otherwise based on input from local experts.
2. We match each food in the food list with a locally-relevant FCT entry to estimate nutrient composition of each food (link to description of matching process). Note that, unless the food in the HCES food list specifies a cooking method (e.g., sweet potato, boiled), foods are matched with the raw version of the food in the FCT, meaning that potential micronutrient losses during cooking are not accounted for.
3. We sum the apparent intake of the focus micronutrient from each food to calculate total daily average apparent micronutrient intake (total household intake divided by the number of days of recall).
4. Using information from the household roster, we calculate the number of AFEs in each household. Note that the number of AFEs in the household is calculated based on the sum of each household member’s age- and sex-specific energy requirements relative to the energy requirements of the reference household member, a non-pregnant, non-lactating adult female 18–30 years of age. Energy requirement estimates are based on the FAO/WHO Human Energy Requirements report (Food and Agricultural Organization of the United Nations & World Health Organization, 2001), assuming a physical activity level of 1.6 for adults and average bodyweight based on country-specific estimates where available (e.g., Demographic and Health Survey).
Table 4 summarizes the adjustment factors incorporated to account for energy requirements during lactation and the energy provided via breastmilk when infants are breastfeeding. Specifically, to account for additional energy requirements during lactation, we assume that all households with a child under 2 years of age also have a lactating mother (note that this is expected to be an overestimation of the total number of lactating women since there is likely to be variation in the degree of adherence to international breastfeeding guidelines). We add an additional 500 kcal per day to the base energy requirements of women assumed to be breastfeeding a child (Centers for Disease Control and Prevention, 2024). For infants under 2 years of age, we estimate total energy requirements from complementary foods (i.e., energy provided from the household diet) by subtracting the energy contributions from breastmilk from their daily energy requirements. The assumed contribution of breastmilk is age-specific (WHO Programme of Nutrition, 1998). We assume that children 0-2 months are exclusively breastfed and hence do not consume any portion of the household diet. For documentation on how these requirements are coded, see (link to GitHub). Because pregnancy status is not adequately collected (or not collected at all) in HCESs, we do not account for additional energy requirements during pregnancy.
Note that adult female serves as the reference household member because her food consumption is expected to be approximately the average in the household. Moreover, her micronutrient requirements are generally high relative to other household members, so if the household’s micronutrient intake is adequate to meet her requirements (assuming that food is distributed within the household in proportion to age- and sex-specific energy requirements), it is likely adequate to meet the needs of other household members
Parameter | Energy (kcal) |
---|---|
Additional energy requirement for lactation | 500 |
Energy intake from breastmilk, age 3-5 months | 434 |
Energy intake from breastmilk, age 6-8 months | 413 |
Energy intake from breastmilk, age 9-11 months | 379 |
Energy intake from breastmilk, age 12-23 months | 346 |
5. We divide average daily total apparent micronutrient intake by the number of AFEs in the household to calculate baseline daily apparent micronutrient intake per AFE.
We compare daily apparent micronutrient intake per AFE to the estimated average requirement (EAR) of an adult female to classify the household diet as adequate or inadequate to meeting the focus micronutrient requirements of an adult female. These estimates are then summarized, accounting for survey weights, at national and subnational levels to generate estimates of the baseline prevalence of inadequacy of the focus micronutrient. Note that the default EARs in the tool are based the harmonized average requirements presented in Allen, Carriquiry & Murphy (2019), but these values can be modified by the user within the cost and effectiveness module framework of the tool.
5.1.2 Nutrient density of the household diet approach
1. For each food in the food list, we convert the reported quantity of food consumed by the household during the recall period (typically the past seven days) to grams and, where relevant, adjusted for the edible portion. Estimates of the edible portion of foods taken from a locally-relevant food composition table (FCT), where possible, and otherwise based on input from local experts.
2. We match each food in the food list with a locally-relevant FCT entry to estimate energy and nutrient composition of each food (link to description of matching process). Note that, unless the food in the HCES food list specifies a cooking method (e.g., sweet potato, boiled), foods are matched with the raw version of the food in the FCT, meaning that potential micronutrient losses during cooking are not accounted for.
3. We sum the apparent intake of the focus micronutrient from each food to calculate total daily average apparent micronutrient intake (total household intake divided by the number of days of recall).
4. We sum the apparent intake of energy from each food to calculate total daily average apparent energy intake (total household energy intake divided by the number of days of recall).
5. For the focus micronutrient, we calculate the baseline nutrient density of the household diet by dividing total daily average apparent micronutrient intake by total daily average apparent energy intake, multiplied by 1000 to express the nutrient density per 1,000 kcal.
6. We compare the household nutrient density to the critical nutrient density of an adult female to classify the household diet as adequate or inadequate to meeting micronutrient requirements of an adult female, assuming energy requirements are met. These estimates are then summarized, accounting for survey weights, at national and subnational levels to generate estimates of the baseline prevalence of inadequacy of the focus micronutrient.
a. Note that the critical nutrient density is calculated as the EAR of a non-pregnant, non-lactating adult female 18-30 year of age divided by the energy requirements of a non-pregnant, non-lactating adult female 18-30 years of age, multiplied by 1,000.
5.2 Steps in modeling the impact of micronutrient interventions and risk of high intakes
5.2.1 Apparent intake per AFE approach
1. We calculate total average daily apparent household consumption of the relevant food vehicle (for modeling LSFF) or crop (for modeling biofortification). This includes fortifiable/biofortifiable food equivalents from processed foods containing the food vehicle or crop (e.g., wheat flour in bread). Fortifiable/biofortifiable food equivalents are drawn from a MAPS database of country-specific equivalents populated based on local recipes and input from in-country experts.
2. We divide total average daily apparent household consumption of the food vehicle or crop by the number of AFEs in the household to generate estimate of daily average apparent consumption per AFE.
3. For modeling LSFF, for each year of the 10-year modeling time horizon we calculate the additional daily apparent micronutrient intake per AFE provided by LSFF by multiplying daily average apparent consumption of the food vehicle per AFE (assumed constant over the 10-year horizon) by the year-specific average fortification level. Note that the average fortification level in each year is calculated as the target fortification level multiplied by the percent of the food vehicle that is fortifiable, the proportion of the food vehicle that is fortified to any extent, the average fortification level among the fortified food vehicle as a percent of the standard (at point of fortification), and the expected micronutrient retention from point of fortification to households. Each of these parameters is modifiable by the user in the tool.
a. Note that to account for higher bioavailability of folic acid compared to dietary folate, we convert average folic acid fortification levels to dietary folate equivalents (DFEs) by multiplying the average fortification level by 1.7 (Bailey, 2000).
4. For modeling biofortification (via crop breeding or agronomic biofortification), for each year of the 10-year modeling time horizon we calculate the additional daily apparent micronutrient intake per AFE provided by biofortification by multiplying daily average apparent consumption of the crop per AFE (assumed constant over the 10-year horizon) by the year-specific average additional micronutrient content in the biofortified crop. Note that the average additional micronutrient content in the biofortified crop (via crop breeding) in each year is calculated as the difference in the micronutrient concentration in the non-biofortified variety and the biofortified variety, where the micronutrient concentration is calculated as the average of country-specific released varieties according to the HarvestPlus database of biofortified crops released (https://bcr.harvestplus.org/)) multiplied by the modeled annual farmer adoption rate. See Table 5 for biofortification effectiveness parameters for Malawi and Ethiopia. Each of these parameters is modifiable by the user in the tool.
Note that we convert vitamin A in the form of pro-vitamin A (PVA) to retinol activity equivalents (RAE) assuming a 12:1 conversion factor of PVA to RAE (Institute of Medicine, 2001).
For agronomic biofortification, the average additional micronutrient content is based on published studies (either based on the absolute increase in the micronutrient contents if reported int the study or calculated based on the percent increase reported in the study. See Tables 6 and 7 for agronomic biofortification effectiveness parameters for granular and foliar applications, respectively. Each of these parameters is modifiable by the user in the tool.
5. We add additional daily apparent micronutrient intake per AFE provided by LSFF or biofortification to baseline daily apparent micronutrient intake per AFE to generate an estimate of total daily apparent micronutrient intake per AFE with LSFF or biofortification.
6. We compare daily apparent micronutrient intake per AFE with LSFF or biofortification to the EAR of an adult female to classify the household diet as adequate or inadequate to meeting the focus micronutrient requirements of an adult female with the micronutrient intervention. These estimates are then summarized, accounting for survey weights, at national and subnational levels to generate estimates of the prevalence of inadequacy of the focus micronutrient with LSFF or biofortification.
7. For each year of the 10-year modeling time horizon, we subtract the prevalence of inadequacy with LSFF or biofortification from the baseline prevalence of inadequacy to estimate effective coverage of the micronutrient intervention.
8. For micronutrients with a tolerable upper intake level (UL), we compare daily apparent micronutrient intake per AFE with LSFF or biofortification to UL of an adult female to classify the household diet as providing less than or above the UL threshold for and adult female. These estimates are then summarized, accounting for survey weights, at national and subnational levels to generate estimates of the prevalence of high intakes per AFE with LSFF or biofortification.
a. Note that the UL for vitamin A applies only to preformed retinol, and the UL for folate applies only to synthetic folic acid.
5.2.2 Nutrient density of the household diet approach
1. We calculate total average daily apparent household consumption of the relevant food vehicle (for modeling LSFF) or crop (for modeling biofortification). This includes fortifiable/biofortifiable food equivalents from processed foods containing the food vehicle or crop (e.g., wheat flour in bread). Fortifiable/biofortifiable food equivalents are drawn from a MAPS database of country-specific equivalents populated based on local recipes and input from in-country experts.
2. For modeling LSFF, for each year of the 10-year modeling time horizon we calculate the additional daily apparent micronutrient intake provided by LSFF by multiplying daily average apparent consumption of the food vehicle (assumed constant over the 10-year horizon) by the year-specific average fortification level. Note that the average fortification level in each year is calculated as the target fortification level multiplied by the percent of the food vehicle that is fortifiable, the proportion of the food vehicle that is fortified to any extent, the average fortification level among the fortified food vehicle as a percent of the standard (at point of fortification), and the expected micronutrient retention from point of fortification to households. Each of these parameters is modifiable by the user in the tool.
a. Note that to account for higher bioavailability of folic acid compared to dietary folate, we convert average folic acid fortification levels to dietary folate equivalents (DFEs) by multiplying the average fortification level by 1.7 (Bailey, 2000).
3. For modeling biofortification (via crop breeding or agronomic biofortification), for each year of the 10-year modeling time horizon we calculate the additional daily apparent micronutrient intake provided by biofortification by multiplying daily average apparent consumption of the crop (assumed constant over the 10-year horizon) by the year-specific average additional micronutrient content in the biofortified crop. Note that the average additional micronutrient content in the biofortified crop in each year is calculated as the difference in the micronutrient concentration in the non-biofortified variety and the biofortified variety, where the micronutrient concentration is calculated as the average of country-specific released varieties according to the HarvestPlus database of biofortified crops released (https://bcr.harvestplus.org/)) multiplied by the modeled annual farmer adoption rate. See Table 5 for biofortification effectiveness parameters for Malawi and Ethiopia. Each of these parameters is modifiable by the user in the tool.
Note that we convert vitamin A in the form of pro-vitamin A (PVA) to retinol activity equivalents (RAE) assuming a 12:1 conversion factor of PVA to RAE (Institute of Medicine, 2001).
For agronomic biofortification, the average additional micronutrient content is based on published studies (either based on the absolute increase in the micronutrient contents if reported int the study or calculated based on the percent increase reported in the study. See Tables 6 and for agronomic biofortification effectiveness parameters for granular and foliar applications, respectively. Each of these parameters is modifiable by the user in the tool.
4. We add additional daily apparent micronutrient intake provided by LSFF or biofortification to baseline daily apparent micronutrient intake and recalculated the nutrient density of the household diet with LSFF or biofortification (that is, we divide total daily average apparent micronutrient intake with LSFF or biofortification by total daily average apparent energy intake, multiplied by 1000 to express the nutrient density per 1,000 kcal).
5. We compare the household nutrient density with LSFF or biofortification to the critical nutrient density of an adult female to classify the household diet as adequate or inadequate to meeting micronutrient requirements of an adult female with the micronutrient intervention, assuming energy requirements are met. These estimates are then summarized, accounting for survey weights, at national and subnational levels to generate estimates of the prevalence of inadequacy of the focus micronutrient with LSFF or biofortification.
6. For each year of the 10-year modeling time horizon, we subtract the prevalence of inadequacy with LSFF or biofortification from the baseline prevalence of inadequacy to estimate effective coverage of the micronutrient intervention.
7. For micronutrients with a tolerable upper intake level (UL), we compare household nutrient density with LSFF or biofortification to the critical upper density of an adult female to classify the household diet as providing less than or above the UL threshold for an adult female. These estimates are then summarized, accounting for survey weights, at national and subnational levels to generate estimates of the prevalence of high intakes with LSFF or biofortification.
a. Note that the UL for vitamin A applies only to preformed retinol, and the UL for folate applies only to synthetic folic acid.
b. Also note that the critical upper density is calculated as the UL of a non-pregnant, non-lactating adult female 18-30 year of age divided by the energy requirements of a non-pregnant, non-lactating adult female 18-30 years of age, multiplied by 1,000.
Country |
Crop |
Micronutrient content in non-biofortified variety |
Average micronutrient content in biofortified variety |
Additional micronutrient content in biofortified variety |
||
Value |
Source |
Value |
Source |
(calculated) |
||
Vitamin A (mcg RAE per g) |
||||||
Ethiopia |
Maize |
0 |
West African FCT, item 01_004 |
3.1 |
(1) |
3.1 |
Ethiopia |
Sweet potato |
0.05 |
West African FCT, item 02_022 |
12.0 |
(2) |
11.9 |
Malawi |
Maize |
0 |
Malawi FCT, item MW01_0038 |
0.55 |
(3) |
0.6 |
Malawi |
Sweet potato |
0.02 |
Malawi FCT, item MW01_0065 |
5.83 |
(4) |
5.8 |
Iron (mg per g) |
||||||
Malawi |
Beans |
0.07 |
Malawi FCT, average of items MW02_0004, MW02_0007, and MW02_0017 |
0.09 |
(5) |
0.02 |
Sources:
(1) Average content of released varieties according to HarvestPlus https://bcr.harvestplus.org/varieties_released/country?id_country=71&country_name=Ethiopia and assuming 12:1 conversion ratio of pro-vitamin A (PVA) to retinol activity equivalents (RAE).
(2) Average content of released varieties according to HarvestPlus https://bcr.harvestplus.org/varieties_released/country?id_country=71&country_name=Ethiopia and assuming 12:1 conversion ratio of pro-vitamin A (PVA) to retinol activity equivalents (RAE).
(3) Average content of released varieties according to HarvestPlus https://bcr.harvestplus.org/varieties_released/country?id_country=134&country_name=Malawi and assuming 12:1 conversion ratio of pro-vitamin A (PVA) to retinol activity equivalents (RAE).
(4) Average content of released varieties according to HarvestPlus https://bcr.harvestplus.org/varieties_released/country?id_country=134&country_name=Malawi and assuming 12:1 conversion ratio of pro-vitamin A (PVA) to retinol activity equivalents (RAE).
(5) Average content of released varieties in Rwanda according to HarvestPlus https://bcr.harvestplus.org/varieties_released/country?id_country=184&country_name=Rwanda.
Micronutrient | Crop | Additional concentration from agronomic biofortification | Units | Source |
---|---|---|---|---|
zinc | millet | 0.004 | mg/g | Calculation based on Teklu, Gashu, Joy et al. (2023) |
zinc | groundnut | (no data) | ||
zinc | maize | 0.002 | mg/g | Calculation based on Botoman, Chimungu, Bailey et al. (2022) |
zinc | pigeon pea | (no data) | ||
zinc | rice | 0.002 | mg/g | Calculation based on Joy, Stein, Young et al. (2015) |
zinc | teff | 0.007 | mg/g | Calculation based on Joy et al. (2015) |
zinc | wheat | 0.004 | mg/g | Calculation based on Joy et al. (2015) |
selenium | cowpea | 0.296 | mcg/g | Ligowe, Young, Ander et al. (2020) (average of 4C and T7) |
selenium | groundnut | 0.711 | mcg/g | Ligowe et al. (2020) |
selenium | maize | 0.209 | mcg/g | Ligowe et al. (2020) |
selenium | pigeon pea | 0.017 | mcg/g | Ligowe et al. (2020) |
iron | millet | 0.027 | mg/g | Calculation based on Teklu et al. (2023) |
Micronutrient | Crop | Additional concentration from agronomic biofortification | Units | Source |
---|---|---|---|---|
zinc | maize | 0.004 | mg/g | Calculation based on Joy et al. (2015) |
zinc | rice | 0.004 | mg/g | Calculation based on Joy et al. (2015) |
zinc | wheat | 0.012 | mg/g | Zia, Ahmed,Bailey et al. (2020) |
selenium | groundnut | 0.371 | mcg/g | Chilimba, Young. & Joy (2014) |
selenium | maize | 0.100 | mcg/g | Chilimba et al. (2014) |
selenium | soyabean | 0.768 | mcg/g | Chilimba et al. (2014) |
5.3 Modeling cost-effectiveness in the MAPS tool
When the user has estimated both the cost and effectiveness of a micronutrient intervention, they also able to generate estimates of the cost-effectiveness of the micronutrient intervention program over the 10-year time horizon. To estimate cost-effectiveness, the year-specific percent of households effectively covered (that is, the percent of households with inadequate intake of the focus micronutrient in the baseline (i.e., without intervention) scenario that achieve dietary micronutrient adequacy with the intervention) are converted to estimates of the annual number of households effectively covered. This requires introducing estimates of the projected number of households for each year of the 10-year time horizon.
We estimate the projected number of households by combining UN World Population Prospects population projections (United Nations, 2019) over the 10-year time horizon with estimates of average household size to project the number of households for each year of the 10-year time horizon. Specifically, we weight the national population projection in each year by the admin level 1 share of the national population (according to the most recent census data) to disaggregate the population projections to the sub-national level. Then, we estimate the number of households each year by dividing the sub-national projections by estimates of the average household size at each admin level 1 (typically according to the most recent Demographic and Health Survey or the most recent Household Consumption and Expenditure Survey). We then multiply the percent of households effectively covered in each year to the projected number of households in that year to estimate the number of households effectively covered in a specific year.
The cost-effectiveness of the intervention is then calculated as the 10-year sum of total annual costs divided by the 10-year total annual sum of households effectively covered, or: