Nigerian Energy Support Programme (NESP) II Businesses and Facilities Import

From OpenStreetMap Wiki
Jump to navigation Jump to search


Brief

The Nigerian Energy Support Programme (NESP) II Businesses and Facilities Import describes a proposal being developed to import the data provided by the NESP II field survey in Nigeria. It is important to note that this import is semi-automated, due to the nature of the available data, that is, it is not possible to import the data all at once. This requires a higher user experience, taking more time to perform the import and the necessary adjustments for OSM upload.

Goals

The Nigerian Energy Support Programme (NESP) co-funded by the European Union and the German Government – BMZ, Ministry for Economic Cooperation and Development – and implemented by Deutsche Gesellschaft für Internationale Zusammenarbeit (GIZ) in collaboration with the Federal Ministry of Power (FMP) supports inter alia electrification planning in Nigeria.  During its first phase (2013-2017), NESP, through its unit on rural electrification, supported the FMP and five partner states (Cross River, Niger, Plateau, Ogun and Sokoto) with electrification planning (incl. geo-data gathering, management and least-cost modelling). This resulted in the creation of an online Central Data Management System (CDMS) hosted by the FMP, a preliminary off-grid solar electrification plan for the whole of Nigeria as well as five more detailed State Rural Electrification Plans.

The focus of this first intervention was rather on modelling than on data gathering. Thus, secondary geo-data sets were used for the modelling. While validating the results of the modelling, the team realized that the geo-data used for the exercise were inaccurate and outdated.

As a result, during its second phase (2018-2020), NESP has established an electrification planning unit that will focus on data gathering and management to provide a stronger basis for electrification modelling. Data gathering will be done, mainly, via field surveys (i.e. power network tracking, settlement survey, etc.), while the CDMS created during the first phase will serve as the data repository.

This intervention is expected to contribute to ease access to data on the status of off grid areas in view to foster electrification. In this line, the goal of this import is to incorporate into OSM,  the data (businesses and facilities) from the NESP II field survey for over 900 settlements in 25 states in Nigeria. These businesses and public facilities data are conducted via field survey with Kobo collect and are of great quality for OSM standards, and bearing in mind that that we have a few of facilities in the OSM database for the settlements and also this survey is focused on remote settlements that are off-grid, merging them will be beneficial to the OSM community and won't be difficult either.

Nationwide Geodata Import Authorization License
Nationwide Geodata Import Authorization License

Schedule

  • May to June 2022: Preparation of the import proposal in the OSM wiki and discussion on Talk-Ng and in the Import list.
  • June 2022: Annotation in the Import Catalog.
  • November 2022: Import completed


Import Progress

Import Progress
State WO Changesets Status
Ogun 1 1, 2, 3, 4, 5, 6, 7, 8, 9 ,10, 11, 12, 13, 14 Completed
Imo 1 1, 2, 3, 4, 5, 6 Completed
Jigawa 1 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12 , 13, 14, 15, 16, 17, 18, 19, 20 Completed
Jigawa 2 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20 Completed
Jigawa 3 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16 Completed
Kano 1 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20 Completed
Kano 2 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14 Completed
Ondo 1 1, 2 , 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18 Completed
Oyo 1 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20 Completed
Oyo 2 1, 2, 3, 4 , 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18 , 19 Completed
Oyo 3 1, 2, 3, 4, 5, 6 Completed
Akwa Ibom 1 1, 2, 3, 4, 5, 6 Completed
Bayelsa 1 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20 Completed
Cross River 1 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15 Completed
Cross River 2 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20 Completed
Delta 1 1, 2, 3, 4, 5, 6 Completed
Edo 1 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 Completed
Rivers 1 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13 Completed
Nasarawa 2 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21 Completed
Nasarawa 1 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19 Completed
FCT 1 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20 Completed
Kogi 1 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20 Completed
Kogi 2 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20 Completed
Kwara 1 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11 Completed
Kwara 2 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19 Completed
Benue 1 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19 Completed
Benue 2 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20 Completed
Benue 3 1, 2, 3, 4, 5, 6 , 7, 8 Completed
Plateau 1 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20 Completed
Plateau 2 1, 2, 3, 4, 5, 6, 7, 8, 9 Completed
Jigawa 4 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17 Completed

Background

License: The approval license is attached here.

ODbL Compliance verified: Yes

Import Type

The import will be divided into settlements, so it will be done in over 900 changesets, one for each settlements. In each changeset, we will assess the data already in the OSM database against the NESP II, and choose the best shape in each case. This decision is made to ensure high accuracy in the data import on OSM.

Data Preparation

Data Reduction & Simplification

The data is originally retrieved in shapefile in only one file for each settlement. The data will be cleaned, and some internal NESP II attributes will be exempted for being not relevant for the import.

Tagging Plans

We have compiled a list of tags to use for the import here: taglist.csv An excerpt is shown in the table below.

Name Key Value Key1 Value1 description
Shoemaker craft shoemaker A place where shoes, boots, sandals… are created, repaired or altered to fit personal needs.
Borehole man_made water_well A water well is a man made excavation in the ground to gain water from an aquifer. With pump
oil mill craft oil_mill A machine which directly produces oil
beauty salon shop hairdresser female yes This includes barbers shops. We can also add "female=yes/no" or "male=yes/no" tags if we want to differentiate.
Hotel tourism hotel Hotel - an establishment that provides paid lodging Edit or translate this description.
Restaurant amenity restaurant Is applied to generally formal eating places with sit-down facilities selling full meals served by waiters and often licensed (where allowed) to sell alcoholic drinks.

Changeset Tags

We will use the following changeset tags:

Where we will substitute STATENAME by the state (example: Ondo) and WO by the work order (1 in the case of Ondo) and CLUSTERID with the unique 6 digits ID assigned to each settlement

Data Transformation

Originally, retrieved data from Kobo will be in CSV. These data will be cleaned in QGIS and all topological, human and spatial errors will be corrected. After that, we will export in Esri Shapefile format for further mapping of attributes column title to OSM acceptable tags with a python script. For each settlement, some manual check will be done for attributes without tags. A sample of the final cleaned version can be found here.

The final cleaned version will be exported in GeoJSON format from the script and opened in JOSM with the OpenData plugin. We will then look carefully for possible errors again (this will at least include the JOSM validator). After that, we download the data from OSM, and we carefully compare them against the NESP II data, deleting which we consider of less quality using Maxar imagery. Once this is finished, we merge both layers (NESP II and OSM) and we upload.

Data Merge Workflow

Team Approach

Import will be undertaken by experienced INTEGRATION Consultants with the import specific NESP_II_businesses_and_facilities_Import OSM user account, following the workflow described above

References

The import was discussed in the talk-ng and in the Import list.

Workflow

Already explained.

Reverse Plan

In case of any trouble, JOSM reverter will be used.

Conflation

Already explained

See also

The email to the Imports mailing list was sent on 2022-05-25 and can be found in the archives of the mailing list here.