Lynchburg VA Area Import

From OpenStreetMap Wiki
Jump to navigation Jump to search




Lynchburg VA Area Address Import is a proposed one-time import of Virginia Address Points, covering the Lynchburg Metropolitan Statistical Area, excluding Lynchburg City as address data is mostly complete, and excluding Appomattox County for purposes of scale.

Goals

To improve the area around Lynchburg and surrounding counties by filling missing address data for the purpose of navigation. Previous imports of this dataset have been carried out in neighboring counties such as the Rockbridge County, Virginia Address Import and this import will follow similar standards for data processing for cohesion in the geographical area.

Schedule

Background

Proposal started: 2024-09-12

Data formatting complete: 2024-09-20

Import began: 2024-09-25

Import completion goal: 2024-12-01

Import Data

Virginia Address Points: https://hub.arcgis.com/datasets/VGIN::virginia-address-points/about
Type of license: Public Domain

The quality of this dataset in the counties of interest is high, and no significant modifications to the data will be necessary aside from field conversion to OSM standards. This includes converting road names out of uppercase, and expanding abbreviations.

Import Type

One Time Import for the first three counties, with possible second round for Appomattox County and other adjacent counties.

Status

The data is split in 400 batches of approximately 2-5 square mile clusters, generated with QGIS k-means clustering. The batches have a mean size of 217 addresses and a median size of 115 addresses, although the maximum batch size is 1,783 address points due to the density near Lynchburg city.

Batch Changeset ID Batch Changeset ID Batch Changeset ID Batch Changeset ID Batch Changeset ID Batch Changeset ID Batch Changeset ID Batch Changeset ID
0 157098081 50 157218267 100 157190513 150 157471992 200 157694978 250 300 350
1 157098399 51 157218345 101 157318643 151 157472096 201 157695022 251 301 351
2 157100409 52 157218492 102 157318680 152 157472158 202 157695050 252 302 352
3 157100506 53 157226852 103 157318723 153 157472540 203 157695090 253 303 353
4 157101551 54 157145692 104 157318806 154 157472685 204 157695108 254 304 354
5 157101625 55 157227059 105 157318857 155 157472807 205 157695175 255 305 157395616 355
6 157102391 56 157232609 106 157318965 156 157472933 206 157695221 256 306 356
7 157141044 57 157232700 107 157319027 157 157473965 207 157695257 257 307 357
8 157141167 58 157232754 108 157319146 158 157561265 208 157695300 258 308 358
9 157141368 59 157232835 109 157319186 159 157561409 209 157695328 259 309 359
10 157141533 60 157232897 110 157319217 160 157561446 210 157695374 260 310 360
11 157141700 61 157232947 111 157390455 161 157561478 211 157695405 261 157145505 311 361
12 157141815 62 157232985 112 157390623 162 157561540 212 157695488 262 312 362
13 157142315 63 157233032 113 157390695 163 157561573 213 157643576 263 313 363
14 157142458 64 157233077 114 157390796 164 157561600 214 157695522 264 314 364
15 157142581 65 157233139 115 157390899 165 157561766 215 157695547 265 315 365
16 157142657 66 157233155 116 157390993 166 157561803 216 157695592 266 316 366
17 157142846 67 157263540 117 157391128 167 157561820 217 157695633 267 317 367
18 157142932 68 157263774 118 157391199 168 157561857 218 157695711 268 318 368
19 157143024 69 157263982 119 157391390 169 157561915 219 157695744 269 319 157398208 369
20 157143379 70 157264169 120 157391460 170 157562016 220 157727319 270 320 370
21 157151897 71 157264424 121 157432088 171 157562094 221 157727397 271 321 371
22 157152004 72 157264672 122 157432572 172 157582058 222 157727678 272 322 372
23 157152055 73 157264804 123 157432622 173 157582138 223 157727802 273 323 373
24 157152149 74 157265013 124 157433738 174 157585843 224 157727887 274 157183411 324 374
25 157152184 75 157265143 125 157433887 175 157605361 225 157728007 275 325 157644590 375
26 157152281 76 157265278 126 157433930 176 157605721 226 157728104 276 326 376
27 157152621 77 157265373 127 157439370 177 157605784 227 157728203 277 327 377
28 157152664 78 157265532 128 157439458 178 157605982 228 157145312 278 328 378
29 157152710 79 157265691 129 157439584 179 157606065 229 157728289 279 329 379
30 157152836 80 157267819 130 157439628 180 157606113 230 157769994 280 330 157398364 380
31 157171221 81 157267957 131 157439651 181 157639267 231 157770148 281 331 381 157643315
32 157171313 82 157268075 132 157439702 182 157100851 232 157770496 282 332 382
33 157171602 83 157268144 133 157439754 183 157639365 233 157770594 283 157395162 333 157642508 383
34 157171744 84 157268337 134 157439820 184 157639574 234 157770775 284 334 384
35 157172047 85 157270745 135 157439847 185 157639737 235 157932941 285 335 385
36 157172251 86 157270944 136 157439895 186 157639827 236 157935262 286 336 386
37 157174146 87 157275057 137 157439921 187 157639930 237 157935700 287 337 387
38 157192096 88 157275106 138 157439949 188 157640224 238 157935816 288 338 388 157174496
39 157192142 89 157275291 139 157439964 189 157640575 239 157935902 289 339 389
40 157192166 90 157183955 140 157439976 190 157683212 240 157936051 290 340 390
41 157192228 91 157275336 141 157440036 191 157683340 241 157936764 291 341 157399029 391 157642892
42 157192291 92 157275434 142 157440058 192 157683397 242 157971081 292 342 392
43 157192323 93 157275607 143 157440118 193 157683505 243 157971296 293 343 157643699 393
44 157192361 94 157275648 144 157440169 194 157683716 244 157971714 294 344 394
45 157192390 95 157275721 145 157440228 195 157683888 245 157971919 295 345 395
46 157216928 96 157275750 146 157440295 196 157684075 246 157972177 296 346 396
47 157217346 97 157275962 147 157440423 197 157684541 247 157972663 297 347 397
48 157217722 98 157275977 148 157440512 198 157684668 248 157972739 298 157644034 348 398
49 157217989 99 157275995 149 157440549 199 157684732 249 157972950 299 349 399

Data Preparation

The processed batches can be found at this Google Drive folder, including a map of each batch's ID and approximate size.

Tagging Plans

Tag Example Data
addr:housenumber 14
addr:street Riverview Lane
addr:city Concord
addr:state VA
addr:postcode 24430
addr:unit Contains unit identifier
Key:addr:unit:label Contains unit designator

A dedicated user account, shared between verified contributors to the import, will be used to carry out this import. Lynchburg MSA Address Import

Data formatting

The latest .txt file of the VGIN dataset was downloaded 2024-09-11 from [[1]]. This file was processed with an already-existing python script by @tekim created for the Rockbridge import. The script used can be found in this Dropbox data folder hosted by user @pmfox. The counties of interest were extracted as .csv files, which were then converted to .geojson and processed using QGIS to split the data into manageable batches.

Data Merge Workflow

Plugin requirements: BuildingsTools, Conflation, Colored Streets map style, MapWithAI for QA validation

Each batch will be processed as follows:

  1. Open the relevant batch_id_###.geojson file using JOSM.
  2. Open the Virginia Imagery Service - Most Recent imagery layer.
  3. Select all points, and remove the batch_id field.
  4. Onto a new layer, download from OSM to use as the merge layer.
  5. Select all "addr:housenumber" on the downloaded layer, then open the Conflation plugin and FREEZE the Subject layer.
  6. Select all address nodes on the import layer, then open the Conflation plugin and FREEZE the Reference layer.
  7. Resolve matches and conflicts on a case-by-case basis. Add a fixme tag when unsure.
  8. Select all entries in the "Reference only" tab and press Conflate.
  9. Using the Colored Streets map style in JOSM, visually verify addresses are the same color and name as their associated street. If there is a discrepancy between the street and the address, check for typos and cross reference with official VGIN sources, as many roads in this area have not been updated since the TIGER import and are incorrect. Update the street name as necessary. Road geometry and TIGER tag cleanup is out of the scope of this import.
  10. For apartment buildings, this dataset frequently separates every unit into its own address. Merge these nodes into a single node for the building, with the Key:addr:flats field containing all unit numbers (can be expressed as a range or series of ranges according to the wiki page).
  11. On the downloaded layer, select buildings and address nodes in a small working area and use the Merge Address Points function of BuildingsTools. Do not select all on the layer, as this process requires manual verification- occasionally address nodes are misaligned to building footprints and require an adjustment before merging. If multiple addresses exist in one building footprint, leave the addresses as nodes.
  12. Use JOSM's validator with MapWithAI installed at time of upload and resolve any errors or warnings related to addresses.
  13. Upload using the dedicated import account with the changeset comment "Lynchburg VA area address import - batch ###" and place the resulting changeset link in the table above for coordination.

Discussion

https://community.openstreetmap.org/t/proposed-import-lynchburg-virginia-area-addresses/118681

QA

JOSM and MapWithAI's QA functionality will be used to validate each changeset.

See also