Lynchburg VA Area Import

From OpenStreetMap Wiki
Jump to navigation Jump to search




Lynchburg VA Area Address Import is a proposed one-time import of Virginia Address Points, covering the Lynchburg Metropolitan Statistical Area, excluding Lynchburg City as address data is mostly complete, and excluding Appomattox County for purposes of scale.

Goals

To improve the area around Lynchburg and surrounding counties by filling missing address data for the purpose of navigation. Previous imports of this dataset have been carried out in neighboring counties such as the Rockbridge County, Virginia Address Import and this import will follow similar standards for data processing for cohesion in the geographical area.

Schedule

Background

Proposal started: 2024-09-12

Data formatting complete: 2024-09-20

Import began: 2024-09-25

Import completed: 2024-11-07

Import Data

Virginia Address Points: https://hub.arcgis.com/datasets/VGIN::virginia-address-points/about
Type of license: Public Domain

The quality of this dataset in the counties of interest is high, and no significant modifications to the data will be necessary aside from field conversion to OSM standards. This includes converting road names out of uppercase, and expanding abbreviations.

Import Type

One Time Import for the first three counties, with possible second round for Appomattox County and other adjacent counties.

Status

The data is split in 400 batches of approximately 2-5 square mile clusters, generated with QGIS k-means clustering. The batches have a mean size of 217 addresses and a median size of 115 addresses, although the maximum batch size is 1,783 address points due to the density near Lynchburg city.

Batch Changeset ID Batch Changeset ID Batch Changeset ID Batch Changeset ID Batch Changeset ID Batch Changeset ID Batch Changeset ID Batch Changeset ID
0 157098081 50 157218267 100 157190513 150 157471992 200 157694978 250 158015747 300 158675524 350 158872323
1 157098399 51 157218345 101 157318643 151 157472096 201 157695022 251 158015869 301 158675661 351 158872391
2 157100409 52 157218492 102 157318680 152 157472158 202 157695050 252 158016088 302 158675726 352 158872473
3 157100506 53 157226852 103 157318723 153 157472540 203 157695090 253 158016231 303 158675784 353 158872545
4 157101551 54 157145692 104 157318806 154 157472685 204 157695108 254 158016561 304 158675877 354 158872628
5 157101625 55 157227059 105 157318857 155 157472807 205 157695175 255 158016667 305 157395616 355 158873333
6 157102391 56 157232609 106 157318965 156 157472933 206 157695221 256 158020685 306 158675976 356 158873507
7 157141044 57 157232700 107 157319027 157 157473965 207 157695257 257 158020882 307 158676060 357 158873579
8 157141167 58 157232754 108 157319146 158 157561265 208 157695300 258 158020978 308 158676233 358 158873738
9 157141368 59 157232835 109 157319186 159 157561409 209 157695328 259 158021055 309 158676293 359 158873776
10 157141533 60 157232897 110 157319217 160 157561446 210 157695374 260 158021876 310 158676450 360 158875424
11 157141700 61 157232947 111 157390455 161 157561478 211 157695405 261 157145505 311 158676549 361 158875482
12 157141815 62 157232985 112 157390623 162 157561540 212 157695488 262 158275183 312 158676642 362 158875538
13 157142315 63 157233032 113 157390695 163 157561573 213 157643576 263 158275285 313 158676816 363 158875585
14 157142458 64 157233077 114 157390796 164 157561600 214 157695522 264 158275321 314 158676855 364 158875645
15 157142581 65 157233139 115 157390899 165 157561766 215 157695547 265 158275384 315 158676893 365 158875698
16 157142657 66 157233155 116 157390993 166 157561803 216 157695592 266 158275448 316 158677370 366 158875755
17 157142846 67 157263540 117 157391128 167 157561820 217 157695633 267 158275505 317 158677410 367 158565633
18 157142932 68 157263774 118 157391199 168 157561857 218 157695711 268 158275554 318 158677462 368 158875790
19 157143024 69 157263982 119 157391390 169 157561915 219 157695744 269 158275592 319 157398208 369 158875864
20 157143379 70 157264169 120 157391460 170 157562016 220 157727319 270 158275645 320 158716680 370 158875906
21 157151897 71 157264424 121 157432088 171 157562094 221 157727397 271 158350100 321 158716831 371 158875944
22 157152004 72 157264672 122 157432572 172 157582058 222 157727678 272 158351022 322 158717041 372 158875987
23 157152055 73 157264804 123 157432622 173 157582138 223 157727802 273 158512101 323 158717159 373 158876081
24 157152149 74 157265013 124 157433738 174 157585843 224 157727887 274 157183411 324 158717263 374 158876158
25 157152184 75 157265143 125 157433887 175 157605361 225 157728007 275 158512266 325 157644590 375 158876252
26 157152281 76 157265278 126 157433930 176 157605721 226 157728104 276 158512342 326 158717319 376 158876286
27 157152621 77 157265373 127 157439370 177 157605784 227 157728203 277 158512416 327 158717385 377 158876312
28 157152664 78 157265532 128 157439458 178 157605982 228 157145312 278 158512449 328 158717424 378 158876354
29 157152710 79 157265691 129 157439584 179 157606065 229 157728289 279 158512631 329 158717513 379 158876414
30 157152836 80 157267819 130 157439628 180 157606113 230 157769994 280 158512756 330 157398364 380 158876522
31 157171221 81 157267957 131 157439651 181 157639267 231 157770148 281 158642536 331 158751384 381 157643315
32 157171313 82 157268075 132 157439702 182 157100851 232 157770496 282 158642557 332 158751477 382 158876545
33 157171602 83 157268144 133 157439754 183 157639365 233 157770594 283 157395162 333 157642508 383 158876582
34 157171744 84 157268337 134 157439820 184 157639574 234 157770775 284 158642573 334 158792140 384 158876627
35 157172047 85 157270745 135 157439847 185 157639737 235 157932941 285 158642609 335 158792199 385 158876815
36 157172251 86 157270944 136 157439895 186 157639827 236 157935262 286 158642737 336 158792290 386 158876922
37 157174146 87 157275057 137 157439921 187 157639930 237 157935700 287 158642752 337 158792418 387 158876965
38 157192096 88 157275106 138 157439949 188 157640224 238 157935816 288 158642794 338 158792510 388 157174496
39 157192142 89 157275291 139 157439964 189 157640575 239 157935902 289 158642815 339 158792578 389 158876994
40 157192166 90 157183955 140 157439976 190 157683212 240 157936051 290 158642835 340 158792665 390 158877156
41 157192228 91 157275336 141 157440036 191 157683340 241 157936764 291 158642907 341 157399029 391 157642892
42 157192291 92 157275434 142 157440058 192 157683397 242 157971081 292 158642932 342 158792749 392 158877409
43 157192323 93 157275607 143 157440118 193 157683505 243 157971296 293 158642963 343 157643699 393 158877442
44 157192361 94 157275648 144 157440169 194 157683716 244 157971714 294 158643100 344 158792782 394 158877495
45 157192390 95 157275721 145 157440228 195 157683888 245 157971919 295 158643118 345 158792811 395 158877511
46 157216928 96 157275750 146 157440295 196 157684075 246 157972177 296 158643131 346 158792897 396 158877525
47 157217346 97 157275962 147 157440423 197 157684541 247 157972663 297 158643156 347 158792969 397 158877546
48 157217722 98 157275977 148 157440512 198 157684668 248 157972739 298 157644034 348 158793009 398 158877570
49 157217989 99 157275995 149 157440549 199 157684732 249 157972950 299 158643172 349 158793107 399 158877602

Data Preparation

The processed batches can be found at this Google Drive folder, including a map of each batch's ID and approximate size.

Tagging Plans

Tag Example Data
addr:housenumber 14
addr:street Riverview Lane
addr:city Concord
addr:state VA
addr:postcode 24430
addr:unit Contains unit identifier
Key:addr:unit:label Contains unit designator

A dedicated user account, shared between verified contributors to the import, will be used to carry out this import. Lynchburg MSA Address Import

Data formatting

The latest .txt file of the VGIN dataset was downloaded 2024-09-11 from [[1]]. This file was processed with an already-existing python script by @tekim created for the Rockbridge import. The script used can be found in this Dropbox data folder hosted by user @pmfox. The counties of interest were extracted as .csv files, which were then converted to .geojson and processed using QGIS to split the data into manageable batches.

Data Merge Workflow

Plugin requirements: BuildingsTools, Conflation, Colored Streets map style, MapWithAI for QA validation

Each batch will be processed as follows:

  1. Open the relevant batch_id_###.geojson file using JOSM.
  2. Open the Virginia Imagery Service - Most Recent imagery layer.
  3. Select all points, and remove the batch_id field.
  4. Onto a new layer, download from OSM to use as the merge layer.
  5. Using the search string < "addr:housenumber" | amenity=* | shop=* | office=* | building=* > on the downloaded layer, then open the Conflation plugin and FREEZE the Subject layer. (This string should catch all existing addresses, buildings, and amenities such as churches that were imported through GNIS- be aware it also picks up parking lots!)
  6. Select all address nodes on the import layer, then open the Conflation plugin and FREEZE the Reference layer.
  7. Resolve matches and conflicts on a case-by-case basis. Add a fixme tag when unsure.
  8. Select all entries in the "Reference only" tab and press Conflate.
  9. Using the Colored Streets map style in JOSM, visually verify addresses are the same color and name as their associated street. If there is a discrepancy between the street and the address, check for typos and cross reference with official VGIN sources, as many roads in this area have not been updated since the TIGER import and are incorrect. Update the street name as necessary. Road geometry and TIGER tag cleanup is out of the scope of this import.
  10. For apartment buildings, this dataset frequently separates every unit into its own address. Merge these nodes into a single node for the building, with the Key:addr:flats field containing all unit numbers (can be expressed as a range or series of ranges according to the wiki page).
  11. On the downloaded layer, select buildings and address nodes in a small working area and use the Merge Address Points function of BuildingsTools. Do not select all on the layer, as this process requires manual verification- occasionally address nodes are misaligned to building footprints and require an adjustment before merging. If multiple addresses exist in one building footprint, leave the addresses as nodes.
  12. Use JOSM's validator with MapWithAI installed at time of upload and resolve any errors or warnings related to addresses.
  13. Upload using the dedicated import account with the changeset comment "Lynchburg VA area address import - batch ###" and place the resulting changeset link in the table above for coordination.

Discussion

https://community.openstreetmap.org/t/proposed-import-lynchburg-virginia-area-addresses/118681

QA

JOSM and MapWithAI's QA functionality will be used to validate each changeset.

See also