Abstract
This study creates a historic dataset of road opening dates in Sydney. A method was developed for map digitization to extract spatial data from historic maps and place them in a collective vector layer. The method includes extensive georeferencing of the maps, as well as editing and cleaning the maps through raster and vector analysis. Preferred methods for map digitization used in the project were identified. For a considerable area of Sydney, in which approximately 52000 road links were included, almost half of the links were identified with an open date by the start of the twentieth century. A further half of these links were confined to opening within a thirty-year period. The project has established a strong foundation for a historic road dataset for Sydney. It has also outlined methods and procedures that can be followed to progress the dataset further.
Similar content being viewed by others
Background & Summary
For historians, engineers, planners, researchers, and other interested parties, there is value to be gained from understanding the evolution of road networks. Historical records can serve to benefit cities moving forward at the strategic, tactical, and practical levels. Examples are abundant. For instance, the environmental impacts of road development and subsequent land impact can be assessed over time, while roads in need of reconstruction, conservation, or modification can be identified from their construction dates. For example, Cardew et al. investigated the recent construction of large residential areas in Sydneyâs West1. Certain roads were identified as necessities to support developing manufacturing industries. Similarly, Walsh focuses on the relevance of geography to progressing industries in the early colonial period of Sydneyâs history2.
Studying the evolution of road networks requires digitizing historic records and maps. Map digitizing is a type of spatial modeling that integrates image processing and automation techniques. The development of these techniques to provide data into a GIS environment has been the focus of research since the 1990s3,4,5,6. Thanks to these efforts, todayâs road network is accessible from various sources such as OpenStreetMap (OSM). However, OSM generally lacks historic information about each segment (i.e., road opening and closure dates) and little effort has been put into extracting this information from historic records and maps.
Recent literature puts significance on the digitized geography of historic sources. Historic GIS, which integrates the study of historic sources such as artifacts, data and maps with Geographic Information Systems (GIS), adds new dimensions to the base of historic information7. In summary, GIS is a representation of qualitative and quantitative data through attributes and spatial characteristics, allowing spatially defined geographic data to be used to enhance historic inquiries8.
Over time, GIS has developed into a tool useful for expressing urban development. Loren Siebert has developed a GIS dataset for understanding the urbanization of Tokyo since the late nineteenth century9. The source creates a spatial history by integrating numerous historic sources10. This includes physically tracing landscapes as a vector, uploading census data as attributes and utilizing rail construction detail, as a means of tracking demographic change over time7.
One of the first major historic GIS datasets developed was the Great Britain Historical GIS Project (GBHGIS) to trace the changing administrative boundaries of previous data the projectâs historians had collected11. Administrative boundaries were also traced in another earlier project on the history of China (222 BCE - 1911 AD)12. The two works were formative for the historic GIS field and explored various ways of using GIS tools to represent historic data.
Several historic GIS projects have considered road development in their research. A project aimed at reconstructing Rome from the eighteenth century uses a base map from 1748 by Giovanni Battista Nolli13. The map is digitized and georeferenced so that it can be compared to vector GIS layers. Overlays of vector layers, such as pedestrian paths and polygons of structures, against the georeferenced base map are used to assess the maps accuracy. In a separate project, Levin et al. from the Hebrew University of Jerusalem have used GIS as a tool to extrapolate roads from digitized and geoprocessed maps14. Similarly, Perret et al. have developed some methods to digitize French road network at national level by the historic maps of Cassini in the 18th century15.
Other studies investigated the evolution of road network growth, the topological characteristics and urban morphology of different case studies. For example historic road networks in London16, Paris17, Zurich18, Changchun19, Seoul20, Milan21, Minneapolis22 and other cities23,24,25 have been digitized and processed. Hypothetical (synthetic) networks were also explored26,27,28.
Another notable project comes from academic Andrew Wilson, who has used GIS to generate a historic dataset of Sydney29. Since 1998, the project has digitized historic maps, images, verbal descriptions and other sources to form the basis of its dataset. However, the work has rarely considered the geographic significance of road construction in Sydney. Roads have been viewed as a means of connecting points in history worth discussing and the importance of their location in space has not been considered the center of discussion itself. This study aims to provide a dataset so that the location of roads in both Sydneyâs space and time can be properly considered.
Other projects with similar ambitions to create a historic road dataset have chosen to manually complete the map digitization process, usually by simply drawing vectors by tracing a historic map. The New York Public Libraryâs Spacetime project has crowd-sourced users to complete this tracing with voluntary input30. Another project focusing on the change in road structure in Manila over a hundred-year period concluded that it was more efficient to trace lines manually after an automated georeference transition was completed31.
Historical maps are usually in the form of scanned maps, which need raster classification for processing. There are many supervised and unsupervised methods described in the literature. A common raster classification technique is called color image segmentation (CIS). Color image segmentation is the process of dividing an image into multiple segments or regions based on color attributes using different clustering algorithms32,33,34,35,36,37. In a raster classification, the goal of this technique is to separate objects or regions with similar color values and assign them a unique label. It contributes to the creation of a clearer and more concise representation of the image, making it easier to analyze and process further.
Furthermore, there are a few state-of-the-art studies using machine learning methods for map digitization. For example, text detection in historic maps38, segmentation and digitization of historic maps39,40, feature recognition41,42, road extraction43, detecting road types44, and cadastral boundary extraction45,46 using neural network, deep neural network, and convolutional neural network models.
This study aims to digitize historic records for roads in Sydney, detailing the open and closure dates for each road link in the Sydney network. The project will collate the scattered historic records currently available for the Sydney road network into an accessible dataset, observing and identifying change over time. We aim to identify an efficient means of automating this process. Figure 1 provides a schematic overview of the study.
Methods
The following subsections describe collecting data and the typical steps for map digitization. For all spatial processing and analysis in this study, QGIS version 3.22.15 (LTR) was used.
Source maps
There are volumes of historic maps available on the road networks of Sydney. Eight maps were selected, including maps from the National Library of Australiaâs Trove database, published in 187747 and 190348, from the State Library of NSW for the map, published in 189049, from the City of Sydney and Dictionary of Sydney for the maps published in 184450, 185551, 188852, 1894 and 188653. All of these maps are out of copyright and publicly available online in image format. The John Sands Map of the City and Suburbs of Sydney, published in 1877, can be seen in Fig. 2.
John Sands Map of the City and Suburbs of Sydney, 187763.
Geo-referencing maps
The aim of the georeferencing process is to correctly position the scanned map (raster image) in the chosen geographic projection. To achieve this, markers are manually placed on the scanned map to indicate that positionâs location or coordinates. These markers are called ground control points (GCP).
There are various methods of transformation that the analyst can use to display the georeferenced image. These will vary in how significantly the original mapâs size, shape and scale are maintained. The polynomial method forms a relationship between each of the nominated ground control points using an equation and the original map configuration. The degree of the polynomial (quadratic and cubic) affects the amount of smooth changes that can be made to the maps geometry54. A higher degree polynomial equation will allow for more map disfiguration, while maintaining the smooth shape of the original map. There is little further improvement for higher order polynomials beyond a cubic equation55.
The thin plate spline transformation is a localized method that creates envelopes around ground control points, distorting the remainder of the map around these envelopes55. The original shape of the map will not be maintained and some sections can become significantly warped. The notable difference between the two methods is that the polynomial transformation will aim to maintain the original scale and shape of the map, permitting the nominated ground control points to be repositioned. The thin plate spline transformation method will significantly restrict movement between the GCP points from their nominated positions, instead allowing warping of the map between designated points.
Raster classification and generalization
Following georeferencing, the next procedure is to extract historic detail from the raster image. The raster automation process commences by first removing all unnecessary detail from the image. There is no means for the system to distinguish between any parts of the image, including what constitutes a road segment, without first completing some raster processing. Identifying which tools are effective and should be used remains the role of the user. This subsection identifies the raster editing methods used for successful map digitization in this project.
The raster classes need to be edited before converting an image into a vector. A raster image is comprised of pixels, each representing different color classes, that together form the collective image. It is critical to the map digitization process that only pixels representative of road segments are maintained in the image. Further, these road segment pixels need to be homogenized into continuous pixel segments. If the image were not reclassified, each distinct class will be vectorized independently. Rather than long road sections, the vector layer would simply comprise small pixel-sized dots that cannot be easily selected, edited or utilized for further analysis. The vector structure that emerges for non-homogenized pixels can be observed in Fig. 3.
For the raster-to-vector conversion to be efficient, and for the conversion to recognize continuous segments as vectors, the color scheme for the raster image will need to be changed. Maps are scanned into a raster in an RGB color scheme, where pixels are displayed as a combination of red, green and blue color bands. From the RGB color scheme format the image is scanned in, with 255 distinct classes, the image is converted down into a binary color scheme. The scheme is structured to distinguish colors representing road segments, and other colors representing background noise.
The color classes for the scanned image will need to be divided and deconstructed in order to create a binary color scheme. An example of the class divisions is provided for a map intersection in Fig. 4. The image shows a color-enhanced intersection between two roads on a map of Woolloomooloo, dated 1844. The colors used in the image are black for road boundaries, yellow for the space between road boundaries, blue for housing or properties either side of the road, and either red or black for additional informative text. A call-out box is used to show the range of colors in each of the three color bands. For the most part, pixels representing road borders are in the range of 1-60 in the red band, while all background noise is represented outside this band. Distinguishing the image can consequentially be achieved through a cut-off in the red color band. Pixels that fall outside of this range can be considered irrelevant for road identification.
Color range for a road intersection from 1844 Woolloomooloo (inner-city eastern suburb of Sydney) map59.
There are numerous methods that can be used to make these divisions. For Fig. 4, the color classes were identified through manual observation. The plug-in Serval can be used to display the RGB color palette of a raster. This is achieved through clicking pixels and displaying the color palette on screen. From observation, a color band can be selected and split into a binary selection.
However, several methods can be used to partially automate the above color identification process. It is ideal to homogenize the three color bands into one, auto-balancing the colors using the GRASS plug-in feature i.colors.enhance. Road features were found to typically be constructed of lower RGB values in all three bands. Comparatively, background detail was found to feature more prominently in a low color class in one band, and higher classes in the other two bands. Homogenizing the color scheme creates a meaningful cutoff that considers all color bands.
The r.reclass tool is then used to store all of the pixels in one of two classes, rather than the original 255. This is to create fewer vectors in the raster-to-vector conversion, making the process more efficient and connecting more vector points together during the vectorization process.
There are methods to automate the reclassification process further. A model or toolbox can be established to automate the reclassing of raster images without prompt, based on a predetermined color threshold56. However, this project aims to establish a method that can be considered for all map types. Considering the uniqueness of color likely to be found in maps from different times and authors, it is more accurate to observe the colors of each map and subsequently choose a color distinction. It is important to find the right class distinction. Selecting too few classes for the reclassification will remove too much information, whilst selecting too many classes will result in an overly high amount of background noise distorting results.
Two main types of errors were noticed across all the maps used in the project. Firstly, the map lines were not scanned with enough detail to display consistent and complete lines. The maps considered for this project are over a hundred years old, and understandably they would have experienced fading, damage and deterioration over time. These errors are identified in the scanning process and need to be fixed.
The intent of this raster modification is to create sharper road segments. QGIS has various in-built functions that allow for efficient raster editing. These are used to make the road segments from the scanned image as complete as possible prior to turning the map into a vector. A raster with holes, broken segments or otherwise will not transform into complete vectors, creating problems in the road identification stage later in the process. Depending on the map in consideration, raster generalization methods will have a variable rate of success.
The simple QGIS in-built program r.grow was used as the first means of raster editing. The feature will grow selected cells from an input criteria into their immediately neighboring cells. This was highly effective in closing gaps in road segments that were only a few pixels wide. The gap between these segments would be closed, creating longer line segments. The method was found to be effective for all maps considered for the project, and could be applied as an iterative process until road gaps were adequately closed.
An alternative to the above method is to use the SAGA plug-in program close one cell gaps. The program will similarly close small gaps between line segments that are slightly incomplete, however the size of the gaps that are closed does not occur to a consistent pixel size57. Rather, the gaps closed depend on the average characteristic of the neighbor cells, amplified by an input variable. The result is that in addition to small line gaps, the program can be more aggressively used to close the gap between entire street networks, by filling the space between two parallel road boundaries. This method is effective for closing the space efficiently in large maps, however for more intricate street networks in densely drawn suburbs, street networks tended to homogenize into one large section. This meant a loss of data about smaller streets.
Vector transformation and vector editing
The vector layer transformed from a raster image comprises numerous lines that represent road links. The vector layer will need some processing to create a more accurate representation of the road network. The intent is to remove any features displayed in the vector layer that should not be identified by the eventual vector selection, when overlayed by the OSM layer. Various tools that were found to be effective included removing small vectors that had formed from isolated pixel clumps. Each polygon vector will contain an area that can be determined from the layerâs attribute table. All vectors with an area below a nominated size can be filtered and removed from the vector layer with relative ease. Identifying the threshold area that a polygon needs to exceed, to be maintained in the vector layer, will be unique for each map. It will depend on the average size of the features on the map. Depending on the geometries present in the map, it is possible to remove buildings, informative background texts, and small outlier pixels in this process.
Another measure of vector processing found to be effective across all maps was the delete holes vector geometry function. For line segments that were filled or closed in raster generalization, the function will remove all holes within a polygon vector up to a nominated area. For large vectors, the intent will be to select vectors from the base OSM layer that are completely contained within the overlayed historic GIS projection.
The alternative method of raster transformation was to use thinner lines that had only been amended on the road boundaries, not filled completely. This method was preferred for more intricately defined road networks to avoid data loss. For this method, it is convenient in the vector editing stage to extend the boundaries of the transformed polygons, using the function buffer. The function dissolves the space between vectors by extending the width of nominated vectors. The method is effective at automating corrective edits to sections of old maps that had not been transformed from raster-to-vector with a high degree of accuracy.
Overlaying with OSM data
The last stage in automating the transformation of raster data into vector data involves determining which historic roads match the OSM links. The select by location function was utilized to determine roads from the historic street map that meet the description of an open road. To reduce confusion, cycleways and footpaths adjacent to roads were excluded from the OSM data. At intersections, there may be a slight inclusion of modern roads in the selection. To address this issue, the unintended selected features are identified and removed manually during post-processing.
In the overlaying process, the existing network (i.e., the OSM road network) is compared with historic roads. There are four possible categories for each network element in this comparison:
-
1.
The link exists on a historic map and exists now. Itâs worth noting that the link may have been constructed, demolished, and rebuilt.
-
2.
The link exists on a historic map but not now. This could be due to (a) it was built, later demolished, or relocated, or (b) it was never built; the map was based on plans that were never realized.
-
3.
The link does not exist on the map but exists now.
-
4.
The link exists on neither, i.e the entire remaining space.
While this study primarily focuses on the first category, the second category was manually examined for some of the maps, and the third category is implicitly derived from the first.
Data Records
The data records contain the Sydney road network and historic geo-referenced maps. The data consists of one shapefile (with its.dbf,.shx.cpg, and.prj extension files) and eight images (.tiff) which have been uploaded on figshare as follows:
-
1.
Sydney road network (Sydney_roads.shp)58: This is a historic dataset for road opening dates in Sydney. The links are based on OpenStreetMap data which overlayed with the historic maps. It includes the following attributes:
-
osm_id: the OpenStreetMap unique identifier for each road segment if available (integer)
-
MAP001: whether the road segment exists in map Wooloomooloo, 1844. Values are âOpenâ, âNot Openâ or âNullâ. Null indicates not being covered by the map.
-
MAP002: whether the road segment exists in map City of Sydney, 1855. Values are âOpenâ, âNot Openâ or âNullâ. Null indicates not being covered by the map.
-
MAP003: whether the road segment exists in map Glebe 1888. Values are âOpenâ, âNot Openâ, âClosedâ or âNullâ. Closed indicates the road segments were open back in the date but they are closed now. Null indicates not being covered by the map.
-
MAP004: whether the road segment exists in map Concord 1894. Values are âOpenâ, âNot Openâ or âNullâ. Null indicates not being covered by the map.
-
MAP005: whether the road segment exists in map John Sands Map of the City and Suburbs of Sydney. Published by John Sands, 1877. V Values are âOpenâ, âNot Openâ, âClosedâ or âNullâ. Closed indicates the road segments were open back in the date but they are closed now. Null indicates not being covered by the map.
-
MAP006: whether the road segment exists in map John Sands Map of the City and Suburbs of Sydney. Published by John Sands, 1890. Values are âOpenâ, âNot Openâ, âClosedâ or âNullâ. Closed indicates the road segments were open back in the date but they are closed now. Null indicates not being covered by the map.
-
MAP007: whether the road segment exists in map Marrickville A 1886-1888. Values are âOpenâ, âNot Openâ or âNullâ. Null indicates not being covered by the map.
-
MAP008: whether the road segment exists in map John Sands Map of the City and Suburbs of Sydney. Published by John Sands, 1903. Values are âOpenâ, âNot Openâ or âNullâ. Null indicates not being covered by the map.
-
Open2021: whether the road segment exists in OpenStreetMap data. Values are âYesâ or âNoâ.
-
-
2.
Woolloomooloo 1844 historic map (1844_Wooloomooloo_Georeferenced.tif)59: This is the georeferenced map of Woolloomooloo 1844 archived by City of Sydney50.
-
3.
Sydney 1855 historic map (1855_City_of_Sydney_Georeferenced.tif)60: This is the georeferenced map of Sydney and suburbs 1855 archived by National Library of Australia51.
-
4.
Glebe 1888 historic map (1888_Glebe_Georeferenced.tif)61: This is the georeferenced map of Glebe 1888 archived by City of Sydney52.
-
5.
Concord 1894 historic map (1894_Concord_Georeferenced.tif)62: This is the georeferenced map of Concord 1894 archived by Dictionary of Sydney53.
-
6.
City and Suburbs of Sydney 1877 historic map (1877_Sydney_Georeferenced.tif)63: This is the georeferenced map of City and Suburbs of Sydney 1877 archived by National Library of Australia47.
-
7.
City and Suburbs of Sydney 1890 historic map (1890_Sydney_Georeferenced.tif)64: This is the georeferenced map of City and Suburbs of Sydney 1890 archived by State Library of NSW,49.
-
8.
Marrickville 1886-1888 historic map (1888_Marrickville_Georeferenced.tif)65: This is the georeferenced map of Marrickville 1886-1888 archived by Dictionary of Sydney53.
-
9.
City and Suburbs of Sydney 1903 historic map (1903_Sydney_Georeferenced.tif)66: This is the georeferenced map of City and Suburbs of Sydney 1903 archived by National Library of Australia48.
Technical Validation
The georeferencing requirements for this study focus on accurately positioning large maps. A visual comparison was completed for the John Sands 1903 map. With the establishment of ground control points (GCPs), as illustrated in Fig. 5, the georeference was completed using two transformation methods: polynomial 3 and thin plate spline. These GCPs are manually pinpointed across the mapsâ periphery and center. The thin plate spline method becomes increasingly effective when compared to the polynomial transformation method, as more ground control points are nominated. This is a result of the ability to remove local errors in the mapping67. However, this depends on the evenness of the ground control point distribution. A neglected area will degrade significantly in either method of transformation68.
The difference in the two methods is quickly apparent from a comparison. Figure 6 shows the final cubic polynomial and thin plate spline georeference transformations for the suburb of Manly, a small selection from the whole map. Both maps are overlayed by the present OpenStreetMap vector layer, and both layers feature identical ground control points. The thin plate spline transformation layer is distorted as a result of the transformation process, however the road sections have far closer alignment to the OSM layer. The cubic polynomial transformation is shifted below the OSM layer, a result of trying to retain the shape of the scanned map. Whilst neither map is perfect, and there will be some rectification required for both maps, the noticeably closer match between the OSM layer and the thin plate spline transformation will return far fewer errors that need to be amended in the remaining automation steps.
By significantly georeferencing larger maps using the thin plane spline method, the original integrity of the map will be lost. Whilst previous examples highlighted the benefit of this distortion for vector matching on a localized scale, the end result of substantial thin plate spline transformations can be significantly deconstructive to the original state of the map. In Fig. 7, a thin plate spline transformation of the John Sands map published in 1903, the global distortion caused by the georeference of the map can be clearly observed. In the images, multiple suburbs are observed to the west of Botany Bay. Thick, white grid lines in the original map represent planar folds from when the map has been folded over time, presumably with the intent to fold along these lines and minimize damage to the remaining image. These grid lines were rigidly drawn with sharp edges. However, the grid lines have been curved and distorted significantly through the georeference transformation, in order to correctly position the map. It highlights errors in the construction of the original map, where suburbs were not positioned in the correct size and scale, rather than errors in the georeferencing process. The aim of georeferencing is to correctly position the map and this can be at the expense of the historic maps original shape and form. Consequentially, the additional distortion caused by the thin plate spline method should not cause concern when completing the georeferencing transformation.
Map of Botany Bay and neighboring suburbs 190366, showing distorted grid lines.
To validate the applied georeferencing method, a comparison of two algorithms has been conducted on a relatively small map of the suburb of Marrickville published in 188853. The two transformation methods were chosen consistently with the methods used for larger maps: polynomial 2 and thin plate spline. Table 1 summarizes the georeferencing methods. Both methods have been compared, alongside a comparison of the amount of ground control points used for the transformation. A small selection of 6 ground control points quickly positioned one key intersection of the map from a 3x2 grid. Selecting 45 ground control points covered all the main intersections in the map network.
In Table 1, mean error is in reference to the map distortion in x and y co-ordinates of GCP points after selecting by the map canvas. Mean error may be influenced by a poorly selected ground control point, however it may also be influenced by poor geo-spatial properties of the original map, such as size or scale. As a result, generating a mean error may not necessarily be detrimental to the geo-referencing accuracy, if it fixes errors in the historic map. Closely aligning the historic and base maps is the intent of the geo-referencing process. A visual comparison of the maps shows there to be little difference between the four maps on first analysis.
Usage Notes
The primary application of the methods detailed in the previous sections was completed on the John Sands map series spanning from 1877 to 1903. A partially automated process for map digitization was applied to each map in the series. A vector layer (i.e., shapefile) similar to the OSM road network is labeled for each map, as described in the Data Records section. Using the defined attributes, one can extract the road network of each map by deconstructing the shapefile into different time intervals representing the open status of the road network in Sydney as of 1877, 1890, and 1903, and beyond. For example, Fig. 8 visualizes the road network over the time period covered by the maps.
The history of demographics in cities, for example, urban migration, can be evaluated against the roads that served these movements. The evolution of transit networks and their impacts on population distribution have been studied in the literature24,69,70,71,72. With the current dataset one can conduct similar analyses and investigate the interaction between land use and the road network.
The reliability of the current dataset depends on the accuracy and level of detail in these maps. This dataset classifies streets based on their presence in historical maps as âOpen,â âNot Open,â or âNullâ (i.e., whether a street was or wasnât present on a historic map), and it does not provide absolute certainty regarding the physical existence of these streets in those times. This limitation is acknowledged to ensure that users understand the technical meanings of the classifications and their constraints. While this dataset serves as a valuable resource for historical reference, it may require additional primary data verification for absolute confirmation of the historical existence of streets.
Code availability
No custom code was used to generate or process the data described in this article.
References
Cardew, R. V., Langdale, J. V. & Rich, D. C.Why Cities Change: Urban Development and Economic Change in Sydney. second edn. (Routelidge, Abingdon, 2007).
Walsh, G. The geography of manufacturing in Sydney, 1788-1851. Business Archives and History 3, 20â52 (1963).
Richardson, D. & Thomson, R. Integrating thematic, geometric, and topological information in the generalization of road networks. Cartographica: The International Journal for Geographic Information and Geovisualization 33, 75â83 (1996).
Buttenfield, B. P. A rule for describing line feature geometry. Map generalization: Making rules for knowledge representation 150â171 (1991).
Thomson, R. C. & Richardson, D. E. A graph theory approach to road network generalisation. In Proceeding of the 17th International Cartographic Conference, 1871â1880 (1995).
Richardson, D. E. Generalization of spatial and thematic data using inheritance and classification and aggregation hierarchies. Advances in GIS research 2, 957â972 (1994).
Gregory, I. N. & Healey, R. G. Historical GIS: structuring, mapping and analysing geographies of the past. Progress in Human Geography 31, 638â653 (2007).
Bailey, T. J. & Schick, J. B. Historical GIS: enabling the collision of history and geography. Social Science Computer Review 27, 291â296 (2009).
Siebert, L. Using GIS to document, visualize, and interpret Tokyoâs spatial history. Social Science History 24, 537â574 (2000).
Knowles, A. K. Gis and history. In Knowles, A. K. & Hillier, A. (eds.) Placing History: How Maps, Spatial Data and GIS are Changing Historical Scholarship, 1â27 (ESRI Press, California, 2008).
Gregory, I. The Great Britain historical GIS. Historical Geography 132â134 (2005).
Bol, P. The china historical geographic information system (CHGIS): Choices, faces, lessons learned. The Conference on Historical Maps and GIS, Nagoya University 1â12 (2007).
Lelo, K. A GIS approach to urban history: Rome in the 18th century. ISPRS International Journal of Geo-Information 3, 1293â1316 (2014).
Levin, N., Kark, R. & Galilee, E. Maps and the settlement of southern Palestine, 1799-1948. Journal of Historical Geography 36, 1â18 (2010).
Perret, J., Gribaudi, M. & Barthelemy, M. Roads and cities of 18th century France. Scientific Data 2, 1â7 (2015).
Masucci, A. P., Stanilov, K. & Batty, M. Limited urban growth: Londonâs street network dynamics since the 18th century. PLoS One 8, e69469 (2013).
Barthelemy, M., Bordin, P., Berestycki, H. & Gribaudi, M. Self-organization versus top-down planning in the evolution of a city. Scientific Reports 3, 1â8 (2013).
Casali, Y. & Heinimann, H. R. A topological analysis of growth in the Zurich road network. Computers, Environment and Urban Systems 75, 244â253 (2019).
Wang, S. et al. The evolution and growth patterns of the road network in a medium-sized developing city: A historical investigation of Changchun, China, from 1912 to 2017. Sustainability 11, 5307 (2019).
Jang, G. U., Joo, J. C. & Park, J. Capturing the signature of topological evolution from the snapshots of road networks. Complexity 2020, 1â14 (2020).
Strano, E., Nicosia, V., Latora, V., Porta, S. & Barthélemy, M. Elementary processes governing the evolution of road networks. Scientific Reports 2, 1â8 (2012).
Levinson, D. & Chen, W. Paving new ground: A Markov Chain model of the change in transportation networks and land use. In Access to Destinations, 243â266 (Emerald Group Publishing Limited, 2005).
Mohajeri, N. & Gudmundsson, A. The evolution and complexity of urban street networks. Geographical Analysis 46, 345â367 (2014).
Lan, T. & Longley, P. A. Urban morphology and residential differentiation across Great Britain, 1881â1901. Annals of the American Association of Geographers 111, 1796â1815 (2021).
Barrington-Leigh, C. & Millard-Ball, A. Global trends toward urban street-network sprawl. Proceedings of the National Academy of Sciences 117, 1941â1950 (2020).
Barthélemy, M. & Flammini, A. Modeling urban street patterns. Physical review letters 100, 138702 (2008).
Rui, Y., Ban, Y., Wang, J. & Haas, J. Exploring the patterns and evolution of self-organized urban street networks through modeling. The European Physical Journal B 86, 1â8 (2013).
Courtat, T., Gloaguen, C. & Douady, S. Mathematics and morphogenesis of cities: A geometrical approach. Physical Review E 83, 036106 (2011).
Wilson, A. Sydney timemap: Integrating historical resources using GIS. History and Computing 13, 45â68 (2001).
Library, N. Y. P. Qgis trace tutorial: Tracing historical streets with QGIS. Spacetime New York Public Library. Available online at: http://spacetime.nypl.org/qgis-trace-tutorial/ (2021).
Cirunay, M., Soriano, M. & Batac, R. Analysis of the road network evolution through geographical information extracted from historical maps: A case study of Manila, Philippines. Journal of Advances in Information Technology 10, 114â118 (2019). Available online at: 10.12720/jait.10.3.114-118.
Chen, T. Q. & Lu, Y. Color image segmentation-an innovative approach. pattern recognition 35, 395â405 (2002).
Deng, Y., Manjunath, B. S. & Shin, H. Color image segmentation. In Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149), vol. 2, 446â451 (IEEE, 1999).
Ding, Z., Sun, J. & Zhang, Y. Fcm image segmentation algorithm based on color space and spatial information. International Journal of Computer and Communication Engineering 2, 48 (2013).
Cai, W., Chen, S. & Zhang, D. Fast and robust fuzzy c-means clustering algorithms incorporating local information for image segmentation. Pattern recognition 40, 825â838 (2007).
Wang, X.-Y., Wang, T. & Bu, J. Color image segmentation using pixel wise support vector machine classification. Pattern Recognition 44, 777â787 (2011).
Le Capitaine, H. & Frélicot, C. A fast fuzzy c-means algorithm for color image segmentation. In EUSFLATâ2011, 1074â1081 (2011).
Weinman, J. et al. Deep neural networks for text detection and recognition in historical maps. In 2019 International Conference on Document Analysis and Recognition (ICDAR), 902â909 (IEEE, 2019).
Petitpierre, R. Neural networks for semantic segmentation of historical city maps: Cross-cultural performance and the impact of figurative diversity. arXiv preprint arXiv:2101.12478 (2021).
Uhl, J. H., Leyk, S., Chiang, Y.-Y., Duan, W. & Knoblock, C. A. Automated extraction of human settlement patterns from historical topographic map series using weakly supervised convolutional neural networks. IEEE Access 8, 6978â6996 (2019).
Chiang, Y.-Y. et al. Training deep learning models for geographic feature recognition from historical maps. Using Historical Maps in Scientific Studies: Applications, Challenges, and Best Practices 65â98 (2020).
Garcia-Molsosa, A. et al. Potential of deep learning segmentation for the extraction of archaeological features from historical map series. Archaeological Prospection 28, 187â199 (2021).
Jiao, C., Heitzler, M. & Hurni, L. A fast and effective deep learning approach for road extraction from historical maps by automatically generating training data with symbol reconstruction. International Journal of Applied Earth Observation and Geoinformation 113, 102980 (2022).
Can, Y. S., Gerrits, P. J. & Kabadayi, M. E. Automatic detection of road types from the third military mapping survey of austria-hungary historical map series with deep convolutional neural networks. IEEE Access 9, 62847â62856 (2021).
Fetai, B., Grigillo, D. & Lisec, A. Revising cadastral data on land boundaries using deep learning in image-based mapping. ISPRS International Journal of Geo-Information 11, 298 (2022).
IgnjatiÄ, J., NikoliÄ, B. & RikaloviÄ, A. Deep learning for historical cadastral maps digitization: overview, challenges and potential (2018).
John Sands (Firm). Sandsâ six mile circuit map of the city & suburbs of Sydney 1876-77. Trove: National Library of Australia. Available online at: https://nla.gov.au/nla.obj-231444908/view/ Sydney, 1877.
John Sands (Firm). City of Sydney and the adjacent municipalities, 1903 (1903). Trove: National Library of Australia. Available online at: https://nla.gov.au/nla.obj-231540665/view Sydney, 1903.
John Sands (Firm). Map of the city of Sydney and suburbs, 1890. State Library of NSW. Available online at https://digital.sl.nsw.gov.au/delivery/DeliveryManagerServlet?embedded=true&toolbar=false&dps_pid=IE16246242&_ga=2.107384010.998467455.1630899986-1048446797.1588120418 (1890).
of Sydney Archives, C. City engineer and city surveyorâs department, riley estate - woolloomooloo, darlinghurst & surry hills [a-00880183]. Available online at: https://archives.cityofsydney.nsw.gov.au/nodes/view/1709110 (1844).
Gardiner, S. Smith & gardinerâs map of sydney and suburbs 1855. Available online at: http://nla.gov.au/nla.obj-230697988 (1855).
JJ Byrne & Co. Glebe municipality, 1888: Single sheet (01/01/1888 - 31/12/1888), [a-00880153]. Available online at: https://archives.cityofsydney.nsw.gov.au/nodes/view/1709080 (1855).
Wilson, A. Atlas of the suburbs of Sydney. Dictionary of Sydney. Available online at: http://dictionaryofsydney.org/entry/atlas_of_the_suburbs_of_sydney (2012).
Jacobsen, A., Drewes, N., Stjernholm, M. & Balstrom, T. Generation of a digital elevation model of mols berje, Denmark, and georeferencing of airborne scanner data. Danish Journal of Geography 35â45. Available online at https://www2.dmu.dk/1_viden/2_Publikationer/3_Ovrige/rapporter/Artikel5_anne_LAND.pdf (2012).
Cajthami, J. Old maps georeferencing - overview and a new method for map series. Conference: 26th International Cartographic Conference, Dresden 1â12 (2013).
Chrysovalantis, D. G. & Nikolaos, T. Building footprint extraction from historic maps utilising automatic vectorisation methods on open source GIS software. Automatic Vectorisation of Historical Maps Conference: International workshop organised by the ICA Commission on Cartographic Heritage into the Digital, 13 March, 2020, Budapest 9â17 (2020).
Gede, M. et al. Automatic vectorisation of old maps using QGIS - tools, possibilities and challenges. Automatic Vectorisation of Historical Maps Conference: International workshop organised by the ICA Commission on Cartographic Heritage into the Digital, 13 March, 2020, Budapest 37â44 (2020).
Turner, H., Lahoorpoor, B. & Levinson, D. Creating a Database for Historical Roads in Sydney from Scanned Maps. figshare https://doi.org/10.6084/m9.figshare.c.6071426.v1 (2023).
Turner, H., Lahoorpoor, B. & Levinson, D. Woolloomooloo 1844 historic map. figshare https://doi.org/10.6084/m9.figshare.22014515.v1 (2023).
Turner, H., Lahoorpoor, B. & Levinson, D. Sydney 1855 historic map. figshare https://doi.org/10.6084/m9.figshare.22014509.v1 (2023).
Turner, H., Lahoorpoor, B. & Levinson, D. Glebe 1888 historic map. figshare https://doi.org/10.6084/m9.figshare.22014524.v1 (2023).
Turner, H., Lahoorpoor, B. & Levinson, D. Concord 1894 historic map. figshare https://doi.org/10.6084/m9.figshare.22014539.v1 (2023).
Turner, H., Lahoorpoor, B. & Levinson, D. City and Suburbs of Sydney 1877 historic map. figshare https://doi.org/10.6084/m9.figshare.22014533.v1 (2023).
Turner, H., Lahoorpoor, B. & Levinson, D. City and Suburbs of Sydney 1890 historic map. figshare https://doi.org/10.6084/m9.figshare.22014518.v1 (2023).
Turner, H., Lahoorpoor, B. & Levinson, D. Marrickville 1886-1888 historic map. figshare https://doi.org/10.6084/m9.figshare.22014521.v1 (2023).
Turner, H., Lahoorpoor, B. & Levinson, D. City and Suburbs of Sydney 1903 historic map. figshare (2023). https://doi.org/10.6084/m9.figshare.22014536.v1 (2023).
Howe, N. R., Weinmann, J., Gouwar, J. & Shamji, A. Deformable part models for automatically georeferencing historical map images. Sigspastial 19: Proceedings of the 27th ACM Sigspatial International Conference on Advances in Geoographic Information Systems, Chicago, IL. Available online at: https://dl.acm.org/doi/pdf/10.1145/3347146.3359367, 540â543 (2019).
Shen, X., Liu, B. & Li, Q.-Q. Correcting bias in the rational polynomial coefficients of satellite imagery using thin-plate smoothing splines. ISPRS Journal of Photogrammetry and Remote Sensing 125, 125â131, https://doi.org/10.1016/j.isprsjprs.2017.01.007 (2017).
King, D. A. & Fischer, L. A. Streetcar projects as spatial planning: A shift in transport planning in the United States. Journal of Transport Geography 54, 383â390 (2016).
Levinson, D. Density and dispersion: the co-development of land use and rail in London. Journal of Economic Geography 8, 55â77 (2007).
Xie, F. & Levinson, D. How streetcars shaped suburbanization: a Granger causality analysis of land use and transit in the Twin Cities. Journal of Economic Geography 10, 453â470 (2009).
Lahoorpoor, B.Terraces, Towers, Trams, and Trains: Examining the Growth of Sydney using Empirical Models and Agent-based Simulation. Ph.D. thesis (2022).
Author information
Authors and Affiliations
Contributions
H.T. constructed the dataset. H.T. and B.L. initiated the project, analyzed data and wrote the paper. D.L. conceptualized the project and supervised the results. All authors reviewed the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisherâs note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the articleâs Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the articleâs Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Turner, H., Lahoorpoor, B. & Levinson, D.M. Creating a dataset of historic roads in Sydney from scanned maps. Sci Data 10, 683 (2023). https://doi.org/10.1038/s41597-023-02574-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41597-023-02574-5