I wish AI leaders would fund more data archival projects, instead of hoarding it themselves. They could build a lot of goodwill, but the current state of the art is destroying old books and denying anyone access to them.
These archival projects have an enormous impact, though they are chronically underfunded. I wish there were a strong economic incentive to support them.
Anthropic just learned to the tune of a 1.5 billion dollar settlement that making available for human consumption, even internally, instead of hoarding for AI training exclusively is a fraught exercise.
Two events: Anthropic did end up paying a $1.5B settlement for a case involving the use of pirated books. See Bartz v. Anthropic.
Second, apparently archiving content and providing it to others is risky business. It is often ruled as piracy, see Hachette v. Internet Archive. It went badly for Internet Archive, against common sense.
I was very excited to see this project. I went to the site and requested processing of the maps for my small town. It also inspired me to make a donation to OSM.
I should have mentioned this earlier, but folks can make direct tax-deductible donations to OldInsuranceMaps.net, which is now affiliated with OSM US's 501(c)(3) status.
Awesome project! Would definitely love to see more overlap with Allmaps. It’s pretty trivial to utilize centralized gcps for both server and client applications and maintain single sources of truth. I’ve been meaning to dive a bit deeper on an old project anyway, good excuse.
This is something we need to add to the FAQ. There is some cross-compatibility already, in that OIM has endpoints to spit out Allmaps-compatible annotations from the database, e.g. https://oldinsurancemaps.net/iiif/resource/88127/. You can paste that right into Allmaps, which will in turn pull tiles from the Library of Congress IIIF server and warp them based on the annotation information. That's just the beginning though, more to come...
If you like OldInsuranceMaps, check out another OSM charter project, Yesterdays! Originally created by a team in Richmond, Virginia [0], with one more deployment covering the Inland Empire [1]. They plan to merge soon. Yesterdays imports Sanborn maps to help place historical photos as accurately as possible.
Seems like a very interesting challenge for automation of raster to vector scanning/software, and QC/checking that the raster-to-vector pipeline hasn't hallucinated something or joined two shapes together that should be discrete objects.
I would presume they're starting with very high res lossless raster scans and storing those in some sort of index, then making them available for different pipelines of processing?
That's basically what's going on, but it's all a manual process so far. The goal is scoped really just to the actual georeferencing and mosaic creation, no post-processing or OCR is performed on the maps within this platform (people are certainly downloading the final rasters and doing that with them though).
Absolutely, this would be incredibly cool, and if they can do it with burnt ancient scrolls it should be a cakewalk with these... Even just shining very strong light behind the pages you can see all the old layers. However, most of the LoC collection is original copyright deposits, so much of what's on OIM doesn't have pasted-on slips.
On visiting the actual oldinsurancemaps.net, I was met with:
"OldInsuranceMaps.net is a Charter Project of OpenStreetMap US that provides an open, online workflow for creating georeferenced layers of historical maps, with a special focus on making seamless mosaics from multi-page atlases in the Sanborn map collection at the Library of Congress."
Sanborn was an insurance adjacent company that made detailed paper maps of many towns in the US in the late 1800s and early 1900s.
This project is scanning those maps and adding the information that modern mapping software needs to show them alongside other geographic information. Where the old paper maps overlap, they work to cleanly stitch them together rather than showing the edges of the paper.
Later: The project is sort of for people looking for the old maps, so I can see why the introduction doesn't spend a life of time explaining them.
They are building computer programs that other people can use to then post online maps from old paper sources. For example, from the Sanborn map collection.
Those maps can be browsed as "overlays" on top of other maps, so you can easily compare how several maps show the same places on Earth.
These archival projects have an enormous impact, though they are chronically underfunded. I wish there were a strong economic incentive to support them.
Second, apparently archiving content and providing it to others is risky business. It is often ruled as piracy, see Hachette v. Internet Archive. It went badly for Internet Archive, against common sense.
Also here's a past HN thread with some more context: https://news.ycombinator.com/item?id=46788588
I should have mentioned this earlier, but folks can make direct tax-deductible donations to OldInsuranceMaps.net, which is now affiliated with OSM US's 501(c)(3) status.
https://openstreetmap.app.neoncrm.com/forms/donate-oim
0: https://yesterdays.maprva.org/
1: https://yesterdays.inlandempire.place/
I would presume they're starting with very high res lossless raster scans and storing those in some sort of index, then making them available for different pipelines of processing?
https://cartes.gouv.fr/explorer-les-cartes/
you can add and remove layers by clicking on the map icon on the top right.
"OldInsuranceMaps.net is a Charter Project of OpenStreetMap US that provides an open, online workflow for creating georeferenced layers of historical maps, with a special focus on making seamless mosaics from multi-page atlases in the Sanborn map collection at the Library of Congress."
What the hell does that mean? Anyone to ELI5?
This project is scanning those maps and adding the information that modern mapping software needs to show them alongside other geographic information. Where the old paper maps overlap, they work to cleanly stitch them together rather than showing the edges of the paper.
Later: The project is sort of for people looking for the old maps, so I can see why the introduction doesn't spend a life of time explaining them.
They are building computer programs that other people can use to then post online maps from old paper sources. For example, from the Sanborn map collection.
Those maps can be browsed as "overlays" on top of other maps, so you can easily compare how several maps show the same places on Earth.