ezwelty
bcf6d595b4
Add Swiss cantonal invasive plant maps
2025-05-13 15:29:01 +02:00
ezwelty
d5e8066d99
Add support for object code definitions
...
These get expanded into new fields.
2025-05-05 06:40:09 +02:00
ezwelty
0234726c85
Update readme and cli
2024-09-24 23:11:41 +02:00
ezwelty
38fd925f33
Refactor and simplify Source.process
...
* Drop allowEmptyGeometry option
* Lump invalidParsedCoordinates and emptyGeometry into invalidGeometries
* Move feature geometry construction to getFeatureGeometry
* Override layer SRS with source.props.srs
* Ensure output geometry is 2D
2024-09-24 23:11:41 +02:00
ezwelty
b310e4bc09
Map coded fields to their logical values
...
Implements the use of Source.props.codes.
2024-09-24 23:11:41 +02:00
ezwelty
3b53b4a26a
Remove Source.process option deleteFunc
2024-09-24 23:11:41 +02:00
ezwelty
a1fe5059c1
Convert array fields to string
2024-09-24 23:11:41 +02:00
ezwelty
788d6b2386
Work around GDAL requiring unique field names (ignoring case)
...
Field names are deduplicated as {field.name}__{index}.
2024-09-24 23:11:41 +02:00
ezwelty
ce38a52c03
Fix bug reading field containing WKT geometry
2024-09-24 23:11:41 +02:00
ezwelty
8dc59d8e52
Remove Source.getSrsString method
2024-09-24 23:11:41 +02:00
ezwelty
b3ecda96dd
Remove use of VRT in Source
2024-09-24 23:11:41 +02:00
ezwelty
602720fa3c
Update Source.process
...
* Change default SRS to EPSG:4326
* Improve handling of axis order
* Update GDAL link to gdal-async
* Remove use of VRT and load x and y coordinates from fields
2024-09-24 23:11:41 +02:00
ezwelty
e3729cebf2
Update getSrs methods to use getLayer
2024-09-24 23:11:41 +02:00
ezwelty
18b47ab7b1
Move type definitions to separate module
2024-09-24 23:11:41 +02:00
ezwelty
d571657b26
Remove unused import
2024-09-24 23:11:41 +02:00
ezwelty
e693f4001d
Refactor Source methods
...
* Add JSDoc typedefs
* Require initial (async) Source.open
* Remove async from Source.glimpse, etc sync
* Rename api to method
* Refactor Source.getData, getMetadata to findFiles(type), fetchFiles(type)
* ...
2024-09-24 23:11:41 +02:00
ezwelty
aadbce4d52
Make archive.search synchronous (and faster)
2024-09-24 23:11:41 +02:00
ezwelty
97c78f287f
Rename Source.download to Source.data
2024-09-24 23:11:41 +02:00
ezwelty
a6e2cfc6f7
Rename Source.info to Source.metadata
2024-09-24 23:11:41 +02:00
ezwelty
76a5e97f5f
Rename delFunc to deleteFunc
2024-09-24 23:11:41 +02:00
ezwelty
da529b0951
Propagate async from Source.open to other methods
2024-09-24 23:11:41 +02:00
ezwelty
3d576b5983
Add Source.addressFunc property for geocoding
2024-09-24 23:11:41 +02:00
ezwelty
cd90fd640e
Add support for datasets with multiple layers
2024-09-24 23:11:41 +02:00
ezwelty
491f55b8d3
Replace @return with standard @returns
2024-09-24 23:11:41 +02:00
ezwelty
80c3e24ffb
Fix bug in Source.open
2024-09-24 23:11:41 +02:00
ezwelty
b5fdd16593
Make downloading missing files optional
2024-09-24 23:11:41 +02:00
ezwelty
8421db78c6
Archive metadata URLs (info, license)
...
* Adds option to save page as png or pdf
* Adds {file: } notation for metadata URLs that are files
2024-09-24 23:11:41 +02:00
ezwelty
1a479bc5a1
Skip getData if no download URLs
2024-09-24 23:11:41 +02:00
ezwelty
b35c9a3ffe
Treat info urls as either web pages or files
2024-09-24 23:11:41 +02:00
ezwelty
da8d6ef66d
Update Source.getData to new props.download format
2024-09-24 23:11:41 +02:00
ezwelty
3a246e7b1b
Remove socrata, opendatasoft, and wfs methods
...
They are treated as regular download URLs.
2024-09-24 23:11:41 +02:00
ezwelty
e577576a58
Allow each url to have an api specification
...
For example [{arcgis: 'url'}, {manual: 'url'}]
2024-09-24 23:11:41 +02:00
ezwelty
0b6fec603d
Integrate archiver and new sources
...
* Move /archiver/*.js to /lib
* Move /archiver/archive and archive.jsonl to root directory
* Add new sources in single /sources.js
* Partly update Source class to use archiver
* Replace Source.props.execute with more flexible Source.props.openFunc
2024-09-24 23:11:41 +02:00
ezwelty
bb4ef4e382
Remove unused imports
2024-09-24 23:11:41 +02:00
ezwelty
64a9b19f44
Remove paged WFS download
...
This was found to be too unreliable and not actually needed.
All WFS sources so far can be downloaded in a single request.
2024-09-24 23:11:41 +02:00
ezwelty
90df8b1863
Remove trailing whitespace
2024-09-24 23:11:41 +02:00
ezwelty
31b896e028
Improve reading of ArcGIS feature layers
...
* Query native JSON format (GeoJSON not always supported)
* Improve selection of object id field for ordering
* Do not clean strings
* Return features only
2024-09-24 23:11:41 +02:00
Kajoyrie P
1f21bd258f
integrating wfs downloader and archiving downloads
2024-09-24 23:11:41 +02:00
Michael Regan
f310201e6b
Changed gdal-next to gdal-async
2024-09-24 23:11:41 +02:00
ezwelty
4fda97c093
Add support for ArcGIS Feature Server layers
2022-08-23 10:36:26 +02:00
ezwelty
995e42c2d7
Remove trailing whitespace
2022-08-23 10:36:26 +02:00
ezwelty
9a76827150
Add modules to API docs, using @private to hide some
2021-05-27 15:52:45 +02:00
ezwelty
bd24a1445a
Replace feature warnings with total counts
2021-05-27 15:51:18 +02:00
ezwelty
8b9e30ce9a
Fix bug in Source.process()
2020-07-23 11:16:11 -06:00
ezwelty
6ec9249c40
Add method to retrieve feature fields as objects
2020-07-14 18:36:19 -06:00
ezwelty
97782fda41
Add option to sample field values with duplication
2020-07-11 16:47:19 -06:00
ezwelty
e3de115a52
Move downloadFile to helper function
2020-07-11 13:00:24 -06:00
ezwelty
85d2fa6f13
Allow sources with empty geometries
2020-05-22 20:03:42 -06:00
ezwelty
f73b5bd5e7
Specify source filename as glob pattern
2020-05-22 20:03:21 -06:00
ezwelty
fb0cf03e4b
Add basic data cleaning module
...
- Add basic cleaning to all string fields in modified crosswalk
- Add option to delete features based on field values after crosswalk
2020-05-22 16:15:57 -06:00
