EODAG - v3.3.2

What's Changed

Bug Fixes

• providers: creodias and cop_dataspace products title mapping by @sbrunato in https://github.com/CS-SI/eodag/pull/1635

Refactoring

• core: authentication for get_quicklook by @cauriol in https://github.com/CS-SI/eodag/pull/1608

Continuous Integration

• update changelog generation by @sbrunato in https://github.com/CS-SI/eodag/pull/1627
• fixed changelog generation by @sbrunato in https://github.com/CS-SI/eodag/pull/1630
• token usage for coverage report publishing by @sbrunato in https://github.com/CS-SI/eodag/pull/1633

Full Changelog: https://github.com/CS-SI/eodag/compare/v3.3.1...v3.3.2

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato 7 days ago

EODAG - v3.3.1

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato 13 days ago

EODAG - v3.3.0

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato 20 days ago

EODAG - v3.2.0

⚡ Core features and fixes

• Fixes download of assets having keys with special characters (#1585)

📄 Providers and product types updates

• geodes API update (#1581)
• Sanitize eumetsat_ds products title (#1582)
• Updated default values for some ECMWF collections (#1575)

⚙️ Plugins new features and fixes

• Do not guess assets keys from their URL when inappropriate (#1584)

🗃️ Miscellaneous

• Various minor fixes and improvements (#1570)(#1571)
• External product types reference updates (#1567)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato 30 days ago

EODAG - v3.1.0

📢 Major changes since last stable (v3.0.1)

Core features and fixes

• [v3.1.0b2] Assets keys uniformization using drivers (#1488)
• [v3.1.0b1] Updated queryables mechanism and ecmwf-like plugins (#1397)(#1427)(#1462)
• [v3.1.0] Customizable providers configuration file through EODAG_PRODUCT_TYPES_CFG_FILE environment variable (#1559)
• [v3.1.0b1] Order and download polling times update (#1440)

Providers and product types updates

• [v3.1.0] Removed onda provider (#1564)
• [v3.1.0b2] default search timeout to 20s (#1505)

Plugins new features and fixes

• [v3.1.0] ECMWFSearch: simplified configuration (#1433), fixed queryables issues (#1509), mapped geometry metadata (#1555)
• [v3.1.0b1] Removed default HTTPDownload zip extension (#1400)
• [v3.1.0b1] Order and poll without downloading (#1437)

Remaining changes since v3.1.0b2

Core features and fixes

• Keep queryables required attribute even with default values (#1521)

Providers and product types updates

• geodes: recognize auth errors during download (#1562), typo in geodes_s3 user conf template (#1536)
• wekeo_main metadata mapping update (#1549) and COP-DEM product types update (#1516)
• eumetsat_ds: new MTG product types (#1513), metadata mapping fix (#1502), remove duplicate product types (#1514)
• Add product types to dedl provider (#1515)

Plugins new features and fixes

• AwsDownload: zip partial download (#1561), InvalidRequest handle (#1532)
• Already authenticated user fix on openid authentication plugins (#1524)
• Fixes missing file error on usgs authentication during attempts (#1550)

Miscellaneous

• [build] remove dependencies max versions (#1519)
• [docs] eodag-cube Python API documentation (#1511), usgs registration update (#1551)
• Various minor fixes and improvements (#1502)(#1540)(#1541)(#1547)(#1552) (#1566)(#1568)
• External product types reference updates (#1510)(#1525)(#1539)(#1548)(#1553) (#1557)(#1565)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato about 1 month ago

EODAG - v3.1.0b2

⚡ Core features and fixes

• Assets keys uniformization using drivers (#1488)
• ssl_verify setting for get_quicklook() (#1490, thanks @tromain)
• Queryables merged by provider priority (#1431)

📄 Providers and product types updates

• geodes_s3 as new provider (#1506)
• default search timeout to 20s (#1505)
• geodes relativeOrbitNumber property (#1499) and numerical queryables fix (#1507)

🗃️ Miscellaneous

• [docs] Updated tutorials using eodag-cube (#1436) and minor fixes (#1498)(#1500)
• [style] Typing update for generics (#1486)
• Various minor fixes and improvements (#1471)(#1472)(#1473)(#1475)(#1477) (#1479)(#1480)(#1483)(#1492)(#1503)(#1504)
• External product types reference updates (#1460)(#1478)(#1484)(#1487)(#1493) (#1494)

New Contributors

• @tromain made their first contribution in https://github.com/CS-SI/eodag/pull/1490

Full Changelog: https://github.com/CS-SI/eodag/compare/v3.1.0b1...v3.1.0b2

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato 3 months ago

EODAG - v3.1.0b1

⚡ Core features and fixes

• Updated queryables mechanism and ecmwf-like plugins (#1397)(#1427)(#1462)
• Order and download polling times update (#1440)
• Do not retry downloading skipped products during download_all (#1465)
• Renamed record files that were using previous mechanism (#1396, thanks @gasparakos)
• New to_lower() and to_upper() parameters mapping methods (#1410, thanks @jgaucher-cs)

📄 Providers and product types updates

• geodes updated id (#1441) and tileIdentifier parameters (#1457), and metadata mapping fix (#1468)
• New MTG product types for eumetsat_ds (#1455)
• FIRE_HISTORICAL on wekeo_ecmwf (#1392)
• Various product types metadata-mapping and default values updates: for cop_ads and wekeo_ecmwf (#1389), GLOFAS and EFAS product types (#1467), EEA_DAILY_VI on wekeo_main (#1464)

⚙️ Plugins new features and fixes

• Removed default HTTPDownload zip extension (#1400)
• Order and poll without downloading (#1437)
• TokenAuth distinct headers for token retrieve and authentication (#1451, thanks @jgaucher-cs)
• Compare only offset-aware datetimes on openid authentication plugins (#1418)
• Fixed creodias_s3 search and download when no asset is available (#1425)

🌍 Server mode

• Dedicated liveness endpoint added (#1353)
• Processing level parsing fix in external STAC collections (#1429)

🗃️ Miscellaneous

• [docs] Queryables documentation in a dedicated section (#1447)
• Various minor fixes and improvements (#1390)(#1403)(#1411)(#1415)(#1419) (#1428)(#1430)(#1434)(#1445)(#1448)(#1458)(#1466)
• External product types reference updates (#1387)(#1391)(#1401)(#1404)(#1406) (#1408)(#1416)(#1424)(#1453)(#1459)

New Contributors

• @gasparakos made their first contribution in https://github.com/CS-SI/eodag/pull/1396
• @jgaucher-cs made their first contribution in https://github.com/CS-SI/eodag/pull/1410

Full Changelog: https://github.com/CS-SI/eodag/compare/v3.0.1...v3.1.0b1

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato 4 months ago

EODAG - v3.0.1

📄 Providers and product types updates

• geodes as new provider (#1357)(#1363)
• cop_ewds as new provider (#1331)
• Removed astraea_eod provider (#1383)
• Fixed S2_MSI_L1C search-by-id for earth_search (#1053)
• MSG product types added (#1348)
• Fixed order for some dedl product-types (#1358)

⚙️ Plugins new features and fixes

• Authenticate only when needed in HTTPDownload (#1370)
• Various fixes for cop_marine (#1336)(#1364)
• OpenID token expiration fix and oidc_config_url usage (#1346)
• Concurrent requests for wekeo_cmems product-types fetch (#1374)
• Error is raised when HTTPDownload order fails (#1338)

🗃️ Miscellaneous

• [build] Add python3.13 and drop python3.8 support (#1344)
• [docs] Plugins and utils documention update (#1297)
• [docs] conda optional dependencies handling (#1343)
• [docs] Fixed auxdata reference in tutorials (#1372, thanks @emmanuel-ferdman)
• [ci] Tests speedup using uv and tox-uv (#1347)
• [ci] wekeo product types included in external product types reference (#1377)
• Various minor fixes and improvements (#1298)(#1335)(#1340)(#1341)(#1351) (#1367)(#1365)(#1368)(#1379)
• External product types reference updates (#1342)(#1356)(#1359)(#1360)(#1362) (#1366)(#1369)(#1373)(#1375)(#1378)(#1381)(#1384)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato 6 months ago

EODAG - v3.0.0

⚠️ Breaking changes since last stable (v2.12.1)

• [v3.0.0b1] search() method now returns only a SearchResult instead of a 2 values tuple (#1200). It can optionally store the estimated total number of products in SearchResult.number_matched if the method is called with count=True (False by default).
• [v3.0.0b1] Packaging refactoring and new optional dependencies (#1108) (#1219). EODAG default installs with a minimal set of dependencies. New sets of extra requirements are: eodag[all], eodag[all-providers], eodag[ecmwf], eodag[usgs], eodag[csw], eodag[server]. Previous existing sets of extra requirements are also kept: eodag[notebook], eodag[tutorials], eodag[dev], eodag[docs].
• [v3.0.0b3] download() / DownloadConf parameters outputs_prefix and outputs_extension renamed to output_dir and output_extension (#1279)

📢 Major changes since last stable (v2.12.1)

Core features and fixes

• [v3.0.0] Sharable and multiple authentication plugins per provider (#1292)(#1329)(#1332)
• [v3.0.0b3] New add_provider() method (#1260)
• [v3.0.0b2] New SearchResult HTML representation for notebooks (#1243)
• [v3.0.0b1] Search results sort feature (#943)
• [v3.0.0b1] Providers groups (#1071)
• [v3.0.0b1] Configurable download timeout (#1124)

Providers and product types updates

• [v3.0.0] Updated cop_ads and cop_cds to new cds api (#1284)
• [v3.0.0] wekeo split into wekeo_main and wekeo_ecmwf providers (#1214)
• [v3.0.0b1] dedl as new provider (#750)
• [v3.0.0b1] dedt_lumi as new provider (#1119) (#1126), with authentication using destine credentials (#1127)
• [v3.0.0b1] cop_marine as new provider (#1131)(#1224)
• [v3.0.0b1] eumetsat_ds as new provider (#1060), including METOP product types (#1143)(#1189)
• [v3.0.0b1] OData API usage for creodias & cop_dataspace (#1149)

Plugins new features and fixes

• [v3.0.0b1] Standardized download output tree (#746)
• [v3.0.0b1] flatten_top_dirs download plugins option set to true by default (#1220)
• [v3.0.0b1] base_uri download plugins setting is not systematically mandatory any more (#1230)
• [v3.0.0b1] Allow no auth for HTTPDownload download requests (#1196)

Server mode

• [v3.0.0b1] Server-mode rework and cql2 support (#966)
• [v3.0.0b1] Offline products order handling (#918)
• [v3.0.0] Browsable catalogs removed (#1306)

Miscellaneous

• [v3.0.0b1 to v3.0.0][style] type hints fixes and mypy in tox (#1052)(#1253)(#1269) (#1326)
• [v3.0.0][docs] Developer documentation update (#1327)

---

Remaining changes since v3.0.0b3

Core features and fixes

• Improve search and authentication errors format (#1237)

Providers and product types updates

• Handle cop_marine in-situ historical data (#1301)
• Fixes for wekeo: GRIDDED_GLACIERS_MASS_CHANGE order link (#1258), yaml issue in provider config (#1315)
• Fixes for wekeo_ecmwf: hydrological_year usage (#1313), fixed default dates (#1288)

Plugins new features and fixes

• Raise an error if no data available on AwsDownload (#1257)

Server mode

• Fixed queryables issues and parameters prefixes (#1318)
• Send search_stac_items() in its own threadpool (#1323)
• Fixed STAC collections metadata (#1278)
• Updated logs format (#1238)

Miscellaneous

• [ci] mypy in linting github action (#1326), actions updates (#1310)(#1314)
• Various minor fixes and improvements (#1256)(#1263)(#1276)(#1289)(#1294) (#1295)(#1296)(#1300)(#1303)(#1304)(#1308)(#1333)
• External product types reference updates (#1290)(#1316)(#1322)(#1334)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato 7 months ago

EODAG - v3.0.0b3

⚠️ Breaking changes

• download() / DownloadConf parameters outputs_prefix and outputs_extension renamed to output_dir and output_extension (#1279)

⚡ Core features and fixes

• New add_provider() method (#1260)
• Handle integers as locations shapefile attributes (#1280)
• Renames some parameters and methods to snake_case (#1271)
• Sorted discovered product types (#1250)

📄 Providers and product types updates

• Fixes usgs search by id (#1262)
• Adds S1_SAR_GRD_COG and new odata query parameters for cop_dataspace (#1277, thanks @ninsbl)
• Adds GRIDDED_GLACIERS_MASS_CHANGE on provider cop_cds (#1255)
• Removes cacheable parameter for wekeo order requests (#1239)

⚙️ Plugins new features and fixes

• aws_session_token support in AwsAuth (#1267)
• HTTPDownload asset HEAD check and ssl_verify (#1266)
• Product types discovery disabled by default on StaticStacSearch (#1259)

🗃️ Miscellaneous

• [style] type hints fixes and mypy in tox (#1253)(#1269)
• [docs] v3 breaking changes (#1281), download() kwargs (#1282), autosummary fixes (#1264) and changelog update (#1254)
• [ci] Github actions updates (#1249)
• [test] Fixed end-to-end tests (#1236)
• External product types reference updates (#1244)(#1246)(#1251)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato 9 months ago

EODAG - v3.0.0b2

⚡ Core features and fixes

• New SearchResult HTML representation for notebooks (#1243)
  

⚙️ Plugins new features and fixes

• Fixed missing products configuration in Api plugin download (#1241)
• Fixed pagination configuration to be not allways mandatory (#1240)

🗃️ Miscellaneous

• [docs] Custom mock search plugin example (#1242)
• External product types reference updates (#1234)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato 10 months ago

EODAG - v3.0.0b1

⚠️ Breaking changes

• search() method now returns only a SearchResult instead of a 2 values tuple (#1200). It can optionally store the estimated total number of products in SearchResult.number_matched if the method is called with count=True (False by default).
• Packaging refactoring and new optional dependencies (#1108) (#1219). EODAG default installs with a minimal set of dependencies. New sets of extra requirements are: eodag[all], eodag[all-providers], eodag[ecmwf], eodag[usgs], eodag[csw], eodag[server]. Previous existing sets of extra requirements are also kept: eodag[notebook], eodag[tutorials], eodag[dev], eodag[docs].

⚡ Core features and fixes

• Search results sort feature (#943)
• Providers groups (#1071)
• Configurable download timeout (#1124)
• Search by id now uses search_all() and crunch (#1099).
• Free text search available for all fields when guessing a produc type (#1070), mission dates filtering support (#1222)
• Configurable requests ssl_verify (#1045)
• Download record hash independent from provider (#1023)
• Fixed and refactored queryables (#1050)(#1097)(#1102)(#1157), authentication fix (#1194), support for local constraints files (#1105)
• Fixed metadata mapping in templates detection (#1139), format_query_params() fixes (#1145) and refactor (#1142). Configurable assets filtering (#1033).

📄 Providers and product types updates

• dedl as new provider (#750)
• dedt_lumi as new provider (#1119) (#1126), with authentication using destine credentials (#1127)
• cop_marine as new provider (#1131)(#1224)
• eumetsat_ds as new provider (#1060), including METOP product types (#1143)(#1189)
• OData API usage for creodias & cop_dataspace (#1149), fixes for empty geometries (#1186), search datetime intervals (#1158), and removed discover_product_types (#1112)
• cop_ads and cop_cds now use BuildSearchResult and HTTPDownload instead of move CdsApi (#1029), EFAS dates formatting (#1178), area metadata mapping fix (#1225)
• wekeo now uses hda-broker 2.0 API (#1034), lists queryables (#1104), has fixed pagination (#1098) and CLMS search by id (#1100)
• Adjusted timeouts (#1163)
• Opened time intervals supported for STAC providers (#1144)
• New product types (#1164)(#1227), providers and product types configuration update (#1212)

⚙️ Plugins new features and fixes

• Standardized download output tree (#746)
• Refactored search plugins methods to use PreparedSearch and RawSearchResult new classes (#1191)
• Refresh token for OIDCAuthorizationCodeFlowAuth plugin (#1138), tests (#1135), and fix (#1232)
• HTTPHeaderAuth accepts headers definition in credentials (#1215)
• flatten_top_dirs download plugins option set to true by default (#1220)
• base_uri download plugins setting is not systematically mandatory any more (#1230)
• Re-login in UsgsApi plugin on api file error (#1046)
• Allow no auth for HTTPDownload download requests (#1196)
• Refactorization of Api base plugin that now inherits from Search and Download (#1051)
• orderLink support in build_search_result.* plugins (#1082), and parsing fix (#1091)
• Fixed resume interrupted assets download using HTTPDownload (#1017)

🌍 Server mode

• Server-mode rework and cql2 support (#966)
• Offline products order handling (#918)
• External enhanced product types metadata (#1008)(#1171)(#1176)(#1180)(#1197)
• Collections search using updated guess_product_type() (#909)
• Providers groups (#1192), and fixes for listing (#1187) and items self links (#1090)
• HEAD requests enabled (#1120)
• LRU caching (#1073)
• Additional item properties (#1170)
• order and storage extensions usage (#1117)
• bbox in queryables (#1185), fixed some types missing (#1083)
• Blacklist configution for assets alternate URLs (#1213)
• id vs title in item metadata fix (#1193)
• Error handling fixes (#1078)(#1103)(#1182)
• Other server-mode fixes (#1065)(#1087)(#1094)(#1095)(#1096)(#1106) (#1113)(#1115)(#1156)(#1174)(#1210)(#1221)(#1223)

🗃️ Miscellaneous

• [build] Updated requirements for uvicorn (#1152), shapely (#1155), orjson (#1150) (#1079)
• [build] Remove requests-ftp (#1085)
• [style] type hints related fixes and refactoring (#1052)
• [docs] sphinx theme updated and removed jquery (#1054), newlines between badges fixes (#1109), and other documentation fixes and updates (#1057)(#1059)(#1062)(#1063)(#1081)(#1121) (#1122)
• [ci] Fetch product types Github action updates (#1202)(#1205)
• Various minor fixes and improvements (#1072)(#1077)(#1101)(#1111)(#1118) (#1132)(#1141)(#1190)
• External product types reference updates (#1027)(#1028)(#1086)(#1093)(#1107)(#1110)(#1114) (#1136)(#1137)(#1140)(#1146)(#1151)(#1153)(#1160)(#1165) (#1203)(#1204)(#1206)(#1207)(#1208)(#1229)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato 10 months ago

EODAG - v2.12.1

• CdsApi queryables fix (#1048)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato about 1 year ago

EODAG - v2.12.0

• Individual product asset download methods (#932)
• New environment variable EODAG_CFG_DIR available for custom configuration directory (#927)
• New list_queryables method, available through python API and server mode, and using product-types constraints if available (#911) (#917)(#974)(#977)(#978)(#981)(#1005)
• Removes limited RPC server (#1011)
• Product types aliases (#905)
• New provider creodias_s3 (#986)(#1002)
• earth_search endpoint updated from v0 to v1 (#754)
• wekeo endpoint updated to wekeo2 wekeo-broker API (#1010)
• New product types added for cop_ads and cop_cds (#898)
• Adds missing tileIdentifier and quicklook for creodias, creodias_s3 and cop_dataspace (#957) (#1014)
• HTTP download with CdsApi (#946)
• Download streaming available for AwsDownload plugin (#997)
• Lists STAC alternate assets in server mode (#961)
• _dc_qs used in server-mode to store CdsApi search criteria (#958)(#1000)
• New eodag exception TimeOutError (#982)
• Cast loaded environment variables type using config type-hints (#987)
• Type hints fixes (#880)(#983)
• Requirements updates (#1020)(#1021)
• Various server mode fixes (#891)(#895)(#947)(#992)(#1001)
• Various minor fixes and improvements (#934)(#935)(#936)(#962)(#969)(#976) (#980)(#988)(#991)(#996)(#1003)(#1009)(#1013)(#1016) (#1019)(#1022)(#1024)(#1025)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato about 1 year ago

EODAG - v2.11.0

New since v2.11.0b1:

• Fallback mechanism for search (#753)(#807)
• creodias and cop_dataspace configuration update (from OData to OpenSearch) (#866)(#883)(#894)(#915)(#929)
• Removes mundi provider (#890)
• Copernicus DEM product types available through creodias (#882)
• wekeo driver update and new product types (#798)(#840)(#856)(#902)
• Allows provider search parameter to directly search on it (#790)
• Refresh token usage in KeycloakOIDCPasswordAuth (creodias and cop_dataspace) (#921)
• Per-provider search timeout (#841)
• New EODAG_PROVIDERS_CFG_FILE environment variable for custom provider configuration setting (#836)
• Many server-mode updates and fixes: queryables endpoints (#795), built-in Swagger doc update (#846), exceptions handling (#794)(#806)(#812)(#829), provider setting (#808) and returned information (#884)(#879), multithreaded requests (#843), opened time intervals fixes (#837), search-by-ids fix (#822), intersects parameter fixes (#796)(#797)
• Adds support for Python 3.12 (#892) and removes support for Python 3.7 (#903)
• Fixes plugin manager rebuild (solves preferred provider issues) (#919)
• Reformatted logs (#842)(#885)
• Adds static type information (#863)
• Various minor fixes and improvements (#759)(#788)(#791)(#793)(#802)(#804)(#805)(#813)(#818)(#819)(#821)(#824)(#825)(#828)(#830)(#832)(#835)(#838)(#844)(#867)(#868)(#872)(#877)(#878)(#881)(#893)(#899)(#913)(#920)(#925)(#926)

New since v2.10.0:

• hydroweb_next (hydroweb.next), thematic hub for hydrology data access, as new provider (#711)
• Search by tile standardized using tileIdentifier new query parameter and metadata (#713)
• Server mode STAC API version updated to 1.0.0-rc.3 (#697)
• Better catalogs title and description in server mode (#710)
• Server mode advanced tests (#708), and fixes for catalogs dates filtering (#706), catalogs cloud-cover filtering (#705), missing sensorType error for discovered product types (#699), broken links through STAC search endpoint (#698)
• Added links to eodag-server image on Dockerhub (#715)
• EODAG server installation update in docker image (#700) and sigterm fix (#702)
• STAC browser docker image update (#704)
• Various minor fixes and improvements (#693)(#694)(#695)(#696)(#703)(#707)(#712)(#714)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato over 1 year ago

EODAG - v2.11.0b1

• wekeo as new provider (#772)
• Server-mode Flask to FastAPI (#701)
• Server-mode download streaming (#742)
• Updated creodias authentication mechanism to Creodias-new (#763)
• Helm Chart (#739)
• Server-mode search by (multiples) id(s) (#776)
• Fixed server-mode parallel requests (#741)
• Keep origin assets in the stac server response (#681)
• Enable single-link download for STAC providers (#757)
• Fixes missing provider in STAC download link (#774)
• Better documentation for guess_product_type() (#756)
• Fixed issue with docker image user directory (#764)
• Various minor fixes and improvements (#720)(#717)(#722)(#723)(#724)(#727) (#729)(#731)(#737)(#738)(#743)(#744)(#745)(#749)(#751) (#762)(#771)(#775)(#777)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato almost 2 years ago

EODAG - v2.10.0

• hydroweb_next (hydroweb.next), thematic hub for hydrology data access, as new provider (#711)
• Search by tile standardized using tileIdentifier new query parameter and metadata (#713)
• Server mode STAC API version updated to 1.0.0-rc.3 (#697)
• Better catalogs title and description in server mode (#710)
• Server mode advanced tests (#708), and fixes for catalogs dates filtering (#706), catalogs cloud-cover filtering (#705), missing sensorType error for discovered product types (#699), broken links through STAC search endpoint (#698)
• Added links to eodag-server image on Dockerhub (#715)
• EODAG server installation update in docker image (#700) and sigterm fix (#702)
• STAC browser docker image update (#704)
• Various minor fixes and improvements (#693)(#694)(#695)(#696)(#703)(#707)(#712)(#714)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato about 2 years ago

EODAG - v2.9.2

• planetary_computer, Microsoft Planetary Computer as new provider (#659)
• Fetch product types optimization (#683)
• Fixes external product types update for unknown provider (#682)
• Default dates and refactor for CdsApi and EcmwfApi (#672)(#678)(#679)
• peps storageStatus update (#677)
• Customized and faster deepcopy (#664)
• Various minor fixes and improvements (#665)(#666)(#667)(#668)(#669)(#670) (#675)(#688)(#690)(#691)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato about 2 years ago

EODAG - v2.9.1

• cop_dataspace, Copernicus Data Space as new provider (#658)
• EODAG specific User-Agent appended to requests headers (#656)
• Sentinel-5P and other product types updates for creodias, mundi and onda (#657)
• mundi GeoRSS geometries handling (#654)
• Handle missing geometries through new defaultGeometry EOProduct property (#653)
• Fixes search errors handling (#660)
• Various minor fixes and improvements (#649)(#652)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato about 2 years ago

EODAG - v2.9.0

• Optimizes search time mixing count and search requests when possible (#632)
• Optimizes search time with rewritten JSONPath.parse usage now based on a common_metadata_mapping_path (#626)
• creodias API update, from resto to OData (#623)(#639)
• Optimizes and updates onda search (#616)(#636)
• Fixes OFFLINE products order mechanism for mundi provider (#645)
• Download progress bar adjustable refresh time (#643)
• Simplify OData metadata mapping using pre-mapping (#622)
• Fixes download error for single-asset products on STAC providers (#634)
• Tests execution optimized (#631)
• Various minor fixes and improvements (#612)(#619)(#620)(#621)(#624)(#625) (#629)(#630)(#635)(#638)(#640)(#641)(#642)(#644)(#646) (#647)

---

Search time optimization: v2.8.0 vs v2.9.0 vs raw request without eodag

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato about 2 years ago

EODAG - v2.8.0

• meteoblue as new forecast provider, in the context of DOMINO-X (#604)
• SARA (Sentinel Australasia Regional Access) as new provider (#578, thanks @catchSheep)(#602)
• Removes unavailable sobloo provider (#607)
• Landsat collection-1 data no more available on usgs (#601)
• Product types catalog more visible in documentation (#603)
• Metadata mapping to_geo_interface() renammed to to_geojson() (d7565a4)
• Added support for python3.11 (#552)
• Improved http asset size discovery in HTTPDownload (#566)
• Various minor fixes and improvements (#572)(#574)(#576)(#579)(#580)(#582) (#586)(#588)(#589)(#590)(#592)(#593)(#595)(#597)(#598) (#599)(#609)(#610)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato over 2 years ago

EODAG - v2.7.0

• Fetch external product types before searching for an unkown product type (#559)
• Handle local assets in HTTPDownload plugin (#561)
• Fetch external product types only for given provider if one is specified (#557)
• Fixed request error handling during search_all() (#554)
• Various minor fixes and improvements (#555)(#558)(#562)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato over 2 years ago

EODAG - v2.6.2

• Added new methods to get assets filename from header (#542)
• All local files URI formats are now supported (#545)
• More tests (#539)(#549)
• Various minor fixes and improvements (#535)(#540)(#541)(#543)(#544)(#553)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato over 2 years ago

EODAG - v2.6.1

• Swagger UI now needs to be manually run when using python API (#529)
• Removed cloudCover restriction in product types discovery (#530)
• Some sensorType values changed in product types settings to align to OpenSearch extension for Earth Observation (#528)
• Fixed CSS glitch in online documentation parameters tables (#527)
• Fixed S3 bucket extraction (#524)
• Various minor fixes and improvements (#522)(#523)(#525)(#526)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato over 2 years ago

EODAG - v2.6.0

• New product types automatic discovery (#480)(#467)(#470)(#471)(#472)(#473)(#481)(#486)(#493) (#491)(#500)
• New providers cop_ads and cop_cds for Copernicus Atmosphere and Climate Data Stores using CdsApi plugin, developed in the context of DOMINO-X (#504)(#513)
• UsgsApi plugin fixed and updated (#489)(#508)
• Cache usage for jsonpath.parse() (#502)
• Refactored download retry mechanism and more tests (#506)
• Drop support of Python 3.6 (#505)
• Various minor fixes and improvements (#469)(#483)(#484)(#485)(#490)(#492) (#494)(#495)(#496)(#497)(#510)(#511)(#514)(#517)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato over 2 years ago

EODAG - v2.5.2

• Fixes missing productPath property for some earth_search products (#480)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato almost 3 years ago

EODAG - v2.5.1

• Fixed broken AwsDownload configuration for STAC providers (#475)
• Set setuptools_scm max version for python3.6 (#477)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato almost 3 years ago

EODAG - v2.5.0

• ecmwf as new provider with new API plugin EcmwfApi and tutorial (#452)
• earth_search_gcs as new provider to download on Google Cloud Storage public datasets (#462, thanks @robert-werner)
• STAC search on private servers needing authentication for earch (#443)
• Do not list providers without credentials needing authentication for search (#442)
• New packaging using pyproject.toml and setup.cfg, following PEP 517 recommendations and setuptools build_meta (#435)
• setuptools_scm usage to have intermediate dev versions between releases (#431)
• New options for AwsDownload plugin: requester_pays, base_uri, and ignore_assets (#456, thanks @robert-werner)
• filter_online() and additional convert methods added to SearchResult (#458)(#450)
• TokenAuth can now use headers and url formatting (#447)
• All available metadata for onda provider is now retrieved (#440)
• Various minor fixes and improvements (#430)(#433)(#434)(#436)(#438)(#444) (#448)(#449)(#451)(#460)(#464)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato almost 3 years ago

EODAG - v2.4.0

• STAC API POST requests and Query fragment handled in both StacSearch client (#363)(#367) and server mode (#417)
• Added downloaded_callback parameter to download_all() method allowing running a callback after each individual download (#381)
• cloudCover parameter disabled for RADAR product types (#389)
• Guess EOProduct.product_type from properties when missing (#380)
• Keywords usage in product types configuration and guess mechanism (#372)
• Automatic deletion of downloaded product zip after extraction (#358)
• Crunchers are now directly attached to SearchResult (#359)
• Import simplified for EOProduct, SearchResult, and Crunchers (#356)
• Added support for python3.10 (#407)
• Pytest usage instead of nosetest (#406) and tests/coverage reports included in PR (#411)(#416)
• Various minor fixes and improvements (#355)(#361)(#366)(#357)(#371)(#373) (#374)(#377)(#379)(#388)(#394)(#393)(#405)(#401)(#398) (#399)(#419)(#415)(#410)(#420)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato about 3 years ago

EODAG - v2.3.4

• Link to the new eodag Jupyterlab extension: eodag-labextension (#352)
• STAC client and server update to STAC 1.0.0 (#347)
• Fixes get_quicklook() for onda provider (#344, thanks @drnextgis)
• Fixed issue when downloading S2_MSI_L2A products from mundi (#350)
• Various minor fixes and improvements (#340)(#341)(#345)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato over 3 years ago

EODAG - v2.3.3

• Fixed issue when searching by id (#335)
• Specified minimal eodag-cube version needed (#338)
• Various minor fixes and improvements (#336)(#337)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato over 3 years ago

EODAG - v2.3.2

• Enable additional arguments like productType when searching by id (#329)
• Prevent EOL auto changes on windows causing docker crashes (#324)
• Configurable eodag logging in docker stac-server (#323)
• Fixes missing productType in product properties when searching by id (#320)
• Fixes duplicate logging in search_all() (#330)
• Various minor fixes and improvements (#319)(#321)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato almost 4 years ago

EODAG - v2.3.1

• Dockerfile update to be compatible with stac-browser v2.0 (#314)
• Adds new notebook extra dependency (#317)
• EOProduct drivers definition update (#316)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato almost 4 years ago

EODAG - v2.3.0

New since v2.2.0:

• Re-structured and more complete documentation (#233, and also #224, #254, #282, #287, #301)
• Homogenized inconsistent paths returned by download() and download_all() methods (#244)(#292)
• Rewritten progress callback mechanism (#276)(#285)
• Sentinel products SAFE-format build for STAC AWS providers (#218)
• New CLI optional --quicklooks flag in eodag download command (#279, thanks @ahuarte47)
• New product types for Sentinel non-SAFE products (#228)
• Creodias metadata mapping update (#294)
• setup_logging() is now easier to import (#221)
• get_logging_verbose() function added (#283)
• Documentation on how to request USGS M2M API access (#269)
• User friendly parameters mapping documentation (#299)
• Auto extract if extract is not set (#249)
• Fixed how download_all() updates the passed list of products (#253)
• Fixed user config file loading with settings of providers from ext plugin (#235, thanks @ahuarte47)
• Improved and less strict handling of misconfigured user settings (#293)(#296)
• ISO 8601 formatted datetimes accepted by all providers (#257)
• GENERIC_PRODUCT_TYPE not returned any more by list_product_types() (#261)
• Warning displayed when searching with non preferred provider (#260)
• Search kwargs used for guessing a product type not propagated any more (#248)
• Deprecated load_stac_items(), StaticStacSearch search plugin should be used instead (#225)
• ipywidgets no more needed in NotebookWidgets (#223)
• Various minor fixes and improvements (#219)(#246)(#247)(#258)(#233)(#273)(#274)(#280)(#284)(#288)(#290)(#295)

New since v2.3.0b1:

• Removed Sentinel-3 products not available on peps any more (#304, thanks @tpfd)
• Prevent display_html() in ipython shell (#307)
• Fixed plugins reload after having updated providers settings from user configuration (#306)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato almost 4 years ago

EODAG - v2.3.0b1

• Re-structured and more complete documentation (#233, and also #224, #254, #282, #287, #301)
• Homogenized inconsistent paths returned by download() and download_all() methods (#244)(#292)
• Rewritten progress callback mechanism (#276)(#285)
• Sentinel products SAFE-format build for STAC AWS providers (#218)
• New CLI optional --quicklooks flag in eodag download command (#279, thanks @ahuarte47)
• New product types for Sentinel non-SAFE products (#228)
• Creodias metadata mapping update (#294)
• setup_logging() is now easier to import (#221)
• get_logging_verbose() function added (#283)
• Documentation on how to request USGS M2M API access (#269)
• User friendly parameters mapping documentation (#299)
• Auto extract if extract is not set (#249)
• Fixed how download_all() updates the passed list of products (#253)
• Fixed user config file loading with settings of providers from ext plugin (#235, thanks @ahuarte47)
• Improved and less strict handling of misconfigured user settings (#293)(#296)
• ISO 8601 formatted datetimes accepted by all providers (#257)
• GENERIC_PRODUCT_TYPE not returned any more by list_product_types() (#261)
• Warning displayed when searching with non preferred provider (#260)
• Search kwargs used for guessing a product type not propagated any more (#248)
• Deprecated load_stac_items(), StaticStacSearch search plugin should be used instead (#225)
• ipywidgets no more needed in NotebookWidgets (#223)
• Various minor fixes and improvements (#219)(#246)(#247)(#258)(#233)(#273)(#274)(#280)(#284)(#288)(#290)(#295)

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato almost 4 years ago

EODAG - v2.2.0

• New search_all and search_iter_page methods to simplify pagination handling (GH-190)
• Docker-compose files for STAC API server with STAC-browser (GH-183)
• Fixed USGS plugin which now uses Machine-to-Machine (M2M) API (GH-209)
• Windows support added in Continuous Integration (GH-192)
• Fixes issue with automatically load configution from EODAG external plugins, fixes GH-184
• More explicit signature for setup_logging, fixes GH-197
• Various minor fixes

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato about 4 years ago

EODAG - v2.1.1

• Continuous Integration performed with GitHub actions
• Providers config automatically loaded from EODAG external plugins like eodag-sentinelsat
• Various minor fixes

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato about 4 years ago

EODAG - v2.1.0

• earth_search and usgs_satapi_aws (Landsat Collection 2) as new providers;
• Updated HTTPDownload plugin, handling products with multiple assets;
• New plugin AwsAuth, enables AWS authentication using no-sign-request, profile, ~/.aws/*;
• New search plugin StaticStacSearch and updated STAC client tutorial;
• New tutorial for Copernicus DEM;
• UTC timezone set for dates by default;
• Locations must now be passed to search() method as a dictionnary;
• Metadata mapping update and uniformization, fixes GH-154;
• Various minor fixes and tests update;
• Drop support of Python 3.5.

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato about 4 years ago

EODAG - v2.0

New since v2.0b2:

• User can add a new provider using Python API
• More download options using Python API, fixes GH-145 and
  GH-112
• New tutorials for STAC and search by geometry, fixes GH-139
• New crunches FilterDate, FilterProperty and updated FilterOverlap, fixes GH-137
• Simplified requirements. No more dependencies with GDAL (fiona), and jq
• Better credentials error handling
• Documentation and tutorials update
• Various minor fixes, code refactorization, and tests update

New since v1.6.0:

• STAC API compliant REST server
• Common configuration for STAC providers
• astraea_eod as new STAC provider
• Search by geometry / bbox / location name, fixes GH-49
• New method deserialize_and_register, fixes GH-140
• Load static stac catalogs as SearchResult
• Search on unknown product types using GENERIC_PRODUCT_TYPE
• get_data, drivers and rpc server moved to eodag-cube
• Removed fixed dependencies, fixes GH-82
• Use template as default locations configuration file
• removed Python 2.7 support

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato over 4 years ago

EODAG - v2.0b2

• New method deserialize_and_register, fixes GH-140
• Load static stac catalogs as SearchResult
• Search on unknown product types using GENERIC_PRODUCT_TYPE
• get_data, drivers and rpc server moved to eodag-cube
• Removed fixed dependencies, fixes GH-82
• Use locations conf template by default

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato over 4 years ago

EODAG - v2.0b1

• STAC API compliant REST server
• Common configuration for STAC providers
• astraea_eod as new STAC provider
• Search by geometry / bbox / location name, fixes #49
• removed Python 2.7 support

Sustainable Development - Data Catalogs and Interfaces - Python
Published by sbrunato over 4 years ago