Data administration

SOLR

The following processes are used to interact with the SOLR database.

class pavics_datacatalog.wps_processes.PavicsCrawler[source]

pavicrawler PAVICS Crawler (v0.1)

Crawl thredds server and write metadata to SOLR database.

Paramètres:
  • target_files (string, optional) – Only those file names will be crawled.
  • target_thredds (string, optional) – Thredds server to scan.
Renvoie:

crawler_result – Crawler result as a json.

Type renvoyé:

application/json

class pavics_datacatalog.wps_processes.PavicsSearch[source]

pavicsearch PAVICS Catalogue Search (v0.1)

Search the PAVICS database and return a catalogue of matches.

Paramètres:
  • facets (string, optional) – Comma separated list of facets; facets are searchable indexing terms in the database.
  • shards (string, optional) – Shards to be queried
  • offset (integer, optional) – Where to start in the document count of the database search.
  • limit (integer, optional) – Maximum number of documents to return.
  • fields (string, optional) – Comme separated list of fields to return.
  • format (string, optional) – Output format.
  • query (string, optional) – Direct query to the database.
  • distrib (boolean, optional) – Distributed query
  • type (string, optional) – One of Dataset, File, Aggregate or FileAsAggregate.
  • constraints (string, optional) – Format is facet1:value1,facet2:value2,…
Renvoie:

  • search_result (application/json, application/gml+xml) – PAVICS Catalogue Search Result
  • list_result (application/json) – List of OPEnDAP urls of the search result.

class pavics_datacatalog.wps_processes.PavicsUpdate[source]

pavicsupdate PAVICS Catalogue Update (v0.1)

Update database entries using key:value pairs and identified by their ids.

Paramètres:
  • id (string) – id field of the dataset or file.
  • type (string, optional) – The File type will update a single file, the Dataset type will update all documents sharing its dataset_id
  • updates (string) – Format is key1:value1,key2:value2,…
Renvoie:

update_result – Update result as a json.

Type renvoyé:

application/json

class pavics_datacatalog.wps_processes.PavicsValidate[source]

pavicsvalidate PAVICS Catalogue Validation (v0.1)

Query database entries for missing required facets.

Paramètres:
  • facets (string) – Facets that are required to be present in each database entry.
  • paths (string, optional) – Limit validation to certain paths relative to thredds main directory.
  • files (string, optional) – Limit validation according to file names.
Renvoie:

validation_result – Validation result as a json.

Type renvoyé:

application/json