sc_crawler.description_ingestor

Functions:

• descriptions_data_path – Download current server description data into a temp folder.
• ingest_server_description – Load and validate generated description data for a Server.
• ingest_server_descriptions – Load generated description data for all Servers with available output.

func descriptions_data_path

descriptions_data_path()

Download current server description data into a temp folder.

Setting the SC_CRAWLER_DESCRIPTIONS_DATA_PATH environment variable will override the default path for persistent/cached description data access.

func ingest_server_description

ingest_server_description(server)

Load and validate generated description data for a Server.

func ingest_server_descriptions

ingest_server_descriptions(servers)

Load generated description data for all Servers with available output.