loc
@achannarasappa/locust
npm i @achannarasappa/locust
loc

@achannarasappa/locust

Distributed web data discovery and collection framework built for serverless

by Ani Channarasappa

1.3.0 (see all)License:MITTypeScript:Not Found
npm i @achannarasappa/locust
Readme

Build Status Coverage Status

Locust

Distributed web data discovery and collection framework

Quick Start

npm install @achannarasappa/locust

Features

  • Configuration driven jobs
  • Distributed execution model to support serverless architectures
  • Handle client-side JavaScript execution
  • Data extraction using CSS selectors
  • Depth-based stop condition along with support for custom stop conditions
  • Robust dev tooling with locust-cli to build and test jobs

Use Cases

  • Web indexing (i.e. web crawling)
  • Web data extraction (i.e. web scraping)

Reference

No alternatives found
No tutorials found
Add a tutorial
No dependencies found

Rate & Review

100
No reviews found
Be the first to rate