se

spider-event

a simple workflow for web crawling

Showing:

Popularity

Downloads/wk

0

GitHub Stars

1

Maintenance

Last Commit

8yrs ago

Contributors

0

Package

Dependencies

2

License

MIT

Type Definitions

Tree-Shakeable

No?

Categories

Readme

spider-event

A simple workflow for web crawling

install

$ npm install spider-event

example

var core = require('spider-event');

var engine = new core.Engine();
engine.startURLs = [
  'http://www.xiami.com/',
  'https://www.npmjs.org/'
];

var spider1 = new core.Spider();
spider1.on('response', function(response) {
  console.log('Response status: ', 200);
  console.log('Response body: ', response.body.slice(0,20));
});

spider1.on('error', function(err, resquest, response) {
  console.error('An error happened!');
});

engine.route(spider1);

engine.run();

More

Read the code to see it's so simple, welcome to fork and contribute.

Rate & Review

Great Documentation0
Easy to Use0
Performant0
Highly Customizable0
Bleeding Edge0
Responsive Maintainers0
Poor Documentation0
Hard to Use0
Slow0
Buggy0
Abandoned0
Unwelcoming Community0
100
No reviews found
Be the first to rate

Alternatives

No alternatives found

Tutorials

No tutorials found
Add a tutorial