marco

Highly scalable distributed web crawler built with Ruby, MongoDB, Redis, RabbitMQ, Docker Swarm and Containers.

Name		Name	Last commit message	Last commit date
Latest commit History 29 Commits
bin		bin
config		config
crawlers/default		crawlers/default
images		images
lib		lib
plugins		plugins
tmp		tmp
workers		workers
.dockerignore		.dockerignore
.gitignore		.gitignore
Dockerfile		Dockerfile
Gemfile		Gemfile
LICENSE		LICENSE
README.md		README.md
init.rb		init.rb

Provide feedback