Commits

Breadcrumbs

History for

on0.16

User selector

All users

All time

Commit History

Commits on May 15, 2012

• require w3lib 1.2 or greater

  dangra

  committed
  d74a067

  Copy full SHA for d74a067

Commits on May 2, 2012

• updated maintainer to scrapinghub

  pablohoffman

  committed
  abcac4f

  Copy full SHA for abcac4f

Commits on Apr 29, 2012

• renamed and improved README to provide a more helpful github landing page

  pablohoffman

  committed
  7818592

  Copy full SHA for 7818592

Commits on Apr 10, 2012

• switched default selectors backend to lxml

  pablohoffman

  committed
  6e8edbd

  Copy full SHA for 6e8edbd

Commits on Mar 5, 2012

• bumped required python-w3lib version in debian/control

  pablohoffman

  committed
  9006227

  Copy full SHA for 9006227

Commits on Jan 13, 2012

• make scrapyd debian package dependent on the same (or higher) version of scrapy package

  pablohoffman

  committed
  85e2b49

  Copy full SHA for 85e2b49

Commits on Jan 12, 2012

• scrapyd: fixed issue with ubuntu package: /var/lib/scrapyd/items dir not being created by default

  pablohoffman

  committed
  8a45dd1

  Copy full SHA for 8a45dd1

Commits on Sep 1, 2011

• updated documentation and code to use -s instead of --set option

  pablohoffman

  committed
  76af0cd

  Copy full SHA for 76af0cd

Commits on May 1, 2011

• debian/control: added python-setuptools to Recommends, because it's need by 'scrapy deploy' command

  pablohoffman

  committed
  718428c

  Copy full SHA for 718428c

Commits on Apr 28, 2011

• removed googledir example, replaced by dirbot project on github. updated docs accordingly

  pablohoffman

  committed
  bf73002

  Copy full SHA for bf73002

Commits on Apr 19, 2011

• debian: added python-w3lib package to dependencies

  pablohoffman

  committed
  ebcbb9f

  Copy full SHA for ebcbb9f

• Moved several functions from scrapy.utils.{http,markup,multipart,response,url} (and their tests) to a new library called 'w3lib'. Scrapy will now depend on w3lib.

  pablohoffman

  committed
  b10f4fa

  Copy full SHA for b10f4fa

Commits on Mar 23, 2011

• moved scrapyd python module to scrapy debian package. left scrapyd package only for installing service (upstart script) and scrapy user

  pablohoffman

  committed
  60f6a9b

  Copy full SHA for 60f6a9b

Commits on Jan 28, 2011

• fixed wrong changes commited in previous changeset

  pablohoffman

  committed
  b1c8950

  Copy full SHA for b1c8950

• added missing scrapyd/default_scrapyd.conf file to MANIFEST.in

  pablohoffman

  committed
  4361150

  Copy full SHA for 4361150

Commits on Jan 11, 2011

• make scrapyd package depend on specific scrapy version

  pablohoffman

  committed
  7dc521c

  Copy full SHA for 7dc521c

Commits on Jan 4, 2011

• make scrapy*-0.12 packages conflict with scrapy*-0.11 packages

  pablohoffman

  committed
  ac81662

  Copy full SHA for ac81662

Commits on Nov 17, 2010

• Make scrapy conflict with previous versionsof the debian package

  pablohoffman

  committed
  2897061

  Copy full SHA for 2897061

• debian/control: Added scrapy/scrapyd to Provides

  pablohoffman

  committed
  3926ca4

  Copy full SHA for 3926ca4

• Changed Debian packaging to use the scrapy version in the package name, so we can have multiple Scrapy versions in the same apt repo

  Show description for a034d07
  pablohoffman

  committed
  a034d07

  Copy full SHA for a034d07

Commits on Oct 27, 2010

• Automated merge with http://hg.scrapy.org/scrapy-0.10

  pablohoffman

  committed
  1d5c560

  Copy full SHA for 1d5c560

• changed pid file name to scrapyd

  pablohoffman

  committed
  c3e5b4b

  Copy full SHA for c3e5b4b

• Automated merge with http://hg.scrapy.org/scrapy-0.10

  pablohoffman

  committed
  2bba87f

  Copy full SHA for 2bba87f

• simplified lockfile used by scrapyd (/var/run/scrapyd.pid instead of /var/run/scrapyd/scrapyd.pid). closes #271

  pablohoffman

  committed
  f47b9f6

  Copy full SHA for f47b9f6

Commits on Sep 28, 2010

• Updated Scrapy version in debian/changelog

  pablohoffman

  committed
  d15a97f

  Copy full SHA for d15a97f

Commits on Sep 17, 2010

• Make Ubuntu package conflict with standard Scrapy Debian/Ubuntu package

  pablohoffman

  committed
  0895256

  Copy full SHA for 0895256

Commits on Sep 7, 2010

• Some changes to Scrapyd to support multiple configuration files, to make it easier to deploy Scrapyd applications. Also documented 'egg_runner' and 'application' options

  Show description for 9158e9d
  pablohoffman

  committed
  9158e9d

  Copy full SHA for 9158e9d

Commits on Sep 3, 2010

• Added new Scrapy service with support for:

  Show description for 37e9c5d
  pablohoffman

  committed
  37e9c5d

  Copy full SHA for 37e9c5d

Commits on Aug 27, 2010

• Moved scrapy-ws script to extras/ and fixed broken methods due to changes in web service API

  Show description for e14cc2c
  pablohoffman

  committed
  e14cc2c

  Copy full SHA for e14cc2c

Commits on Aug 24, 2010

• Removed scrapy-sqs script, as it has been superseded by the new scrapy 'queue' command

  pablohoffman

  committed
  8e83f52

  Copy full SHA for 8e83f52

Commits on Aug 21, 2010

• Added bash completion for the Scrapy command-line tool. Closes #210

  pablohoffman

  committed
  0d9e75c

  Copy full SHA for 0d9e75c

Commits on Aug 18, 2010

• Deprecated scrapy-ctl.py command in favour of simpler "scrapy" command. Closes #199. Also updated documenation accordingly and added convenient scrapy.bat script for running from Windows.

  Show description for 34554da
  pablohoffman

  committed
  34554da

  Copy full SHA for 34554da

Commits on Jul 31, 2010

• minor fix to path name

  pablohoffman

  committed
  c5fd113

  Copy full SHA for c5fd113

• Splitted single Debian package into two packages (closes #187):

  Show description for f6eac8e
  pablohoffman

  committed
  f6eac8e

  Copy full SHA for f6eac8e

Commits on Jun 14, 2010

• updated copyright year, and indentation space

  pablohoffman

  committed
  ede1df4

  Copy full SHA for ede1df4