Commits

Branch selector

 master

User selector

rmax

All time

Commit History

Commits on Apr 27, 2017

• Abort connection earlier and avoid to buffer data

  Show description for 2b34c6e
  rmax

  committed
  2b34c6e

  Copy full SHA for 2b34c6e

Commits on Mar 1, 2017

• Handle data loss gracefully.

  Show description for f01ae6f
  rmax

  committed
  f01ae6f

  Copy full SHA for f01ae6f

Commits on Feb 8, 2017

• BUG: Fix __classcell__ propagation.

  Show description for 4e765ac
  rmax

  committed
  4e765ac

  Copy full SHA for 4e765ac

Commits on Dec 21, 2016

• ENH Pass arguments to logger rather than formatted message.

  Show description for 6dec4a3
  rmax

  committed
  6dec4a3

  Copy full SHA for 6dec4a3

Commits on Dec 1, 2016

• TST Include nested a nested spider in spider loader test.

  rmax

  committed
  923b974

  Copy full SHA for 923b974

• DOC State explicitly that spiders are loaded recursively.

  rmax

  committed
  6431e7a

  Copy full SHA for 6431e7a

• TST: Fix duplicated test name.

  rmax

  committed
  d9f43e2

  Copy full SHA for d9f43e2

Commits on Nov 9, 2016

• Update conda channel to conda-forge and show conda version badge.

  rmax

  committed
  76459e1

  Copy full SHA for 76459e1

Commits on Nov 8, 2016

• Ignore explicitly compiled python files.

  Show description for 3cd56da
  rmax

  committed
  3cd56da

  Copy full SHA for 3cd56da

Commits on Dec 5, 2015

• DOC Removed pywin32 from install instructions as it's already declared as dependency.

  rmax

  committed
  f8ae99d

  Copy full SHA for f8ae99d

Commits on Nov 26, 2015

• Added installation notes about using Conda for Windows and other OSes.

  rmax

  committed
  cc8ddb6

  Copy full SHA for cc8ddb6

Commits on Jun 11, 2015

• Do leveldb compactation for the httpcache on closing.

  rmax

  committed
  877c257

  Copy full SHA for 877c257

Commits on Jul 16, 2014

• For consistency, use `job_dir` helper in `SpiderState` extension.

  Show description for 85b52b0
  rmax

  committed
  85b52b0

  Copy full SHA for 85b52b0

• Updated input/ouput processor example according to #560.

  rmax

  committed
  e441a01

  Copy full SHA for e441a01

Commits on Mar 12, 2014

• Alow to disable a downloader handler just like any other component.

  

  rmax

  authored and

  curita

  committed
  a1df15b

  Copy full SHA for a1df15b

Commits on Feb 15, 2014

• DOC Use pipelines module name instead of pipieline following default project files.

  rmax

  committed
  28f946b

  Copy full SHA for 28f946b

Commits on Jan 30, 2014

• DOC Fixed HTTPCACHE_STORAGE typo in the default value which is now Filesystem instead Dbm.

  rmax

  committed
  a6279fe

  Copy full SHA for a6279fe

Commits on Jan 23, 2014

• Updated the tutorial crawl output with latest output.

  rmax

  committed
  4255e12

  Copy full SHA for 4255e12

• Updated shell docs with the crawler reference and fixed the actual shell output.

  Show description for 9aab922
  rmax

  committed
  9aab922

  Copy full SHA for 9aab922

• PEP8 minor edits.

  rmax

  committed
  4081ba2

  Copy full SHA for 4081ba2

• Expose current crawler in the scrapy shell.

  rmax

  committed
  240fdde

  Copy full SHA for 240fdde

• Unused re import and PEP8 minor edits.

  rmax

  committed
  b934120

  Copy full SHA for b934120

• Ignore None's values when using the ItemLoader.

  rmax

  committed
  420efe7

  Copy full SHA for 420efe7

Commits on Nov 7, 2013

• Replaced remaning __import__(module) calls.

  Show description for 6f5423a
  

  rmax

  authored and

  dangra

  committed
  6f5423a

  Copy full SHA for 6f5423a

• replaced __import__ by importlib.import_module.

  Show description for 6b1760d
  

  rmax

  authored and

  dangra

  committed
  6b1760d

  Copy full SHA for 6b1760d

Commits on Oct 31, 2013

• Merge branch 'master' into import-module

  rmax

  committed
  d1b9128

  Copy full SHA for d1b9128

Commits on Oct 27, 2013

• Replaced remaning __import__(module) calls.

  Show description for 10e22aa
  rmax

  committed
  10e22aa

  Copy full SHA for 10e22aa

• replaced __import__ by importlib.import_module.

  Show description for 343f997
  rmax

  committed
  343f997

  Copy full SHA for 343f997

Commits on Oct 20, 2013

• DOCS removed .tld suffix for spider names for the sake of consistency.

  rmax

  committed
  34543c2

  Copy full SHA for 34543c2

• Removed reference to URL in crawl command as it's no longer supported.

  rmax

  committed
  c2ced9a

  Copy full SHA for c2ced9a

Commits on Oct 19, 2013

• PEP8 improvements

  Show description for dc666f6
  rmax

  committed
  dc666f6

  Copy full SHA for dc666f6

Commits on Sep 30, 2013

• docs: added section regarding setting up django's settings.

  rmax

  committed
  d6e3eae

  Copy full SHA for d6e3eae

• docs: minor tidy up sample code and missing shell prompts.

  rmax

  committed
  0cc1d87

  Copy full SHA for 0cc1d87

Commits on Feb 11, 2013

• added --pdb command option to enable pdb debugger on failure.

  rmax

  committed
  5971333

  Copy full SHA for 5971333

Commits on Feb 1, 2013

• tests: dummydbm.error should be KeyError.

  rmax

  committed
  d00e6cf

  Copy full SHA for d00e6cf