commits

dekker.one / Fourmi

A web scraper build to search specific information for a given compound (and its pseudonyms)

fork atom

Author

Commit

Message

Date

Jip J. Dekker

e0556bbf

Merge branch 'release/basic-scraper-structure' basic-scraper-structure

11y ago

Jip J. Dekker

e210ce85

Merge branch 'develop', remote-tracking branch 'origin/develop' into develop

11y ago

Jip J. Dekker

6bbee865

Merge branch 'feature/basic-structure' into develop

11y ago

Jip J. Dekker

1e730e77

Merge branch 'feature/basic-structure' of code.giphouse.nl:giphouse/descartes-2 into feature/basic-structure

11y ago

Jip J. Dekker

32cedecf

Added an basic parser class to extend, next step implementing the global function

11y ago

Jip J. Dekker

325febe8

Added an basic parser class to extend, next step implementing the global function

11y ago

Jip J. Dekker

d91706d6

The script should stop sometime, added a stopping signal

12y ago

Jip J. Dekker

87d10415

Made all Python files PEP-8 Compatible

12y ago

Jip J. Dekker

5b176275

The parsers however could use their own folder

12y ago

Jip J. Dekker

8e9314e7

One spider should have it's own folder

12y ago

Jip J. Dekker

bdcf359d

Logical fixes to have some "working" case

12y ago

Jip J. Dekker

8175e02f

New Structure, splitting on parsers instead of Spiders

12y ago

Jip J. Dekker

306a37db

A better structure which is able to start multiple spiders.

12y ago

Jip J. Dekker

aa65bbd4

Merge branch 'feature/basic-structure' into develop

12y ago

Jip J. Dekker

847b4f20

Merge branch 'feature/basic-structure' of code.giphouse.nl:giphouse/descartes-2 into feature/basic-structure

12y ago

Jip J. Dekker

328cb380

Unix machine should be able to execute this without any problems.

12y ago

Jip J. Dekker

826937e2

Unix machine should be able to execute this without any problems.

12y ago

Jip J. Dekker

7355de1b

Added an simple script to run a spider

12y ago

Jip J. Dekker

b1840d3a

Another name change to accommodate an executable script

12y ago

Jip J. Dekker

4f5b66ff

Basic structure to make sure the spider use an argument

12y ago

Jip J. Dekker

2cb21c6b

Moved the Scrapy to an other namespace, should prevent some importing faults.

12y ago

Jip J. Dekker

55843d32

Added an formal pipeline to make sure that we don't supply double values.

12y ago

Jip J. Dekker

b239e474

Merge branch 'feature/basic-structure' into develop

12y ago

Jip J. Dekker

8dd2c168

Added the basic structure for the first two spiders

12y ago

Jip J. Dekker

35481128

Removed all .pyc files and added to the ignore list

12y ago

Jip J. Dekker

6182d410

Added an result item which the spiders will return.

12y ago

Jip J. Dekker

f25af46a

Added the right RST syntax

12y ago

Jip J. Dekker

f5598691

Removed old README file

12y ago

Jip J. Dekker

0e48a714

Merge branch 'develop'

12y ago

Jip J. Dekker

5a3721e7

Provided all Group members to the right README conform with python standards.

12y ago

Bas Vb

17c9c66b

Add Bas to README

12y ago

Michail Kuznetcov

afe09673

add my initial README.md

12y ago

Rob tB

5890c701

added my name to README.md

12y ago

Rob tB

161be2cd

edited README.md

12y ago

Rob tB

7de1231f

added initial README file

12y ago

Jip J. Dekker

3a307a85

Added an gitignore file

12y ago

Jip J. Dekker

aba39dd7

README to an RST file, to be python conform

12y ago

Jip J. Dekker

3cbaa998

Added an basic Scrapy setup

12y ago

Jip J. Dekker

94b1d24b

Let's Begin!

12y ago

Merge branch 'release/basic-scraper-structure' basic-scraper-structure

e0556bbf

Jip J. Dekker

11y

Merge branch 'develop', remote-tracking branch 'origin/develop' into develop

e210ce85

Jip J. Dekker

11y

Merge branch 'feature/basic-structure' into develop

6bbee865

Jip J. Dekker

11y

Merge branch 'feature/basic-structure' of code.giphouse.nl:giphouse/descartes-2 into feature/basic-structure

1e730e77

Jip J. Dekker

11y

Added an basic parser class to extend, next step implementing the global function

32cedecf

Jip J. Dekker

11y

Added an basic parser class to extend, next step implementing the global function

325febe8

Jip J. Dekker

11y

The script should stop sometime, added a stopping signal

d91706d6

Jip J. Dekker

12y

Made all Python files PEP-8 Compatible

87d10415

Jip J. Dekker

12y

The parsers however could use their own folder

5b176275

Jip J. Dekker

12y

One spider should have it's own folder

8e9314e7

Jip J. Dekker

12y

Logical fixes to have some "working" case

bdcf359d

Jip J. Dekker

12y

New Structure, splitting on parsers instead of Spiders

8175e02f

Jip J. Dekker

12y

A better structure which is able to start multiple spiders.

306a37db

Jip J. Dekker

12y

Merge branch 'feature/basic-structure' into develop

aa65bbd4

Jip J. Dekker

12y

Merge branch 'feature/basic-structure' of code.giphouse.nl:giphouse/descartes-2 into feature/basic-structure

847b4f20

Jip J. Dekker

12y

Unix machine should be able to execute this without any problems.

328cb380

Jip J. Dekker

12y

Unix machine should be able to execute this without any problems.

826937e2

Jip J. Dekker

12y

Added an simple script to run a spider

7355de1b

Jip J. Dekker

12y

Another name change to accommodate an executable script

b1840d3a

Jip J. Dekker

12y

Basic structure to make sure the spider use an argument

4f5b66ff

Jip J. Dekker

12y

Moved the Scrapy to an other namespace, should prevent some importing faults.

2cb21c6b

Jip J. Dekker

12y

Added an formal pipeline to make sure that we don't supply double values.

55843d32

Jip J. Dekker

12y

Merge branch 'feature/basic-structure' into develop

b239e474

Jip J. Dekker

12y

Added the basic structure for the first two spiders

8dd2c168

Jip J. Dekker

12y

Removed all .pyc files and added to the ignore list

35481128

Jip J. Dekker

12y

Added an result item which the spiders will return.

6182d410

Jip J. Dekker

12y

Added the right RST syntax

f25af46a

Jip J. Dekker

12y

Removed old README file

f5598691

Jip J. Dekker

12y

Merge branch 'develop'

0e48a714

Jip J. Dekker

12y

Provided all Group members to the right README conform with python standards.

5a3721e7

Jip J. Dekker

12y

Add Bas to README

17c9c66b

Bas Vb

12y

add my initial README.md

afe09673

Michail Kuznetcov

12y

added my name to README.md

5890c701

Rob tB

12y

edited README.md

161be2cd

Rob tB

12y

added initial README file

7de1231f

Rob tB

12y

Added an gitignore file

3a307a85

Jip J. Dekker

12y

README to an RST file, to be python conform

aba39dd7

Jip J. Dekker

12y

Added an basic Scrapy setup

3cbaa998

Jip J. Dekker

12y

Let's Begin!

94b1d24b

Jip J. Dekker

12y