Commit Graph

21 Commits

Author SHA1 Message Date
Alejandro Perez Lopez
38fdf3bb50 Move logic in case the captcha resolution fails or we can't extract the data after the captcha resolution to avoid errors 2023-09-22 12:37:05 +02:00
Alejandro Perez Lopez
aec433fa9c Remove duplicated code by extracting repeated code into methods and add feedback for invalid urls 2023-09-09 19:23:56 +02:00
Alejandro Perez Lopez
bf1b9309e1 Create a class for storing the scraped product information 2023-09-09 19:22:40 +02:00
Alejandro Perez Lopez
1d6213ffb1 Modify .gitignore in order to add more routes for images 2023-09-09 19:22:06 +02:00
Alejandro Perez Lopez
fe1ac2cedd Extract into a separated method the logic for building the referer url 2023-09-05 12:04:14 +02:00
Joan
b717e9fdc4 Fixed exception handling 2023-09-05 10:24:19 +02:00
Joan
a60aa4c580 Added last_screenshot for debugging purposes 2023-09-05 10:24:10 +02:00
Joan
8071324adf Changed SQL INSERT so no injection is possible 2023-09-02 22:00:59 +02:00
Joan
d3651352ee Use same version of chrome driver and browser 2023-09-02 22:00:37 +02:00
Joan
e124ca4f2f Syncing old changes... 2023-08-28 20:51:29 +02:00
Joan
d99399f6ac Added xpath method for obtaining image when normal fails 2023-07-11 12:56:02 +02:00
Joan
e3d7db2916 Updated git ignore 2023-07-11 12:10:46 +02:00
Joan
243d0ba749 Added image placeholder if cant retrieve it 2023-06-28 13:26:31 +02:00
Joan
a40f55ca4e Changed link to button 2023-03-14 10:16:58 +01:00
Joan
9979672b46 Added captcha solving method 2023-03-06 22:34:43 +01:00
Joan Cano
e40ca2f165 Added DUMMY file to create products folder 2023-03-06 17:20:19 +01:00
Joan Cano
e6ef4365dd Fixed DB path 2023-03-06 17:16:58 +01:00
Joan Cano
8e5ab0ef81 Fixed Dockerfile 2023-03-06 17:13:20 +01:00
Joan Cano
76cbb0c6cb Fixed Dockerfile 2023-03-06 17:12:41 +01:00
Joan Cano
444921daa6 Added .env skeleton file 2023-03-06 17:06:35 +01:00
Joan Cano
a4a76966fe Initial commit, refactored some things from original code and removed WP functionality 2023-03-06 17:04:59 +01:00