There are bunch of such examples in the internet. What i'm looking as a product manager is a no-code/low-code solution. There's no time for all this stuff with the environment, bugs, servers, databases etc. All I need is to get data, store it somewhere where I have access to and be able to add some scripts to process the data.
thanks for your feedback. check these tools out. https://www.scrapingbee.com/blog/web-scraping-tools/ . note that any low code /no code solution will not be very flexible and you might need to pay to use some of them
Yes, unless you use it unethically. Web scraping is just like any tool in the world. You can use it for good stuff and you can use it for bad stuff. A great example when web scraping can be illegal is when you try to scrape nonpublic data. Here's more http://scrapingauthority.com/2016/08/22/web-scraping-legal
After going through this post i felt like this is one of the best information i have read
Thank you for reading!
There are bunch of such examples in the internet. What i'm looking as a product manager is a no-code/low-code solution. There's no time for all this stuff with the environment, bugs, servers, databases etc. All I need is to get data, store it somewhere where I have access to and be able to add some scripts to process the data.
thanks for your feedback. check these tools out. https://www.scrapingbee.com/blog/web-scraping-tools/ . note that any low code /no code solution will not be very flexible and you might need to pay to use some of them
Agreed. As a PM, the time required to build this is better spent on more strategic work and getting more users.
scrapy is a muscled candidate to get job done. especially if the source is dynamically changing DOM tree. https://scrapy.org/
is it legal to scarp any data to any extend?
Yes, unless you use it unethically. Web scraping is just like any tool in the world. You can use it for good stuff and you can use it for bad stuff. A great example when web scraping can be illegal is when you try to scrape nonpublic data. Here's more http://scrapingauthority.com/2016/08/22/web-scraping-legal