I have a list of URLs and I need to scrape the given details:
1. Wine name ---. product-details__container-right li:nth-child(1) h1:nth-child(1)
2. Wine Type--- li.pb-4:nth-child(2) a:nth-child(1)
3. Producer Link --- div.font-light-bold:nth-child(3) a:nth-child(1)
I have approximately 1000+ links and the input and output files will be on .csv
Basic Problems:
1. Those websites can't be accessed using automated scraping tools like phantombuster. It's giving an HTTP code 403 error.
2. We also faced the same issue for scraping angel list profiles. I also have a USA proxy to process with the python script.
3. Need some coder to go through the database via cookies.