15:22:20 <Varun777> hi all
15:22:29 <Varun777> urgent help
15:22:33 <Varun777> on scrapy
15:22:50 <vii_majesty> what happen
15:23:34 <Varun777> vii_majesty: https://theekkathir.in/News/states/
15:23:42 <Varun777> I want to scrape this website
15:24:02 <Varun777> Note this website, there is no pagination support
15:24:31 <Varun777> I want to scrape by clicking load more button further scraping
15:24:46 <Varun777> beyond five-six list of news
15:24:48 <vii_majesty> have you tried curl
15:25:06 <Varun777> no
15:25:56 <vii_majesty> actually try wget
15:26:00 <vii_majesty> wget -r https://theekkathir.in/News/states/
15:27:18 <Varun777> it downloads xml files
15:28:46 <vii_majesty> otherwise in your browser, go to the site 
15:28:49 <vii_majesty> and press CTRL S
15:33:11 <Varun777> I saves as given 5-6 websites, while downloading
15:33:41 <Varun777> when I asked llama , It says
15:33:49 <Varun777> to use scrapy-selenium
15:34:00 <Varun777> any alternatives to scrapy-selenium
15:41:15 <hariharan> Why are you checking alternative to scrapy selenium is there any issues you're  facing with it? 
15:42:54 <Varun777> no hariharan
15:43:58 <hariharan>  what is the purpose  of alternative you're  looking for? 
15:44:05 <Varun777> selenium makes more challenging to write code to work with github actions
15:44:32 <Varun777> https://theekkathir.in/News/states/
15:44:53 <Varun777> hariharan: I want to click load more button
15:45:41 <Varun777> to scrape more contents, which loads down
15:47:14 <hariharan> You have shared a github is that is used to scrape the contents? 
15:48:11 <Varun777> yes hariharan
15:48:21 <Varun777> shall I share again
15:53:34 <hariharan-u> mohan43u: how to update the youtube live description with my blog post url can you able to update it ? 
19:58:47 <mohan43u> hariharan: I can update, send me the link