Problem scraping Bet365 with headless mode

[victornoleto]

I know that my question is not exactly related to the repository, but I thought it was worth sharing.

I created a thread on stackoverflow and there extremely detailed what my problem is when web scraping the Bet365 site.

Thanks if you can take a look.

https://stackoverflow.com/questions/70883112/problem-scraping-bet365-with-headless-mode-python-selenium-puppeteer

[S1M0N38]

Have you already tried soccerapi-server ?

[victornoleto]

Isn't this server just for generating a new X-Net-Sync-Term?

[S1M0N38]

Yes, but you can use the same technology (puppeteer noheadless inside docker container with virtual display) to achieve your goals. Moreover the stealth plugin improve anti-bot detection

[Colombo97]

@victornoleto Did u solve the issue?

[HMaker]

In last changes bet365 tries to detect headless chrome but puppeteer-stealth is able to bypass their naive detection.

[Colombo97]

@HMaker Thank you for feedback, i'll try it

[victornoleto]

Unfortunately I gave up on finding a solution. I didn't get to test the solution proposed by @HMaker.

[Colombo97]

Lets dicuss about it add me on discord: Colombo97#9666