bug: sitemap parser returning invalid URLs

[barjin]

In the case of a pretty-printed XML sitemap, the Sitemap.load() call can return invalid URLs (the text content of the loc element contains newlines and whitespace characters).

The solution is likely simple - we should call trim() on those (see snippet below). Maybe also try parsing the urls with new URL(), skipping if this call throws?

crawlee/packages/utils/src/internals/sitemap.ts

Line 149 in ea48d46

this.url.loc = text;

[AryanGupta001]

hi! , I am starting my open source journey and would like to work on this issue.