opensource
All things OSS, for maintainers, contributors and enthusiasts! Post interesting projects, meta discussions, etc.
Retik Bongo pfp
0 reply
0 recast
0 reaction
Jimmy pfp
0 reply
0 recast
0 reaction
aerique pfp
0 reply
0 recast
0 reaction
hellno the optimist pfp
1 reply
0 recast
11 reactions
Wesley— oss/acc pfp
3 replies
3 recasts
26 reactions
AK 🦂 pfp
0 reply
0 recast
4 reactions
Thumbs Up pfp
0 reply
0 recast
1 reaction
Tarun Sachdeva pfp
0 reply
0 recast
6 reactions
Thumbs Up pfp
0 reply
0 recast
2 reactions
Breck Yunits pfp
0 reply
1 recast
1 reaction
AK 🦂 pfp
0 reply
0 recast
1 reaction
shazow pfp
1 reply
1 recast
9 reactions
Mikko Ohtamaa pfp
0 reply
0 recast
4 reactions
Darryl Yeo 🛠️ pfp
0 reply
0 recast
3 reactions
AK 🦂 pfp
Crawlee is a powerful Python library for web scraping and browser automation , designed to create scrapers that look almost like real users . It offers rich configuration options , allowing users to customize the tool to suit their specific needs . The library offers two main types of crawlers : BeautifulSoupCrawler and PlaywrightCrawler . BeautifulSoupCrawler is ideal for projects that require efficient data extraction from HTML content without the need to execute client-side JavaScript . While PlaywrightCrawler uses a headless browser to handle web pages that rely on client-side JavaScript or require interaction with JavaScript content . Both crawlers support features such as automatic retries , proxy rotation , session management , custom request routing, and robust error handling . https://github.com/apify/crawlee-python Site: https://crawlee.dev/python/
0 reply
0 recast
2 reactions