Jeff Feiwell
@hyper
Has anyone successfully scraped Linkedin at scale or found a way to turn their connections into queryable data?
7 replies
0 recast
0 reaction
Omar
@omar
Yeah, I did this but back in 2014 for public profile data. Got about 170M profiles and 310M employment data points.
2 replies
0 recast
0 reaction
Shashank
@0xshash
build jobscaster on fc
0 reply
0 recast
1 reaction
Erik Boles
@erikboles
It can be done, but they’ve made it far more difficult than it was in the past. I’m sure 3rd party apps exist, but I’d write a script to scrape using DOM. You’d have to RAND pause between scrapes and use various IPs.
0 reply
0 recast
0 reaction
Akhil
@akhil-bvs
Try this tool : https://phantombuster.com/
0 reply
0 recast
0 reaction
Ryan Orban
@ryo
I’ve used the datasets from https://www.peopledatalabs.com/ in the past, it’s somewhat queryable but if you want the full profile you have to parse the JSON. Getting the full dump isn’t cheap, but their API pricing is reasonable
1 reply
0 recast
0 reaction
maxgrok
@maxgrok
Try phatombuster.
0 reply
0 recast
0 reaction