This was a project which I designed and developed fully on my own. The goal was to get validated leads for our ICT business sales to contact and offer consulting services regarding email delivery and security.
The platform scanned 253 616 Finnish companies, 209 809 of their .fi TLD’s and 75 703 email exchanges. The resulting graph database was later enriched with other key data, which increased the value of the dataset as a whole.
Results were pushed to Monday.com CRM via integration for further processing by the sales.
A very interesting and challenging “little” project overall, that thought me a lot. Some major challenges included error handling, throttling, avoiding bot detection with proxies and ton of other little details.
- Neo4j graph database
- Node.js
- Redis