Real Estate
PropTech SaaS: Automating 2M+ Property Listings Daily
A leading PropTech startup needed real-time visibility into the Mumbai real estate market. They were previously relying on expensive data APIs that had delayed information. We built a custom distributed scraping system that collects property listings across three major Indian real estate portals daily.
The Challenge
Scraping 2M+ listings daily without getting IP banned, while standardizing highly unstructured HTML data (amenities, carpet area, possession dates) into a unified PostgreSQL database.
Our Solution
We deployed a cluster of Playwright instances routed through Indian residential proxies. The system bypasses rate limits using human-like scrolling and dynamic delays. We also wrote a robust data normalizer to standardize property attributes before insertion.
The Results
2.1 Million listings extracted every 24 hours
₹12 Lakhs/year saved compared to their previous API vendor
99.8% uptime across a 6-month period