Case Study - Automated data collection platform
A bespoke Node.js platform that collects and processes large-scale market data for investment decisions
- Client
- Investment Firm
- Year
- Service
- Backend development
Overview
In the investment world, having better data means making better decisions. Our client needed a way to systematically collect and analyse market data from a wide range of online sources — something that would have taken their team weeks to do manually.
We built a robust Node.js and TypeScript backend that orchestrates dozens of data collection workers, each tailored to a specific source. The system handles rate limiting, error recovery and data normalisation automatically, outputting clean, structured datasets ready for analysis.
Working closely with members of the investment team, we iterated on the data formats and collection targets until the output matched exactly what they needed for their due diligence process.
What we did
- Node.js & TypeScript
- Data pipelines
- Backend architecture
- PostgreSQL
The data platform JJP built gave us market insight we simply could not have obtained through other channels. It directly informed a major investment decision.
Investment Director
- Data sources
- 50+
- Data points collected
- 2M+
- Automation rate
- 95%
- Faster than manual
- 10x