kuhl-haus-mdp

Market data processing library.

Overview

The Kuhl Haus Market Data Platform (MDP) is a distributed system for collecting, processing, and serving real-time market data. Built on Kubernetes and leveraging microservices architecture, MDP provides scalable infrastructure for financial data analysis and visualization.

Key Features

• Real-time market data ingestion and processing

• Scalable microservices architecture

• Automated deployment with Ansible and Kubernetes

• Multi-environment support (development, staging, production)

• OAuth integration for secure authentication

• Redis-based caching layer for performance

Code Organization

The platform consists of four main packages:

• Market data processing library (kuhl-haus-mdp) - Core library with shared data processing logic

• Backend Services (kuhl-haus-mdp-servers) - Market data listener, processor, and widget service

• Frontend Application (kuhl-haus-mdp-app) - Web-based user interface and API

• Deployment Automation (kuhl-haus-mdp-deployment) - Docker Compose, Ansible playbooks and Kubernetes manifests for environment provisioning

Documentation

For architecture details, component descriptions, and API reference, see the full documentation on Read the Docs.

Additional Resources

📖 Blog Series:

• Part 1: Why I Built It

• Part 2: How to Run It

• Part 3: How to Deploy It

• Part 4: Evolution from Prototype to Production

• Part 5: Wave 1 Complete: Bugs, Bottlenecks, and Breaking 1,000 msg/s

• Stock Selection: Why News Matters