Orchestrated the migration of a critical data processing pipeline from a legacy batch system to a robust event-driven architecture using Apache Kafka and Kafka Streams, achieving a 65% reduction in end-to-end data latency. This transformation was crucial for improving the responsiveness of real-time fraud detection systems, which previously faced unacceptable delays during peak transaction volumes, impacting user experience and increasing risk exposure. My approach focused on designing scalable topologies to handle over 50,000 events per second consistently.
My experience extends to designing and implementing high-performance event-driven solutions across diverse cloud environments. At Stripe, I led the development of a real-time anomaly detection system leveraging Apache Flink, processing over 100,000 events/second with sub-200ms latency to identify suspicious activities. I also optimized a multi-node Confluent Kafka cluster, reducing broker resource consumption by 25% through meticulous configuration tuning and custom Java client development. Furthermore, I engineered a highly available event ingestion service using AWS Kinesis and Lambda, capable of handling variable peak loads up to 120,000 messages per second, ensuring reliable data capture for over a dozen internal microservices.
Synapse Data Solutions' pioneering work in real-time predictive analytics, particularly your recent initiative on low-latency market intelligence platforms, deeply resonates with my expertise in building resilient and high-throughput data streams. My background in engineering scalable event-driven platforms with technologies like Kafka and Flink, specifically focused on data integrity and minimal latency, directly aligns with the technical challenges and innovative goals outlined in your team’s public research. I am particularly drawn to your focus on leveraging asynchronous processing for complex financial datasets.
My extensive experience in architecting and optimizing event-driven systems that process billions of events daily positions me to make immediate and significant contributions to Synapse Data Solutions. I am confident my technical leadership and hands-on skills in core eventing technologies can enhance your infrastructure's performance and reliability, propelling your next generation of data-centric products. I am eager to discuss how my insights can support Synapse Data Solutions in achieving its ambitious technical milestones.
Best regards,
Leila Nazari