Real-Time Data Streaming Engineer

We are seeking a highly skilled Real-Time Data Streaming Engineer to join a dynamic team supporting one of Randstad’s premier clients in Washington, DC. This role requires deep experience in building and managing event-driven architectures and real-time data pipelines using modern streaming and orchestration tools. The ideal candidate has a passion for distributed systems, excels in handling high-throughput data pipelines, and is comfortable working across cloud-native environments with a focus on performance, security, and scalability.

Key Responsibilities:

• Design, build, and maintain real-time data pipelines using Apache Kafka, Amazon MSK, Kafka Streams, and Kafka Connect
• Implement and optimize stream processing solutions using Apache Flink, Spark Streaming, or similar frameworks
• Manage data workflows and orchestration using Apache NiFi and Apache Airflow
• Administer and integrate messaging platforms such as MQ and Pub/Sub systems to support event-driven microservices
• Architect and support scalable, cloud-native streaming infrastructure across AWS, GCP, or Azure environments
• Implement best practices for schema evolution, data governance, and secure data processing
• Collaborate with cross-functional engineering teams to develop event-based microservices and integrations
• Troubleshoot and resolve issues related to stream processing performance and reliability
• Contribute to the continuous improvement of infrastructure, deployment automation, and monitoring solutions
• Stay current on emerging technologies and help drive innovation in real-time data architecture and tooling