Job Description

This role is for one of the Weekday's clients

Compensation: $180,000–$280,000

Min Experience: 6 years

Location: USA, Texas City, California City, Austin, Dallas, Washington, San Francisco, US, San Francisco Bay Area, new york, Seattle, Boston, Los Angeles

JobType: full-time

We are seeking a highly experienced Python Software Engineer to lead backend development for large-scale, real-time data pipelines. The ideal candidate has deep expertise in Python, data ingestion frameworks, workflow orchestration, and performance optimization. This role involves building robust, high-throughput systems that correlate and process data across multiple streams in real time.

Key Responsibilities

• Architect and develop scalable backend services and data ingestion pipelines using Python.
• Work with real-time data processing systems to ensure high performance, low latency, and reliability.
• Build and optimize workflows using Celery, Temporal, or similar orchestration tools.
• Apply advanced query optimization and data modeling techniques to support high-volume data operations.
• Collaborate with data platform teams to improve ingestion, transformation, and processing layers.
• Ensure smooth integration with third-party tools, security systems, and cloud-based environments.
• Troubleshoot pipeline issues and drive system improvements for scalability and efficiency.

Required Experience

• Extensive hands-on experience with Python for backend engineering.
• Strong background in data ingestion pipelines and real-time data processing.
• Expertise in Celery, Temporal, or other workflow automation/orchestration systems.
• Solid understanding of distributed systems, query optimization, and data platform architecture.
• Experience working with high-volume, high-frequency data streams.

Job Tags

Full time, Weekday work,

Similar Jobs