Data Engineer (Python)

We are seeking an open-minded Senior Data Software Engineer to drive the development and maintenance of our data-driven architecture.

In this role, you will work on developing pipelines to build business-related data products and designing cloud-based platform solutions to support DataHub functionality. If you’re passionate about shaping the future of data engineering and thrive in an environment where innovation and collaboration are key, we invite you to join us.

This position offers remote setup with the flexibility to work from any location in Kazakhstan, whether it's your home or well-equipped offices in Astana, Almaty or Karaganda.

Responsibilities

• Design and implement data pipelines

• Perform data ingestion processes to integrate existing data sources into the new platform

• Participate in platform engineering, including cloud-based solutions to support the architecture, such as ingestion frameworks, platform orchestrators and exploratory environments

• Conduct MLOps activities to build production-ready cloud-based solutions to support existing ML pipelines

• Take part in the design of on-premises to cloud migration activities

Requirements

• Strong production experience in Java, Python or Scala

• Proficiency in SQL

• Understanding of common Big Data challenges (splitability, massive parallel processing, load-balancing, data locality, streaming, etc.) and relevant technologies (Apache Spark, Kafka, NoSQL databases)

• Familiarity with data modeling concepts such as relational/dimensional data, SCD and snowflaking

• Hands-on production experience with any major cloud provider: Azure, AWS or GCP

• B2 English level, both verbal and written

• Hands-on production experience with any major cloud provider: Azure, AWS or GCP

Nice to have

• Competency in common data-related architectures such as Data Hub or Data Lake

• Knowledge of Databricks

We offer/Benefits

We connect like-minded people:

• Delivering innovative solutions to industry leaders, making a global impact 
• Enjoyable working environment, whether it is the vibrant office or the comfort of your own home 
• Opportunity to work abroad for up to two months per year 
• Relocation opportunities within our offices in 55+ countries
• Corporate and social events   

We invest in your growth: 

• Leadership development, career advising, soft skills and well-being programs 
• Certifications, including GCP, Azure and AWS
• Unlimited access to LinkedIn Learning and Udemy
• Free English classes with certified teachers 
• Discounts in local language schools, including online courses for the Kazakh language

We cover it all:

• Participation in the Employee Stock Purchase Plan 
• Monetary bonuses for engaging in the referral program 
• Medical & family care package   
• Six trust days per year (sick leave without a medical certificate)   
• Coverage of psychology sessions of your choice
• Benefits package (sports activities, a variety of stores and services)

EPAM is a team of technologists and innovators united by a passion for technology. In Kazakhstan, we operate across all cities with offices in Astana, Almaty, and Karaganda and work with the world's leading companies from different industries. In 2023, EPAM received the Export Excellence Award at the esteemed Digital Bridge Awards, showcasing our commitment to excellence and innovation.

About the role

At ClickHouse, we believe in making product decisions grounded in data, not gut feelings. To support that, we've built a comprehensive internal data warehouse — read more about it on our blog. It powers analytics, forecasting, and decision-making across every team in the company.

Our stack centers on ClickHouse as the core storage and processing engine, complemented by dbt, Airflow, S3, AWS, Superset, and GitHub Actions. We ingest data from 30+ distinct external sources, process over 2.5 PB of data, and deliver most data marts to business consumers with a 1-hour end-to-end latency - a standard that demands highly optimized, rock-solid transformation pipelines.

We're looking for a Senior Data Engineer to help evolve the DWH platform, push its technical boundaries, and deliver reliable, high-performance data models to business users across the organization.

Key Responsibilities

1. DWH Platform Development

   • Design and develop reusable Airflow components - operators, connectors, and hooks - along with custom integrations tailored to our data architecture.

   • Build reusable dbt macros and abstractions: incremental strategies, ETL building blocks, and generic data quality tests, all optimized for ClickHouse-specific behavior and our data patterns.

   • Develop DataOps tooling - CI pipelines, data migration frameworks, and security controls - with a strong focus on reliability, self-service usability, and scale.

2. Team contributions

   • Conduct thorough code reviews for team members and other team contributors.

   • Actively participate in technical and architectural design discussions.

   • Drive technical leadership in specific areas of our stack.

   • Continuously improve the team's development environment, with a focus on automation - including AI-assisted workflows.

   • Contribute to platform stability through proactive troubleshooting and timely incident resolution.

3. Data modeling

   • Develop, refactor, and optimize business data models in line with our modeling standards and ClickHouse best practices.

   • Mentor and support contributors through code reviews and technical guidance.

   • Lead the design and implementation of the most technically demanding data marts - particularly those involving high data velocity, large volumes, or complex business logic.

Qualifications

Required:

• Exceptional SQL skills - this is non-negotiable.

• Strong hands-on experience with Airflow, dbt, and Python.

• Proven track record building and optimizing large-scale, high-throughput data pipelines.

• Solid understanding of data warehousing fundamentals: ETL/ELT, dimensional modeling, and data quality.

• Bachelor's degree in Computer Science or a related field.

• Comfortable thriving in a fast-paced startup environment — exciting and dynamic, but sometimes wonderfully chaotic.

Preferred:

• Hands-on experience with ClickHouse - a significant advantage.

• Familiarity with AWS or other cloud platforms.

• Experience with CI/CD development, especially using GitHub Actions.

Perks

• Flexible work environment - ClickHouse is a globally distributed company and remote-friendly. We currently operate in over 25 countries.

• Healthcare - Employer contributions towards your healthcare.

• Equity in the company - Every new eligible team member who joins our company receives equity.

• Time off - Flexible time off in the US, generous entitlement in other countries.

• A USD$500 Home office setup if you’re a remote employee.

• Global Gatherings – We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites.

Culture - We All Shape It

As part of a rapidly scaling start-up, you will be instrumental in shaping our culture.

Are you interested in finding out more about our culture? Learn more about our values here. Check out our blog posts or follow us on LinkedIn to find out more about what’s happening at ClickHouse.

Equal Opportunity & Privacy

ClickHouse provides equal employment opportunities to all employees and applicants and prohibits discrimination and harassment of any type based on factors such as race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Please see here for our Privacy Statement.