Data Engineer (Python)

Location

Manila-based with a hybrid-first setup; fully remote work is possible for eligible roles, with core collaboration hours from 12:00 to 19:00 Manila time (UTC+8).

About the company

A technology-driven financial company building a banking and lending platform across Southeast Asia, beginning in the Philippines. It serves millions of users through a large app and partner network, combining global fintech expertise with local market knowledge.

Responsibilities

• Design and operate batch and streaming data pipelines on Databricks and Apache Spark over AWS, ingesting from databases, APIs, and event streams.
• Shape lakehouse architecture on S3 and Delta Lake, including medallion Bronze/Silver/Gold layering and storage optimization.
• Own projects end to end, from stakeholder alignment and design review through implementation, launch, and ongoing support.
• Build self-service, scalable ETL/ELT solutions and maintain governance and access control with Unity Catalog, including PII handling.

Requirements

• Hands-on Databricks experience and strong Apache Spark skills, with PySpark and/or Scala.
• Strong Python for data engineering, plus SQL and Spark SQL for transformation and analytics.
• Experience with Delta Lake and lakehouse architectures, including performance optimization of Spark jobs and storage formats such as Parquet and Delta.
• Proven project ownership and clean, testable, maintainable code with Git-based version control; infrastructure-as-code experience such as Terraform or Ansible is a plus, not required.

Наша команда отвечает за качество моделей TTS в GigaChat – той части нейросети, которая занимается звуком. Сейчас мы ищем ребят, которые будут работать над базовым качеством, мультимодальным Гигачатом и другими классными проектами.

Первый этап отбора на эту вакансию – общение с AI-рекрутером. После отклика вам на почту и в чат на платформе HeadHunter придет приглашение пройти первичное интервью с ГигаРекрутером в Telegram. Диалог займёт примерно 10 минут. Его задача — уточнить недостающие детали и ускорить рассмотрение вашей кандидатуры. ГигаРекрутер только начинает свой путь, поэтому просим относиться с пониманием. Ваш опыт и участие помогут сделать его удобным и полезным!

Писать пайплайны обработки аудио/видео данных.

Хотим обрабатывать десятки тысяч часов в день на кластере

инферить опенсорсные и внутренние модели на гпу (денойзер, распознавание, тулы для оценки качества аудио)

поддержка сетевого хранилища данных

• python и алгоритмы на хорошем уровне

• опыт с multithreading и multiprocess

• опыт обучения и/или инференса тяжелых моделей на нескольких гпу

• s3, dvc, git

• гибридный или удаленный формат работы

• ежегодный пересмотр зарплаты и годовая премия

• корпоративный спортзал и зоны отдыха

• более 400 образовательных программ СберУниверситета для профессионального и карьерного развития

• расширенный ДМС, льготное страхование для семьи и корпоративная пенсионная программа

• гибкий дисконт по ипотечному кредиту, равный 1/3 ключевой ставки ЦБ

• бесплатная подписка СберПрайм+, скидки на продукты компаний-партнеров

We are seeking an open-minded Senior Data Software Engineer to drive the development and maintenance of our data-driven architecture.

In this role, you will work on developing pipelines to build business-related data products and designing cloud-based platform solutions to support DataHub functionality. If you’re passionate about shaping the future of data engineering and thrive in an environment where innovation and collaboration are key, we invite you to join us.

This position offers remote setup with the flexibility to work from any location in Kazakhstan, whether it's your home or well-equipped offices in Astana, Almaty or Karaganda.

Responsibilities

• Design and implement data pipelines

• Perform data ingestion processes to integrate existing data sources into the new platform

• Participate in platform engineering, including cloud-based solutions to support the architecture, such as ingestion frameworks, platform orchestrators and exploratory environments

• Conduct MLOps activities to build production-ready cloud-based solutions to support existing ML pipelines

• Take part in the design of on-premises to cloud migration activities

Requirements

• Strong production experience in Java, Python or Scala

• Proficiency in SQL

• Understanding of common Big Data challenges (splitability, massive parallel processing, load-balancing, data locality, streaming, etc.) and relevant technologies (Apache Spark, Kafka, NoSQL databases)

• Familiarity with data modeling concepts such as relational/dimensional data, SCD and snowflaking

• Hands-on production experience with any major cloud provider: Azure, AWS or GCP

• B2 English level, both verbal and written

• Hands-on production experience with any major cloud provider: Azure, AWS or GCP

Nice to have

• Competency in common data-related architectures such as Data Hub or Data Lake

• Knowledge of Databricks

We offer/Benefits

We connect like-minded people:

• Delivering innovative solutions to industry leaders, making a global impact 
• Enjoyable working environment, whether it is the vibrant office or the comfort of your own home 
• Opportunity to work abroad for up to two months per year 
• Relocation opportunities within our offices in 55+ countries
• Corporate and social events   

We invest in your growth: 

• Leadership development, career advising, soft skills and well-being programs 
• Certifications, including GCP, Azure and AWS
• Unlimited access to LinkedIn Learning and Udemy
• Free English classes with certified teachers 
• Discounts in local language schools, including online courses for the Kazakh language

We cover it all:

• Participation in the Employee Stock Purchase Plan 
• Monetary bonuses for engaging in the referral program 
• Medical & family care package   
• Six trust days per year (sick leave without a medical certificate)   
• Coverage of psychology sessions of your choice
• Benefits package (sports activities, a variety of stores and services)

EPAM is a team of technologists and innovators united by a passion for technology. In Kazakhstan, we operate across all cities with offices in Astana, Almaty, and Karaganda and work with the world's leading companies from different industries. In 2023, EPAM received the Export Excellence Award at the esteemed Digital Bridge Awards, showcasing our commitment to excellence and innovation.