P

Member of Technical Staff (Backend Software Engineer, Search Crawler)

We are seeking an experienced Backend Software Engineer to join our Crawler team. In this role, you will design, develop, and operate systems that ingest, process, and manage web-scale data in support of our next generation of advanced sea…

perplexity

Зарплата не указанаСербияBelgrade

We are seeking an experienced Backend Software Engineer to join our Crawler team. In this role, you will design, develop, and operate systems that ingest, process, and manage web-scale data in support of our next generation of advanced search technologies. This is a critical, high-impact engineering position, requiring expertise across both backend and frontend components of our data acquisition stack.

Responsibilities

  • Take ownership of and lead projects focused on developing large-scale web crawlers, ingestion pipelines, and data processing systems.
  • Build, maintain, and optimize core backend and frontend components for crawler services, including storage, retrieval, and UI dashboards for data management.
  • Collaborate closely with Search and Infrastructure teams to ensure the reliable, high-quality ingestion and processing of billions of web pages.
  • Architect and implement fullstack features and scalable distributed systems that handle high-load and real-time data operations.
  • Rapidly iterate, experiment with novel approaches, and continuously enhance system performance, usability, and reliability.

Qualifications

  • Minimum of 5 years of software development experience, with strong knowledge of data structures and algorithms in at least one of the following languages: Python, C++, Rust, or Go.
  • Experience with large-scale web crawlers is highly desirable.
  • Proven experience building, deploying, and optimizing high-load, distributed, and hardware-adjacent services.
  • Deep understanding of cloud infrastructure, with hands-on experience in Kubernetes (K8s) and AWS.
  • Demonstrated passion for writing clean, efficient, and scalable systems.

Похожие вакансии Go

Сайты компаний
C

Senior Software Engineer - Go SDK - Language Clients

clickhouse
Зарплата не указанаПольшаГерманияНидерландыИспанияПортугалияСШАКанадаФранцияИзраильИталияBerlinTorontoBrooklynУдалёнка
Локации (удалёнка):BerlinTorontoBrooklyn

Удалённая работа — географически не привязана. Щёлкни по любой из локаций, чтобы открыть оригинальную карточку.

About the team

The Integrations Ecosystem org builds the drivers, SDKs, connectors and BI integrations that make ClickHouse feel native in any stack. The Language Clients team maintains the official clients for Python, JavaScript, Java, Go, Rust, C++ and C#, plus the ODBC, JDBC and ADBC drivers. We're small, senior and remote across North America and EMEA.

The role

We're looking for a product-minded engineer to own ClickHouse's Go clients. You'll decide what the clients should do by talking to the developers who use them, reading the issues and the telemetry, and listening to the community. Then you'll build it, with deep Go expertise, and measure whether it worked. Your scope is the SDK and what builds on it: clickhouse-go and ch-go, and the collectors, pipelines, agents and tools that write millions of rows per second through your code.

What you'll do

  • Know who uses the clients and what they're trying to do. Define what good looks like (time to first query, error clarity, throughput, adoption by key integrations), measure it, and let that drive the roadmap.

  • Be the voice of ClickHouse for Go developers. Speak at GopherCon and Go meetups, and write the posts, tutorials and examples that developers and AI assistants find when they search for how to use ClickHouse from Go (SEO and GEO). Answer questions where the community asks them.

  • Own the Go clients and their ecosystem: clickhouse-go, ch-go, database/sql, releases and support. Evolve them without breaking the people who depend on them.

  • Keep the clients the fastest Go option for the fastest analytical database, and make sure the client is never the bottleneck. Performance is part of every release, not an afterthought: profile, change, measure again, catch regressions in CI, and publish the numbers.

  • Partner with the projects built on the clients, from the OpenTelemetry Collector to ClickHouse Grafana datasource and ClickPipes, and catch their regressions before they ship.

  • Review and co-maintain other clients, and take part in cross-client decisions on types, errors and protocol features.

  • Bring written proposals about where we invest next. You set direction rather than wait for it.

  • Make the clients enterprise-ready: TLS and mTLS, cloud authentication, safe credential handling, vulnerability response, a small dependency footprint, and the questions large Go shops ask before they adopt.

  • Shape the clients for agents as users: an API, docs and error messages an AI coding agent can use correctly on the first try.

  • Extend our AI development platform, with new workflows for maintaining the clients: consistency checks across languages, issue triage, release checks.

About you

  • Product-minded with a bias for action. You'd rather run an experiment and bring back data than wait for approval, you measure whether it worked, and you can explain what you chose not to build.

  • 5+ years in software, much of it on data-intensive systems: drivers, SDKs, ingestion, streaming, observability or analytics.

  • Deep Go expertise: the runtime and garbage collector, escape analysis, the memory model, pprof and the execution tracer. You reason about throughput and latency down to allocations and bytes on the wire, and you prove it with tests and benchmarks.

  • Strong Go concurrency instincts: context, goroutines and channels, bounded pools, backpressure, clean shutdown, and the leaks and races that come with each.

  • Beyond Go, productive in at least one more of our client languages (Python, JavaScript, Java, Rust, C++, C#). You'll review and co-own across clients.

  • You've built or substantially extended a Go module other engineers depend on. You understand semantic import versioning and treat breaking changes accordingly.

  • Strong grasp of database fundamentals: SQL, query execution and analytical workloads. Judgment about when to use database/sql and when to drop down to the protocol.

  • Enthusiastic about working in public. You've given talks or written technical content, or you're keen to, and you see it as part of the job rather than a distraction from it.

  • Thoughtful use of AI development tools, with the judgment to review what comes out.

  • Clear writing. Most coordination happens in design docs, PRs and RFCs.

Nice to have

  • ClickHouse, especially its type system and native format, or another columnar or OLAP engine.

  • Contributions to Go data or observability infrastructure: OpenTelemetry, Prometheus, Grafana, Kafka clients, database drivers.

  • Building or maintaining a database/sql driver.

  • Apache Arrow or ADBC in Go.

  • Experience designing SDKs, docs or error messages with AI coding agents as the consumer.

  • Protocol or wire-format work on a database driver or network client.

Learn more

Perks

  • Flexible work environment - ClickHouse is a globally distributed company and remote-friendly. We currently operate in over 25 countries.

  • Healthcare - Employer contributions towards your healthcare.

  • Equity in the company - Every new eligible team member who joins our company receives equity.

  • Time off - Flexible time off in the US, generous entitlement in other countries.

  • A USD$500 Home office setup if you’re a remote employee.

  • Global Gatherings – We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites.

Culture - We All Shape It

As part of a rapidly scaling start-up, you will be instrumental in shaping our culture.

Are you interested in finding out more about our culture? Learn more about our values here. Check out our blog posts or follow us on LinkedIn to find out more about what’s happening at ClickHouse.

Equal Opportunity & Privacy

ClickHouse provides equal employment opportunities to all employees and applicants and prohibits discrimination and harassment of any type based on factors such as race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Please see here for our Privacy Statement.

Сайты компаний
vk

Backend-инженер

vk
Зарплата не указанаРоссияМосква
Группа интеграций технической платформы рекламы отвечает за парсинг, обогащение, а также роутинг запросов рекламы в различные движки подбора. VK Реклама имеет множество API и внешних интеграций — как SSP, так и DSP. Слаженная работа всех компонентов в реальном времени обеспечивается на уровне графа компонентов SSP. Это позволяет подбирать максимально релевантную рекламу для зрителя за доли секунды. Нужен специалист по техническому развитию данной компоненты.

Задачи

  • Реагирование на инциденты, обеспечение надёжности и безопасного деплоя сервисов
  • Внедрение целевых технологий в сервисы VK Рекламы: трейсинг запросов через AppTracer во всех компонентах системы
  • Перевод взаимодействия между микросервисами подбора на графовую модель Service Host
  • Обновление высоконагруженного хранилища пользовательских кук (более 650k RPS): отказ от железных тарантулов в пользу облачного Redis

Требования

  • Уверенное владение Go (Golang) и Python, опыт создания и эксплуатации высоконагруженных сервисов
  • Опыт самостоятельного проектирования сервисов и API, понимание компромиссов между производительностью, надёжностью и сложностью сопровождения
  • Хорошее понимание конкурентной обработки, многопоточности, сетевого взаимодействия и управления ресурсами
  • Знание принципов распределённых систем: партиционирование, репликация, согласованность данных, идемпотентность и гарантии доставки событий
  • Опыт работы с базами данных и кешами, умение выбирать хранилище под профиль нагрузки и требования к задержкам
  • Практический опыт профилирования, нагрузочного тестирования и диагностики проблем в продакшене
  • Опыт работы с Linux, Docker, Git, автоматизированным тестированием и CI/CD
  • Желательно: практический опыт работы с Kafka — проектирование топиков и партиций, настройка producers и consumers, понимание consumer groups и гарантий доставки событий
  • Желательно: опыт работы с Redis для кеширования, хранения оперативных данных и счётчиков; понимание TTL, политик вытеснения и атомарных операций
Сайты компаний
ozon
Зарплата не указанаРоссияМосква

Привет! Это команда QA платформа. 

Мы создаём инструменты для развития инфраструктуры QA в Ozon. Мы разрабатываем Test Manager System, фреймворки для Go, Python и TypeScript, метрики, CLI-инструменты для репортинга, агентские инструменты для работы с тестами и многое другое. 

Наш стек

  • Go, Python, TypeScript, Vue, PostgreSQL, Redis, Kafka, Cassandra, ClickHouse, S3. 

Вы будете

  • Создавать и развивать инструменты для инфраструктуры QA в Ozon. 

  • Развивать систему обработки тестовых отчетов и тест-кейсов, пропускающую через себя сотни миллионов тестов ежедневно. 

  • Автоматизировать QA процессы в компании, создавать и развивать инструменты стандартизации, а так же заниматься внедрением этих процессов и инструментов на тысячи пользователей. 

  • Работать в команде, которая любит вызовы и готова создавать новое. 

Примеры задач

  • Оптимизация аплоада сотен миллионов файлов при нагрузке в тысячи RPS и трафике десятки гигабайт в секунду. 

  • Создание системы менеджмента тестовых пайплайнов для оптимизации запусков и оптимизации времени исполнения тестов. 

  • Интеграция с системами трейсинга для построения карты взаимодействий между разными сервисами и подсчёта покрытия межсервисных взаимодействий. 

Нам важно

  • Опыт разработки на Go. 

  • Понимание высоконагруженных систем и умение работать с большими объёмами данных. 

  • Знание инструментов для работы с очередями и базами данных: Kafka, Cassandra, ClickHouse, Redis, PostgreSQL. 

  • Опыт работы с S3-хранилищами. 

  • Умение создавать и развивать инструменты для автоматизации и тестирования. 

HireSeeker собирает вакансии со всех площадок и присылает только релевантные. Бесплатно.