← Back to list
Senior
Registration: 21.07.2025

Vladlen Lerner

Skills

Python
Scala
Spark
SQL
Hadoop
Apache Airflow

Work experience

Senior Data Engineer
since 10.2024 - Till the present day |Uzum Market
Python, Scala, Kafka, API, ClickHouse, ETL, CI/CD, Jira, Confluence, GitHub
● I build and maintain robust, scalable data pipelines to support the analytics and operational needs of Uzbekistan's leading e-commerce platform. ● Working within a modern three-layer data architecture, I optimize ETL processes, manage data workflows in Airflow, and ensure seamless data ingestion from streaming and batch sources. ● My role bridges engineering excellence with real-world business impact-empowering inventory tracking, marketing intelligence, and analytical reporting through reliable, high-performance data infrastructure. Key Achievements & Technologies: ● Designed and optimized ETL pipelines using Spark (Python & Scala), focusing on scalability and performance. ● Integrated diverse data sources including Kafka (streaming), APIs, S3, and ClickHouse for realtime and batch analytics. ● Developed and maintained Airflow DAGs to orchestrate data workflows and improve reliability. ● Built and maintained dbt models to streamline data transformations and improve pipeline clarity. ● Implemented support for multiple data formats (Avro, Hudi, JSON) within a modular architecture. ● Enhanced ClickHouse with custom dictionary functions and advanced analytics use cases. ● Enabled marketing teams by integrating new external sources and automating campaign performance pipelines. ● Participated in on-call duties (PagerDuty) and ensured system stability and SLA adherence. ● Used tools like Jira, Confluence, GitHub, Drone CI, and go-migrate for collaborative development and DevOps.
Data Engineer
11.2023 - 10.2024 |VEON
Python, Scala, Kafka, API, ClickHouse, ETL, CI/CD, Jira, Confluence, GitHub
● I deliver impactful solutions that enhance business outcomes by leveraging geographical data for location analysis, base station optimization, and event impact evaluation. ● In fintech, I calculate credit scores and analyze customer interest in banking products using offline and online triggers. I also maintain ML models for targeted advertising and KYC purposes. Key Achievements & Technologies: ● Led migration from legacy to modern clusters, implementing architectural solutions. ● Developed and optimized ETL pipelines using Hadoop, Spark (in Scala), Airflow, and other technologies. ● Actively contributed to Agile processes, mentoring interns and enhancing team expertise. ● Solved complex challenges in graph computations, real-time data processing, and system optimization. ● Coordinated a data exchange project for the GSMA conference, boosting Veon's global visibility.
Data Engineer
09.2022 - 10.2023 |Hamkorbank
Python, Scala, Kafka, API, ClickHouse, ETL, CI/CD, Jira, Confluence, GitHub
● I played a pivotal role in building a Hadoop cluster from the ground up on multiple virtual machines with my team. ● Within the Big Data department, we implemented data-driven solutions to support executive decision-making. ● Our team was responsible for developing reports for the Central Bank, providing analytics on mobile app usage, and optimizing the client onboarding system. Key Achievements & Technologies: ● Utilized Apache Spark for efficient data analysis. ● Experimented with Kafka and collaborated with the DevOps team to set up CDC processes using Debezium connectors. ● Automated processes using the Airflow scheduler.
Data Engineer
10.2017 - 08.2022 |VEON
Python, Scala, Kafka, API, ClickHouse, ETL, CI/CD, Jira, Confluence, GitHub
● I collaborated with Big Data teams at a leading telecom operator, focusing on analyzing online store sales to enhance audience reach and boost sales. ● I developed crucial metrics such as ARPU and company revenue for top management. ● Our team created customer profiles through advanced modeling, improved network quality by analyzing signal strength, and utilized geodata to visualize foot traffic on maps. Key Achievements & Technologies: ● Big Data processing using Apache Hadoop and Apache Spark frameworks. ● Remote collaboration within an Agile distributed team. ● Maintained comprehensive documentation and conducted software testing with HiveRunner and ScalaTest. ● Supervised interns, fostering their growth and development.
Researcher
11.2015 - 12.2017 |National University of Uzbekistan
Python, C, C++, Bash
● I contributed to a scientific project focused on IT security for operational systems, adhering to strict GOST standards and following the Waterfall methodology. ● My role involved developing applications to enhance system functionality and conducting stress tests. Key Achievements & Technologies: ● Developed applications to enhance system functionality. ● Conducted stress tests to ensure system resilience. ● Collaborated on a scientific report detailing our findings.

Educational background

Applied Mathematics / Computer Science
Till 2016
Lomonosov Moscow State University

Languages

EnglishUpper IntermediateRussianNative