We are looking for a hands-on Leading / Senior Data Engineer to own critical ingestion and lakehouse workflows in a high-throughput, production-grade data platform. + ' ' + Degree in computer science, information science, engineering, mathematics, or related technical discipline5+ years experience with SQL and NoSQL technologiesStrong experience working with Oracle and PostgreSQL databasesExtensive experience in ETL development, with strong skills in Python programmingAdvanced knowledge of PySpark for large-scale distributed data processingProficient in Airflow for scheduling, orchestrating and monitoring complex ETL/ELT workflowsExpertise in Kafka for event streaming and messaging pipelinesExperience working with MinIO (S3-compatible storage), managing data in Parquet and Iceberg formatsFamiliarity with Lakehouse conceptsDeep understanding of MPP architecture conceptsThe following experience will be considered as an advantage:Familiarity with Impala for interactive SQL querying on Big DataExperience with GreenplumFamiliarity with containerization (Docker, Kubernetes)Experience with CDC tools like Debezium and Oracle GoldenGate for real-time data replicationExperience with data visualization tools (e.g. Tableau, PowerBI, etc.)Understanding of DataOps and DevOps principlesKnowledge of data modeling and database designExperience with data engineering best practices, such as data security, data access control and data governanceKnowledge of Grafana for monitoring metricsProficient with GitLab for version controlExperience mentoring junior data engineers and collaborating with cross-functional teams (Data Scientists, Analysts, DevOps) + ' ' + Opportunities for professional growth and developmentCompetitive salary and bonusesComprehensive insurance coverageSupportive work environmentVisa Premium salary cardCorporate discounts and eventsAdditional vacation daysDiscounted education and employee loansNew cozy studio office in Port Baku Tower 2Strong teamwork with Agile principles, regular team buildings and themed eventsMulticultural environment with foreign colleagues sharing their best experiences + ' ' + Designing a data lake to process and store an array of (un)structured data loaded from raw sources. Development of the data model - properly store the data and access it as needed for business purposesDevelopment of the integration process - development of integration with various systems so that they can have a single view of key indicators when making decisionsData preparation and ETL - development of a pipeline for extracting, transforming and loading data Developing and monitoring data pipelines to ensure data quality and integrityAutomation and optimization of the data transformation processWorking closely with other teams in the organization to ensure data is available and accessible for analytics and decision-makingKapital Bank iş mühiti, əlavə fürsətlər və digər vakansiyaları görüntüləmək üçün Kapital Bank Life səhifəsinə keçid edin.
