Senior Data Engineer

About the role

Endava's data team covers engineering, analysis, architecture, modelling, machine learning, AI and data science, turning raw data into actionable insights and building robust data infrastructure. As a Senior Data Engineer in Skopje, you will design, build and maintain data pipelines using a medallion architecture, combining hands-on development, data modelling, production support and technical leadership. You will work closely with development and data teams, product owners and business stakeholders.

Key responsibilities

• Work with analysts and stakeholders to understand source systems, data flows, business processes and reporting requirements, clarifying business rules and challenging unclear assumptions.
• Design, build and maintain ETL/ELT pipelines in Azure Databricks using Python, PySpark and SQL.
• Implement bronze, silver and gold data layers, covering raw data ingestion, cleansing, validation and preparation for reporting.
• Develop curated datasets and dimensional models, made available through Microsoft Fabric for Power BI reporting.
• Implement incremental processing and manage schema changes, duplicates, missing values and late-arriving data.
• Provide technical guidance and mentoring, lead code and design reviews, and support consistent development, testing and CI/CD practices.
• Contribute to product and delivery discussions by explaining technical trade-offs, identifying data dependencies and helping prioritise work.
• Document data models, transformations, lineage, dependencies and operational procedures.

Required profile

• 7+ years of experience in data engineering, including designing, building, deploying and supporting production data pipelines.
• Good understanding of data warehousing and dimensional modelling, including table grain, facts, dimensions and historical changes.
• Experience orchestrating and monitoring data pipelines, and with automated testing, data validation, Git and CI/CD.
• Ability to take ownership of technical decisions, review designs and code, and guide other engineers.
• Ability to understand business processes and product priorities, and to explain technical choices to users and stakeholders.
• Ability to work independently and collaborate effectively in English.

Required skills

• Strong Python and SQL, with hands-on PySpark and Spark SQL in Azure Databricks.
• Microsoft Fabric, especially curated data via OneLake, lakehouses or warehouses.
• Working knowledge of Azure storage, access management and secure credential handling.
• Nice to have: Snowflake, enterprise data modelling, logistics/transportation or supply chain data, AI development tools.

What we offer

• Competitive salary package, share plan, company performance bonuses and referral bonus.
• Career coaching, global career opportunities and internal development programmes.
• Training, certifications, online learning platforms, workshops and conferences.
• Hybrid work and flexible working hours, plus a wellbeing programme.