<img height="1" width="1" style="display:none;" alt="" src="https://px.ads.linkedin.com/collect/?pid=4958233&amp;fmt=gif">
Data
Brasov+9 more

What's this role about?

Our client is going through an exciting period of change and is seeking highly motivated and experienced Senior Data Engineer to join their Data Engineering team. You will work as part of an exciting greenfield tech hub covering all facets of technology within their organisation. You will be responsible for end-to-end development on the data platform, including test development, to ensure continued service delivery versus expectations. You will understand all engineering stages for a data platform by providing end-to-end, full-stack data expertise from design to build. You will be a leading member of the team, helping to develop and mentor junior members as well as input into design and architectural decisions. If you're looking for an exciting opportunity to step out of your comfort zone and make a real impact by building better software, this is the job for you!   *Key Responsibilities:* * Work together with data scientists and analysts to understand the needs for data and create effective data workflows * Solution design, implement, and maintain data pipelines for data ingestion, processing, and transformation using could services and other technologies * Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage. * Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations. * Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data. * Improve the scalability, efficiency, and cost-effectiveness of data pipelines. * Monitoring and resolving data pipeline problems, ensuring  consistency and availability of the data. * Automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.)

What skills and experience do you need?

*Required skills:* * Proficient in *Python* and SQL, with experience in data scripting languages. * Strong experience with Relational and NoSQL databases. * Knowledge of good data design principles (concepts such as Kimball and Star Schema), data warehousing concepts and data modelling. * Strong understanding of ETL/ELT processes. * Exposure to advanced data transformation and optimization techniques, including *Spark* (Pyspark/Scala). * Familiarity with testing frameworks like Pytest/Unitest. * Experience with *Azure services* such as Azure Data Factory, Azure Databricks, Azure Blob Storage, Azure Dataflow, Azure Functions, Azure KeyVault, and Azure DevOps. * Proficiency in tools like *Data Build Tool* and Datadog. * Exposure to data monitoring and observability tools. * Relevant experience with Event-Driven Architecture * Good understanding of Agile ways of working  #LI-Hybrid

Apply now

Join our

team

Ready to create your own Endava story? Your journey starts here!
Life at Endava

Our global community

We’re a diverse group of people who share, create and connect over projects and beyond in the communities we live in. Working across 28 countries in six continents, we aim to be a force for good locally and turn our passions into drivers of change.

Interesting? We love when people share.

Learn more about the opportunities and life at Endava

Contact us now!