My Find a Job in Dubai 2024: Top Job Portals, Visa, Salary Guide & Application Tips

Job Description

Overview of the role

As an Data engineer in our team, you will be responsible for governing solutions, assessing complex new data sources with various SAP and non-SAP source systems, and quickly turning these into business insights-ready data sets. You will participate in new scope & requirements, break-fix work, testing, and support activities to meet the business needs. Implementing appropriate processes to drive high-quality and sustainable solutions will be critical.

 

What you will do

  • Partners with the product owner, scrum master and solution architect to deliver solutions.
  • Understanding the business requirements.
  • Responsible for reviewing and analyzing business requirements and designing technical solutions.
  • Responsible for governance of the technology implementation of the solution designs
  • Collaborate with internal and external implementation team members and partners to develop, test, and deploy solutions.
  • Adheres to software development and maintenance standards by thoroughly understanding internal and external development best practices.
  • Estimate and deliver multiple project assignments and system change requests with the required quality according to agreed-upon resourcing and timelines.
  • You must analyze structured, semi-structured, and unstructured data sources in detail for quality, completeness, and business value.
  • Responsible for governance and implementing robust data pipeline using Microsoft toolset and Databricks.
  • Responsible for creating reusable and scalable data pipelines.

Skills

Required skills to be successful

  • Expertise in data ingestion, data processing, and analytical pipelines for big data, relational / non-relational databases, and data warehouse solutions
  • Experience in designing and hands-on development in cloud-based analytics solutions.
  • Designing and developing warehouse solutions using Azure Synapse Analytics, ADLS, ADF, Databricks, Power BI, and Azure Analysis Services.
  • Build workflows using data from various sources, including on-premises databases and external data sources with rest APIs and harvesting tools.
  • Strong analytic skills related to working with unstructured datasets.
  • Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential.
  • Hands-on experience with Agile software development
  • Thorough understanding of Azure / AWS Cloud Infrastructure offerings.
  • Expertise in Azure Stream Analytics is desirable.
  • Knowledge of Scala is desirable.

 

What equips you for the role

  • Relevant 8+ years of experience in Azure and Databricks.
  • Minimum 5+ years of implementation experience from conceptualization to delivery of analytics capabilities on the Azure platform.
  • Bachelor’s degree in computer science or an allied field of study.
  • Knowledge of SAP BW/BO, Tableau, Power BI, and Scala will be considered as an added advantage.
  • Certification on Azure platform toolsets will be considered an added advantage.

source

Leave a Reply

Your email address will not be published. Required fields are marked *