Job Description

Role- Azure Data Engineer

Location- Phoenix ,AZ (Only Local)

Lon Term Contract

Overview:

The client is seeking a highly skilled Data Engineer with extensive experience in Azure Databricks and data engineering . This person will be responsible for designing, developing, and maintaining data pipelines, ensuring data quality, and optimizing code for performance. They should have strong experience with Azure-based services, particularly Data Lake Storage and SQL Data Warehouse , and be able to handle complex data engineering tasks. The ideal candidate should be able to work independently, communicate effectively with stakeholders, and deliver high-quality results within set timelines. Additionally, the role requires expertise in data governance, data modeling, and troubleshooting technical issues, along with strong attention to detail and a problem-solving mindset.

1. Business Requirements Interpretation : The candidate must be able to interpret business requirements and work closely with both internal teams and external application vendors.
2. Data Modeling & Quality : Designing, developing, and maintaining data models and data quality rules to meet business needs.
3. Troubleshooting : Addressing and resolving data-related issues, ensuring high data quality and integrity.
4. Optimizing Data Code : Reviewing and optimizing PySpark/Python code for better performance, including SQL queries and scripts.
5. Documentation & Code Maintenance : Writing clean, efficient, and well-documented code. Maintenance of custom code and processes.
6. Collaboration & Communication : Collaborating with stakeholders and teams to solve data-related issues, and delivering training and release notes to end-users.
7. Quality Assurance : Ensuring all tasks adhere to service level agreements (SLA) and turnaround times (TAT), including performing quality checks.

1. Experience with Databricks and Azure : At least 8 years of data engineering experience, with expertise in Azure Databricks , MSSQL , LakeFlow , Python , and other Azure technologies.
2. Data Pipeline Development : Designing and building scalable data management systems using Azure Databricks , including creating data processing pipelines and ETL workflows .
3. Integration Skills : Experience integrating Databricks with other Azure services like Azure Data Lake Storage and Azure SQL Data Warehouse .
4. SQL & PySpark Proficiency : Strong experience with Spark SQL , PySpark , and writing optimized SQL queries and Python scripts for data processing.
5. Data Governance & Data Models : Designing and implementing data models , schemas, and data governance in the Databricks environment.
6. Data Warehousing & Data Quality : In-depth understanding of data warehousing concepts and experience implementing data quality rules using Databricks and tools like IDQ (Informatica Data Quality).
7. Analytical & Problem-Solving Skills : Strong organizational, analytical, and problem-solving skills with a keen attention to detail.
8. Communication Skills : Excellent communication skills to engage with both technical and non-technical stakeholders effectively.
9. Independent Work & Team Collaboration : Ability to work independently with minimal supervision, while also collaborating well within teams.

Job Tags

Similar Jobs