Job Description
Azure Data Engineer, you'll be responsible for designing, implementing, and managing data solutions on the Azure platform.
Responsibilities
- To meet data processing and analytics requirements, design and create SQL queries, stored procedures, functions, and views.
- To make SQL code for data extraction, transformation, and loading operations as efficient as possible, collaborate closely with data engineers and data scientists.
- To ensure effective data retrieval and processing, troubleshoot and optimize database performance.
- Design and maintain data models in conjunction with the data engineering team to ensure consistency and integrity of the data.
- Create and keep up with documentation for database schemas, data models, and SQL code.
- Developing, managing, and optimizing robust and reliable data pipelines using azure native capabilities.
- Implement ADF workflows that perform data ingestion, data integration/ETL, statistical model executions etc.
- Creating architecture for data solutions with high performance characteristics Bringing data and analytics products to production.
Requirements
- Should have minimum of 2+ years of experience in Cloud Data Engineering
- Experience with Azure cloud Platform (mandatory).
- Must have Python experience as a data Engineer.
- Provide technical expertise in the design and development using Azure Cloud
- Should have Built pipelines on Azure Data factory and related component.
- Programming on Databricks using both SQL and Python.
- Should have good understanding of SQL. Well versed with SQL quires
- Creating and configuring Database.
- Experience in using Azure services and tools to ingest, egress, and transform data from multiple sources.
- In-depth technical knowledge of tools like Azure Data Factory, Azure Data bricks, Azure storage, Azure Synapse etc.
- Delivered ETL solutions including data extraction, transformation, cleansing, data integration and data management.
- Designed ingestion layer for structured & unstructured data & implement specific data model for business & analytics use.
- Implemented batch & near real-time data ingestion pipelines.
Benefits
- Career Development
- Competitive Salary
- Flexible Hours
- Health Insurance
- Performance based Rewards