• Design, develop, and implement scalable and reliable data solutions on the Microsoft Azure platform.
• Collaborate with cross-functional teams to gather and analyze data requirements.
• Design and implement data ingestion pipelines to collect data from various sources, ensuring data integrity and reliability.
• Perform data integration and transformation activities, ensuring data quality and consistency.
• Implement data storage and retrieval mechanisms, utilizing Azure services such as Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
• Monitor data pipelines and troubleshoot issues to ensure smooth data flow and availability.
• Implement data quality measures and data governance practices to ensure data accuracy, consistency, and privacy.
• Collaborate with data scientists and analysts to support their data needs and enable data-driven insights.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 4+ years of experience with Big Data technologies
• Migrating Data from Snowflake to Databricks
• Exp with Databricks, Snowflake is must with Python scripting and SQL knowledge
• Strong knowledge and experience with Microsoft Azure cloud platform.
• Proficiency in SQL and experience with SQL-based database systems.
• Experience with batch and data streaming.
• Hands-on experience with Azure data services, such as Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
• Experience using Azure Databricks in real-world scenarios is preferred.
• Experience with data integration and ETL (Extract, Transform, Load) processes.
• Strong analytical and problem-solving skills.
• Good understanding of data engineering principles and best practices.
• Experience with programming languages such as Python or Scala.
• Relevant certifications in Azure data services or data engineering are a plus.