Role : Data Architect with Databricks
Location : Remote
Seeking a skilled Data Architect to design and implement data architecture solutions for data-centric projects. The role involves leading the development of enterprise data strategies, creating real-time analytics models, managing data pipelines, and optimizing data processing using various technologies.
Key Responsibilities:
• Design and implement data architecture solutions for data-centric projects.
• Lead the development of enterprise data strategies, standards, processes, and tools.
• Create real-time analytics models using DataBricks for actionable insights.
• Manage and schedule data pipelines in Azure Data Factory for seamless data ingestion.
• Optimize data processing and perform transformations using Apache Spark, Scala, and Python.
• Implement Delta Lake and Adaptive Query Execution frameworks for efficient data handling.
• Ensure data security by implementing dynamic data masking in Azure SQL DB.
• Generate insightful reports using Power BI for data visualization.
• Maintain pipeline schedules, triggers, and logs for effective data management.
• Collaborate with cross-functional teams to integrate data communication across platforms for enhanced data insights and decision-making.