Key Responsibilities:

• Design, develop, and maintain data pipelines using Delta Lake/Lakehouse architectures.

• Utilize Databricks for data processing, analysis, and machine learning model development.

• Create and manage interactive dashboards to visualize data and provide actionable insights.

• Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.

• Conduct data analysis to identify trends, patterns, and anomalies.

• Implement best practices for data governance, security, and performance optimization.

• Stay current with industry trends and emerging technologies in data science and Delta Lake/Lakehouse ecosystems.

Required Skillsets:

• Master’s degree in computer science, Data Science.

• 0-2 years of working experience with Delta Lake/Lakehouse technologies.

• Databricks Certified Data Engineer Professional certification required.

• Proven experience in developing interactive dashboards using StreamLit or Solara.

• Hands on programming experience in Python, SQL, and other relevant languages.

• Direct working experience with Unix, Jit, and Jenkins.

• Excellent problem-solving skills and attention to detail.

Preferred Qualifications:

• Experience with cloud platforms such as AWS, Azure, or Google Cloud.

• Knowledge of big data frameworks (e.g., Apache Spark).

• Experience with machine learning and statistical analysis.

• Familiarity with ETL processes and data integration techniques.

• Excellent problem-solving skills and attention to detail.