Job Description

• s a Databricks Data Engineer, Candidates will be responsible for designing, implementing, and optimizing data pipelines and workflows using Databricks and other data engineering tools.
• Candidates will work closely with cross-functional teams to ensure data integrity, performance, and scalability, enabling the organization to make data-driven decisions.
• Key Responsibilities: Design, develop, and maintain data pipelines and ETL processes using Databricks, Spark, and other data engineering tools.
• Implement and report on business key performance indicators (KPIs) in data warehousing environments.
• Utilize analytic SQL to work with traditional relational databases and distributed systems.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Optimize data workflows for performance, scalability, and reliability.
• Develop and maintain documentation for data engineering processes and solutions. Ensure data quality and integrity through rigorous testing and validation.

• 4+ years of work experience implementing and reporting on business key performance indicators in data warehousing environments.
• 4+ years of experience using analytic SQL, working with traditional relational databases and/or distributed systems.
• 3+ years of experience with programming languages such as Python and PySpark.
• 3+ years of experience with data orchestration/ETL tools.
• 2+ years of experience with Databricks/Spark and Power BI.
• 2+ years of experience with X12 EDI.
• 2+ years of experience with Azure.

• Strong understanding of data warehousing concepts and best practices. Proficiency in SQL and experience with relational databases.
• Expertise in programming languages like Python and PySpark.
• Experience with data orchestration tools and ETL processes.
• Familiarity with Databricks, Spark, and Power BI. Knowledge of X12 EDI standards in healthcare domain.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Job Tags

Similar Jobs