We are seeking a highly skilled and motivated Data Engineer to join the Enterprise Data & AI team. In this role, you will play a crucial part in designing, building, and maintaining the data pipelines that power our predictive & descriptive use cases.
You Will:
* Design, build and maintain robust & scalable data pipelines to feed descriptive analytics, predictive analytics, and reporting use cases.
* Construct meaningful data assets sourced from structured, semi-structured, and unstructured data.
* Ensure data quality, accuracy and integrity of the data assets created.
* Automate the data pipelines end to end.
* Participate in data modeling and schema design.
* Work closely with business partners, data scientists & BI team to understand the business process and data needs to translate them into an effective data solution.
* Collaborate with Stakeholders, Analysts, Data Scientists to understand the data requirements & deliver optimal solutions.
* Collaborate with cross-functional teams to identify the right data sources for the use cases.
* Perform data discovery and analysis on various data sources.
* Find and tell the compelling narrative of the data that aligns to the intended audience.
* Create and maintain Data Dictionary for the data pipelines.
* Participate in code reviews and documentation efforts to maintain high-quality code and data documentation.
You Have:
* 3-5 Bachelors' degree in STEM related field or equivalent.
* At least 4 years of experience in Data Engineering or similar role.
* Strong understanding of data engineering principles, standard methodologies, and software development life cycle.
* Proficiency in SQL, Python, PySpark and bash scripts.
* Knowledge of Databricks.
* Experience with the design and development of ETL/ELT process.
* Experience working in a Data warehouse.
* Understanding of Data modeling and in particular Dimension modeling.
* Strong analytical and problem-solving skills.
* Excellent communication and collaboration skills to work across multiple groups within the organization.
* Experience with Alteryx.
* Experience in the insurance industry.
* Experience with Databricks Workflows.
Location & Travel:
Seniority level
* Associate
Employment type
* Full-time
Job function
* Information Technology
Industries
* Insurance
#J-18808-Ljbffr