Job Opportunity
We are seeking a talented Data Developer to join our high-end technology team, focusing on a cutting-edge product leveraging Generative AI.
This role involves working in a dynamic and innovative environment, utilizing Azure cloud services, including ADLS2, and dealing with complex data structures in SQL and NoSQL databases.
Key Responsibilities:
* Implement and manage data solutions in Azure Cloud, focusing on ADLS2, SQL, and NoSQL databases.
* Develop and oversee data governance and data modeling strategies, ensuring compliance with industry standards and regulations.
* Handle data processing tasks including ETL, using tools like Azure Databricks, while ensuring data lineage is documented and traceable.
* Engage in data streaming and real-time data processing, ensuring scalability for growing data needs.
* Write and maintain scripts primarily in PySpark, ensuring adherence to data contracts and quality standards.
* Troubleshoot and resolve data-related issues, ensuring minimal disruption to operations.
* Propose and implement best practices in data engineering, emphasizing maintainability and scalability of data solutions.
* Collaborate closely with data scientists, analysts, software engineers, and business stakeholders to align data solutions with business objectives, ensuring effective communication of data governance and lineage aspects.
Qualifications:
* Proven experience in data engineering and analytics, preferably in a high-tech environment.
* Strong proficiency in PySpark, Python, and familiarity with Azure cloud services.
* Solid understanding of ADLS2, SQL and NoSQL databases, data governance, and data modeling principles.
* Experience with ETL processes, Azure Databricks, and data streaming.
* Familiarity with data contracts, ensuring that data provided meets the agreed-upon quality and format standards.
* Ability to implement scalable data solutions that can adapt to growing data volumes and complexity.
* Ability to stay updated with the latest trends and technologies in data engineering and analytics.
* Capable of troubleshooting and problem-solving in data-related operations.
* Excellent collaboration skills to work effectively with cross-functional teams.
Preferred Skills:
* Additional experience with other programming languages.
* Prior work in a similar Generative AI environment.
* Certifications or formal training in Azure cloud services and data engineering tools.
* Strong communication skills to effectively articulate technical concepts and solutions, especially regarding data governance and lineage.
* Collaborate with compliance teams to ensure data practices adhere to legal and regulatory requirements, particularly concerning data privacy and protection.
* Foster a culture of data quality and integrity through regular audits and monitoring of data processes.
About Us
Autoridade em transformação tecnológica e soluções de negócios inteligentes. Nosso compromisso é oferecer valor único aos nossos clientes, parceiros e colaboradores. Estamos sempre procurando por talentos que sejam focados em inovação e mudança.
Benefícios
* Plano de saúde e odontológico;
* Vale alimentação e refeição;
* Auxílio-creche;
* Licença paternagem estendida;
* Wellhub (Gympass);
* TotalPass;
* PLR;
* Seguro de Vida;
* CI&T University;
* Clube de descontos;
* Plataforma online gratuita dedicada à promoção da saúde física, mental e bem-estar;
* Curso gestante e paternagem responsável;
* Parceria com plataformas de cursos online;
* Plataforma para aprendizagem de idiomas;
* E muitos outros.
Mais detalhes sobre os nossos benefícios aqui:
A colaboração é nosso superpoder, diversidade nos une, e a excelência é nosso padrão. Valorizamos a diversidade de identidades e experiências de vida, fomentando um ambiente de trabalho diverso, inclusivo e seguro. Incentivamos a candidatura de pessoas de comunidades diversas e sub-representadas às nossas vagas. #J-18808-Ljbffr