Apache Spark / PySpark, AWS, AWS Glue, CloudWatch, Python (Basics), Scala, SQL
As a Senior Data Engineer, you will design and develop data solutions using AWS services such as Glue, Athena, and Lake Formation.
You will work on building, managing, and optimizing data pipelines, ensuring data integrity and accessibility.
This role involves close collaboration with data engineers, data scientists, and other developers to deliver robust, secure, and scalable data architectures.
Requirements? Candidates with 5+ years' experience in software engineering, building large scale systems.
? Experience with the following software/tools is highly desired:
SQL and NoSQL databases like MySQL, Postgres, DynamoDB, ElasticsearchWorkflow management tools like AirflowAWS cloud services: RDS, AWS Lambda, AWS Glue, AWS Athena, EMR (equivalent tools in the GCP stack will also suffice)? Strong programming skills in at least one of the following languages: Python preferred, Java and/or C++ accepted.
? Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques.
? Experience implementing software around data processing, metadata management, ETL, and scaling tools like Airflow and Kubernetes.
? Experience working with cross-functional teams in a fast-paced environment.
? Knowledge of healthcare data pertaining to insurance claims is helpful.
? Ability to translate data needs into detailed functional and technical designs for development, testing, and implementation.
? Ability to identify and communicate risks and issues affecting business rules, functional requirements, and specifications.
? Ability to serve as a liaison between technical, quality assurance, and non-technical stakeholders throughout the development and deployment process.
Job Responsibilities? Provide technical leadership in our client's data engineering team, driving technology decisions, mentoring others, and contributing significantly on an individual level.
? Build frameworks to handle data at high scale and data cataloging tools like AWS Glue on top of a multi-tiered data lake storage.
? Use exploration and analytic tools like AWS Athena/Presto to probe and validate data.
? Build robust data processing pipelines using Airflow, MLFlow or similar, and integrate with multiple components and data sources and sinks.
? Design and architect new product features, champion the use of cutting-edge technologies and tools, and mentor the team in the adoption of these new technologies.
? Collaborate with the Machine Learning team to ensure that data processing, structure, and accessibility maximizes model performance.
? Work on a bi-weekly sprint schedule in a fast-paced startup environment.
Participate in and contribute to scrum meetings i.e.
daily stand-up, sprint planning, and retrospectives.
? Deliver value in the form of timely, high quality, performant software components and services.
? Collaborate with product owners and stakeholders to plan and define requirements.
What We OfferCulture of Caring: At GlobalLogic, we prioritize a culture of caring.
Across every region and department, at every level, we consistently put people first.
From day one, you'll experience an inclusive culture of acceptance and belonging, where you'll have the chance to build meaningful connections with collaborative teammates, supportive managers, and compassionate leaders.
Learning and Development: We are committed to your continuous learning and development.
You'll learn and grow daily in an environment with many opportunities to try new things, sharpen your skills, and advance your career at GlobalLogic.
With our Career Navigator tool as just one example, GlobalLogic offers a rich array of programs, training curricula, and hands-on opportunities to grow personally and professionally.
Interesting & Meaningful Work: GlobalLogic is known for engineering impact for and with clients around the world.
As part of our team, you'll have the chance to work on projects that matter.
Each is a unique opportunity to engage your curiosity and creative problem-solving skills as you help clients reimagine what's possible and bring new solutions to market.
In the process, you'll have the privilege of working on some of the most cutting-edge and impactful solutions shaping the world today.
Balance and Flexibility: We believe in the importance of balance and flexibility.
With many functional career areas, roles, and work arrangements, you can explore ways of achieving the perfect balance between your work and life.
Your life extends beyond the office, and we always do our best to help you integrate and balance the best of work and life, having fun along the way!
High-Trust Organization: We are a high-trust organization where integrity is key.
By joining GlobalLogic, you're placing your trust in a safe, reliable, and ethical global company.
Integrity and trust are a cornerstone of our value proposition to our employees and clients.
You will find truthfulness, candor, and integrity in everything we do.
About GlobalLogicGlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world's largest and most forward-thinking companies.
Since 2000, we've been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences.
Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.
Apply NowFirst Name *
Last Name *
Email *
Phone
Gender *
Country of Residence *
City
How did you hear about this job?
Upload Resume / Share LinkedIn Profile *
Drag and drop your file here or click here to upload.
Only .docx, .rtf, .pdf formats allowed to a max size of 5 MB.
Alternately you can include your LinkedIn profile.
You can find more information about how GlobalLogic processes your personal data and what your rights are in the Recruitment Privacy Notice.
#J-18808-Ljbffr