Medior AWS Data Engineer Eindhoven

Vacatureomschrijving

We are seeking a highly skilled AWS Data Engineer with extensive experience in AWS cloud data engineering and ETL development. The ideal candidate will have a strong background in building end-to-end solutions using distributed computing frameworks and ETL tools, along with proficiency in Python, Pyspark, SQL, and other key technologies.

• Design and develop data pipelines for various clients using AWS cloud technologies, including Databricks, Glue, EMR, Redshift, RDS, Lambda, DynamoDB, EC2, S3, Airflow, SNS, and SQS.
• Utilize ETL/SQL development expertise to create efficient data pipelines and perform complex data transformations.
• Work closely with business stakeholders to understand requirements and implement custom solutions based on their needs.
• Implement and optimize lambda functions with different trigger sources and event triggers using SNS for stakeholder notification.
• Collaborate with version control systems (VCS) such as GitHub and Bitbucket for code management and maintenance.
• Ensure data integrity and efficiency by handling slowly changing dimension (SCD) data with incremental loads.
• Apply cost optimization strategies to implement the most efficient methods while minimizing costs.
• Utilize data modeling techniques such as 3NF, Dimensional Modeling, and Data Vault to design and optimize data structures.
• Work in an agile, scrum environment, collaborating with cross-functional teams to deliver high-quality solutions.

• Bachelor's degree in Computer Science, Engineering, or related field.
• Minimum of 5 years of experience as an AWS Cloud Data Engineer.
• Extensive experience in AWS cloud computing platform, with a focus on building data pipelines using Databricks, Glue, EMR, Redshift, RDS, Lambda, DynamoDB, EC2, S3, Airflow, SNS, and SQS.
• Proficiency in Python, Pyspark, SQL, and shell scripting.
• Strong ETL/SQL development skills with a minimum of 3 years of experience.
• Solid understanding of data engineering principles and best practices.
• Experience with version control systems (GitHub, Bitbucket) and agile methodologies.
• Excellent communication and collaboration skills, with the ability to work closely with business stakeholders.
• Proactive attitude with a can-do mentality and a commitment to delivering high-quality solutions.

TMC is an international high-tech consultancy company that brings expertise to their clients in order to support them with the realization of their technological challenges. As such, TMC is operating as an expert center at the disposition of its clients and we help them to be more competitive in an ever more global and faster changing technological world.

At TMC we believe that people are the driving force behind technological innovation. That is why we want to create the best possible conditions for tech talents to thrive in. We offer you a challenging and stimulating work environment in which you can be the director of your own career.

As an Employeneur you are part of our TMC family. Next to our outstanding technical expertise, fun and engagement are meaningful parts of our culture.

We are truly unique thanks to our Employeneurship model which is a true innovation for the High Technology consulting business. It is the business relationship of the 21th century for high skilled technical professionals. It is built around 5 main pillars:

• You will have a permanent employment contract, offering you stability and security
• You will get to know your market value and have a share in the profit your work generates thanks to the individual profit sharing
• We will support you with a one-on-one coaching and trainings designed to help you develop your entrepreneurial skills
• The competence cells structure, provides you with a strong meaningful and relevant network
• The entrepreneurial lab: a playground for new ideas and a potential launching for start-ups

TMC is an equal opportunity employer and values diversity. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.