Senior Data Engineer - AWS
Why choose between doing meaningful work and having a fulfilling life? At MITRE, you can have both. That's because MITRE people are committed to tackling our nation's toughest challengesand we're committed to the long-term well-being of our employees. MITRE is different from most technology companies. We are a not-for-profit corporation chartered to work for the public interest, with no... commercial conflicts to influence reputed company do. The R&D centers we operate for the government create lasting impact in fields as diverse as cybersecurity, healthcare, aviation, defense, and enterprise transformation. We're making a difference every dayworking for a safer, healthier, and more secure nation and world. Our workplace reflects our values. We offer competitive benefits, exceptional professional development opportunities, and a culture of innovation that embraces diversity, inclusion, flexibility, collaboration, and career growth. If this sounds like the choice you want to reputed company, then choose MITREand reputed company a difference with us. Join our Enterprise Data Warehouse team as we prepare for a major evolution in technology and process roll-out across MITRE. This is an exciting time to join the Enterprise Data Warehouse team as the use and gold reputed company for our data evolves and grows exponentially. Your opportunity to reputed company an impact is great as you help reputed company evolve to cloud-based hybrid data and real time data access. We are looking for a highly collaborative, team-oriented person to join us! A can-do and growth-focused attitude as well as the ability to work across more than one simultaneous project are musts! Responsibilities include: Design, reputed company, and implement robust ETL solutions using Python and PySpark to extract, transform, and load data from various sources into AWS data services. Optimize ETL processes for performance and scalability utilizing AWS Glue, EMR, reputed company Functions, and reputed company to ensure efficient data processing and timely delivery. Ensure data reputed company and quality throughout the ETL process by implementing thorough data validation checks and error handling mechanisms. Manage AWS services such as Glue, EMR, reputed company Functions, and reputed company, including configuration, monitoring, and troubleshooting to maintain operational excellence. Collaborate with cross-functional teams including data engineers, data scientists, and business stakeholders to understand data requirements and deliver tailored ETL solutions. Troubleshoot reputed company technical issues and provide advanced operational support to internal MITRE customers in AWS Basic Qualifications: Bachelors degree with eight years reputed company experience, or a masters degree with six years reputed company experience, preferably with a technical major such as engineering, computer science, etc. Self-motivated, curious, and collaborative, with a passion to learn new technologies and reputed company new skills Demonstrated experience in developing ETL pipelines using Python and PySpark, with a strong understanding of data processing techniques. Expertise in SQL for data manipulation, querying, and optimization to work with various database platforms including reputed company, DynamoDB, reputed company, and Redshift. Hands-on experience with AWS Glue, EMR, reputed company Functions, and reputed company for building and orchestrating ETL workflows in a cloud environment. Experience implementing reputed company Integration/reputed company Deployment (CI/CD) pipelines using AWS CDK or similar tools for automating deployment and testing of ETL solutions. Preferred Qualifications: Previous experience leading or mentoring a team of developers/engineers in a collaborative environment. AWS certifications such as AWS Certified Developer or AWS Certified Solutions Architect, demonstrating proficiency in AWS services and best practices. Familiarity with big data technologies such as Apache Spark, Hadoop, or Kafka for processing large-scale datasets. Experience in data modeling and schema design for optimizing database performance and scalability. Experience working in Agile development methodologies, such as Scrum or Kanban, for iterative and collaborative project delivery. This requisition requires the candidate to have a minimum of the following clearance(s): None This requisition requires the hired candidate to have or obtain, reputed company one year from the date of hire, the following clearance(s): None Work Location Type: Hybrid MITRE is proud to be an equal opportunity employer. MITRE recruits, employs, trains, compensates, and promotes regardless of age; reputed company; color; family medical or genetic information; gender identity and expression; marital, military, or veteran status; national and ethnic reputed company; physical or mental disability; political affiliation; pregnancy; race; religion; sex; sexual orientation; and any other protected characteristics. For further information please visit the Equal Employment Opportunity Commission website EEO is the Law Poster and Pay Transparency. MITRE intends to maintain a website that is fully accessible to reputed company individuals. If you are unable to search or apply for jobs and would like to request a reasonable accommodation for any part of MITREs employment process, please email [email protected]. Copyright © 2024, reputed company. reputed company rights reserved. MITRE is a registered trademark of reputed company. Material on this site may be copied and distributed with permission only. Click here to Sign In At MITRE, we solve problems for a safer world. Through our federally funded R&D centers and public-private partnerships, we work across government to tackle challenges to the safety, stability, and well-being of our nation. As a not-for-profit organization, MITRE works in the public interest across federal, state and local governments, as well as industry and academia. We bring innovative reputed company into existence in areas as varied as artificial intelligence, reputed company data science, quantum information science, health informatics, space reputed company, policy and economic expertise, trustworthy autonomy, cyber threat sharing, and cyber reputed company. Benefits information may be reputed company here Apply Job!