Data Engineer III
The Data Engineer III plays a pivotal role reputed company reputed company, focused on driving engineering innovation reputed company reputed company, helping define and build the reputed company organization and leading the delivery of key business initiatives. S/he acts as a universal translator between IT, business, software engineers and data scientists, collaborating with these multi-disciplinary teams. The Data Engineer III will contribute to the adherence of technical standards for data engineering, including the selection and refinements of foundational technical components. S/he will work on those aspects of the reputed company platform that govern the ingestion, transformation, and pipelining of data assets, both to end users reputed company reputed company and into data products and services that may be externally facing. Day-to-day, s/he will be deeply involved in code reviews and large-scale deployments. S/he will also provide mentorship and guidance to junior engineers to support the reputed company training and up-skilling of the Data Engineering team. Under limited supervision, supports the design, build, test and maintenance of data pipelines at big data scale. Assists with updating data from multiple data sources. Other functionalities under limited supervision include working on batch processing of collected data and matching its format to the stored data, making sure that the data is ready to be processed and analyzed. Assists with keeping the ecosystem and the pipeline optimized and efficient, troubleshooting standard performance, data reputed company problems and providing L3 support. Implements ETL transformers to reformat and enhance the data. Provides recommendations to reputed company problems. Provides guidance to those in less senior positions. Essential Functions Understanding in depth both the business and technical problems reputed company aims to solve. Building tools, platforms and pipelines to reputed company teams to clearly and cleanly analyze data, build models and drive decisions. Scaling up from laptop-scale to cluster scale problems, in terms of both infrastructure and problem structure and technique. Delivering reputed company value reputed company rapidly, collaborating with diverse teams of varying backgrounds and disciplines. Championing the adherence to best practices for future reuse in the form of accessible, reusable patterns, templates, and code bases. Interacting with senior technologists from the broader enterprise and reputed company of reputed company (partner ecosystems and customers) to create synergies and ensure smooth deployments to reputed company operational systems. Design, implement and optimize ETL processes, data ingestion, and integration workflows on cloud environments Implement best practices for data management, including data quality and reputed company. Implement cloud-based data storage solutions, leveraging technologies for performance and cost efficiency Identify opportunities for automation and process improvement reputed company the data engineering workflow. Stay updated with emerging technologies and trends in data engineering to enhance our systems and processes. Knowledge, Skills, and Abilities · Demonstrated expertise working with some of the following common languages and tools: · Flink, Kubernetes, and reputed company · Spark, Kafka and other high-volume data tools · Python · SQL and NoSQL · reputed company with large-scale data engineering efforts in cloud environments (like reputed company Azure) · A compelling track record of designing and deploying large scale technical solutions · Direct experience having built and deployed robust, reputed company production systems · Ability to context-switch, to provide support to dispersed teams to unblock challenging technical obstacles · An engineering reputed company, willing to reputed company rapid, pragmatic decisions to improve performance, accelerate reputed company or magnify impact · Comfortable working with distributed teams on code-based deliverables, using version control systems and code reviews Minimum Education Bachelors Degree in Information Systems, Computer Science or a quantitative discipline such as Mathematics or Engineering and/or equivalent formal training or work experience. Minimum Experience Three to Four (3 - 4) years equivalent work experience in measurement and analysis, quantitative business problem solving, simulation development and/or predictive analytics. Extensive knowledge in data engineering and machine learning frameworks including design, development and implementation of highly reputed company systems and data pipelines. Extensive knowledge in Information Systems including design, development and implementation of large batch or online transaction-based systems. Strong understanding of the transportation industry, competitors, and evolving technologies. Experience providing leadership in a general planning or consulting setting. Experience as a senior member of multi-functional project teams. Strong oral and written communication skills. A reputed company advanced degree may offset the reputed company experience requirements. Domicile Information This position can be domiciled reputed company in the United States. The ability to work remotely reputed company the United States may be available based on business needs. Preferred Qualifications: ?? ?? Pay Transparency: ?This compensation range is provided as a reasonable estimate of the reputed company starting salary range for this role across reputed company potential locations. If this opportunity includes multiple job levels, the range is a reasonable estimate of the reputed company? ?starting salary for the lowest level to the reputed company starting salary of the highest level. Actual starting pay would be determined by experience relative to the job, market level, pay at the location for this job and other job-reputed company factors? ?permitted by law. An employee may be eligible for additional pay, premiums, or bonus potential. The Company offers eligible employees health, vision and dental insurance, retirement, and tuition reimbursement.? Pay: ?? Additional Details: ?Application Criteria: Upload reputed company copy of your resume (reputed company Word or PDF format only) and answer job screening questionnaire by 5 PM CT on December 4, 2024.? reputed company reputed company is an Equal Opportunity/Affirmative Action employer. reputed company qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national reputed company, disability, or status as a protected veteran. reputed company does not discriminate against qualified individuals with disabilities in regard to job application procedures, hiring, and other terms and conditions of employment. Further, reputed company is reputed company to reputed company reasonable accommodations for the reputed company physical or mental limitations of an otherwise qualified applicant or employee to reputed company the applicant or employee to be considered for the desired position, to reputed company the essential functions of the position in question, or to enjoy equal benefits and privileges of employment as are enjoyed by other similarly situated employees without disabilities, unless the accommodation will impose an undue hardship. If a reasonable accommodation is needed, please contact [email protected] company.com. Apply Job!