Company: fedex services
Job title: data engineer advisor (remote) - dataworks
Job requisition number: rc415104
Category: information technology
Pay type: exempt
Collierville, tennessee 38017
Plano, texas 75024
Harrison, arkansas 72601
Lakeland, florida 33801
Orlando, florida 32810
Pittsburgh, pennsylvania 15205
Under minimal supervision, supports the design, build, test and maintain data pipelines at big data scaleAssists with updating data from multiple data sourcesOther functionalities under close supervision is to work on batch processing of collected data and match its format to the stored data, make sure that the data is ready to be processed and analyzedAssists with keeping the ecosystem and the pipeline optimized and efficient, troubleshooting standard performance, data related problems and provide l3 supportIndependently implements parsers, validators, transformers and correlators to reformat, update and enhance the dataProvides recommendations to highly complex problemsProvides guidance to those in less senior positions.
The data engineer advisor plays a pivotal role within dataworks, focused on creating and driving engineering innovation within dataworks, helping define and build the dataworks organization and facilitate the delivery of key business initiativesS/he acts as a “universal translator” between it, business, software engineers and data scientists, collaborating with these multi-disciplinary teamsThe data engineer advisor will contribute to the creation of and adherence to technical standards for data engineering, including the selection and refinements of foundational technical componentsS/he will work on those aspects of the dataworks platform that govern the ingestion, transformation, and pipelining of data assets, both to end users within fedex and into data products and services that may be externally facingDay-to-day, s/he will be deeply involved in code reviews and large-scale deployments.
Essential job duties & responsibilities:
Understanding in depth both the business and technical problems dataworks aims to solve
Building tools, platforms and pipelines to enable teams to clearly and cleanly analyze data, build models and drive decisions
Scaling up from “laptop-scale” to “cluster scale” problems, in terms of both infrastructure and problem structure and technique
Delivering tangible value very rapidly, collaborating with diverse teams of varying backgrounds and disciplines
Codifying best practices for future reuse in the form of accessible, reusable patterns, templates, and code bases
Interacting with senior technologists from the broader enterprise and outside of fedex (partner ecosystems and customers) to create synergies and ensure smooth deployments to downstream operational systems
Skills/knowledge considered a plus:
Technical background in computer science, software engineering, database systems, distributed systems
Fluency with distributed and cloud environments and a deep understanding of how to balance computational considerations with theoretical properties
Detailed knowledge of the microsoft azure tooling for large-scale data engineering efforts and deployments is highly preferred
A compelling track record of designing and deploying large scale technical solutions, which deliver tangible, ongoing value
Direct experience having built and deployed robust, complex production systems that implement modern, data scientific methods at scale
Ability to context-switch, to provide support to dispersed teams which may need an “expert hacker” to unblock an especially challenging technical obstacle, and to work through problems as they are still being defined
Demonstrated ability to deliver technical projects with a team, often working under tight time constraints to deliver value
An ‘engineering’ mindset, willing to make rapid, pragmatic decisions to improve performance, accelerate progress or magnify impact
Comfort with working with distributed teams on code-based deliverables, using version control systems and code reviews
Ability to conduct data analysis, investigation, and lineage studies to document and enhance data quality and access
Use of agile and devops practices for project and software management including continuous integration and continuous delivery
Demonstrated expertise working with some of the following common languages and tools:
Spark (scala and pyspark), hdfs, kafka and other high-volume data tools
Sql and nosql storage tools, such as mysql, postgres, cassandra, mongodb and elasticsearch
Pandas, scikit-learn, matplotlib, tensorflow, jupyter and other python data tools
Master’s degree in information systems, computer science, or a quantitative discipline such as mathematics or engineering and/or equivalent formal training or work experienceSeven (7) years equivalent work experience in measurement and analysis, quantitative business problem solving, simulation development and/or predictive analyticsExtensive knowledge in data engineering and machine learning frameworks including design, development and implementation of highly complex systems and data pipelinesExtensive knowledge in information systems including design, development and implementation of large batch or online transaction-based systemsStrong understanding of the transportation industry, competitors, and evolving technologiesExperience providing leadership in a general planning or consulting settingExperience as a leader or a senior member of multi-function project teamsStrong oral and written communication skillsA related advanced degree may offset the related experience requirements.
Domicile / relocation information:
This position can be domiciled anywhere in the united states.
The ability to work remotely within the united states may be available based on business need.
Relocation assistance may be available based on business need.
Upload current copy of resume (microsoft word or pdf format only) and answer job screening questionnaire by 5:00 pm cst on wednesday october 6,2021 at 5:00pm
Fedex services is an equal opportunity/affirmative action employerAll qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, genetics disability, or protected veteran status.
Fedex services will make reasonable accommodations for the known physical or mental limitations of an otherwise qualified individual with a disability who is an applicant or an employee, unless undue hardship or a direct threat would result from the accommodationIf reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact firstname.lastname@example.org.