Upwork ($UPWK) is the world’s work marketplace. We serve everyone from one-person startups to over 30% of the Fortune 100 with a powerful, trust-driven platform that enables companies and talent to work together in new ways that unlock their potential.
Last year, more than $3.3 billion of work was done through Upwork by skilled professionals who are gaining more control by finding work they are passionate about and innovating their careers.
This is an engagement through Upwork’s Hybrid Workforce Solutions (HWS) Team. Our Hybrid Workforce Solutions Team is a global group of professionals that support Upwork’s business. Our HWS team members are located all over the world.
Work/Project Scope:
- Develop, maintain, and operate various data ingestion pipelines running on top of the platform
- Participate in developing and maintaining our end-to-end data platform, from data acquisition, real-time data stream, to data lake, enterprise data warehouse.
- Improve and optimize processes for better operability
- Develop and implement data quality rules and validation processes, leading engineering excellence initiatives to improve data quality and issue resolution
Must Haves(Required Skills):
- Extensive experience in data engineering roles
- Strong Python, SQL, Java skills
- Working knowledge of AWS Kinesis, Firehose, Lambda, and S3
- Real world experience with Apache Airflow in a production environment (writing, maintaining and operating DAGs)
- Experience interacting with external APIs for data ingestion
- Comfortable working with a globally distributed team with minimum supervision and attention to detail
- Able to commit working during PST Time (10AM - 3PM Pacific Timezone)
Upwork is proudly committed to fostering a diverse and inclusive workforce. We never discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical condition), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.
#LI -LD1
