Middle/Senior Data Engineer (AWS)

Remote · USA Full-time New today

We are seeking a talented and experienced Data Engineer to join our team at Provectus. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical challenges and have the opportunity to contribute to Provectus’ open source projects, build internal solutions, and engage in R&D activities, providing an excellent environment for professional growth.

Requirements

Experience in data engineering;

Experience working with Cloud Solutions (preferably AWS, also GCP or Azure);

Experience with Cloud Data Platforms (e.g., Snowflake, Databricks);

Proficiency with Infrastructure as Code (IaC) technologies like Terraform or AWS CloudFormation;

Experience handling real-time and batch data flow and data warehousing with tools and technologies like Airflow, Dagster, Kafka, Apache Druid, Spark, dbt, etc.;

Proficiency in programming languages relevant to data engineering such as Python and SQL;

Experience in building scalable APIs;

Experience in building Generative AI Applications (e.g., chatbots, RAG systems);

Familiarity with Data Governance aspects like Quality, Discovery, Lineage, Security, Business Glossary, Modeling, Master Data, and Cost Optimization;

Advanced or Fluent English skills;

Strong problem-solving skills and the ability to work collaboratively in a fast-paced environment.

Nice to Have

Relevant AWS, GCP, Azure, Databricks certifications;

Knowledge of BI Tools (Power BI, QuickSight, Looker, Tableau, etc.);

Experience in building Data Solutions in a Data Mesh architecture;

Familiarity with classical Machine Learning tasks and tools (e.g., OCR, AWS SageMaker, MLFlow, etc.).

Responsibilities

Collaborate closely with clients to deeply understand their existing IT environments, applications, business requirements, and digital transformation goals;

Collect and manage large volumes of varied data sets;

Work directly with Data Scientists and ML Engineers to create robust and resilient data pipelines that feed Data Products;

Define data models that integrate disparate data across the organization;

Design, implement, and maintain ETL/ELT data pipelines;

Perform data transformations using tools such as Spark, Trino, and AWS Athena to handle large volumes of data efficiently;

Develop, continuously test and deploy Data API Products with Python and frameworks like Flask or FastAPI.

apply to this job

Apply

Middle/Senior Data Engineer (AWS)

Requirements

Nice to Have

Responsibilities

Related roles

Junior Crypto Analyst Intern

Enterprise Account Executive - UK & Ireland

People Operations Business Partner

Senior Backend Engineer (Remote)

Senior Compensation & Benefits Partner

Senior Digital Marketing and Demand Generation Manager (US Remote)

Associate Product Marketing Manager (US Remote)

Cloud Security Engineer IV

QA Engineer Intern

ML/LLM Ops Intern

RN Tele/Med Surg - IST $65 Premium Flat Rate (AHN Travel Team) – Amazon Store

Sr FP&A Partner

Impact Investing Summer Associate

Lead Risk Systems Developer

Experienced Customer Support Agent for Healthcare Marketplace - Remote Opportunity with Fast-Growing Tech Startup

ES - Onsite Associate (Utiel)

Wound Care Sales Specialist

Immediate Hiring: Retail Customer Service Associate at arenaflex

Experienced Entry Level Remote Customer Service Representative – Delivering Exceptional Travel Experiences with arenaflex

Experienced Customer Sales and Service Representative – Delivering Exceptional Customer Experiences in a Dynamic and Supportive Environment