Big Data Engineer - Valueprosite
Must Have Big Data Skills , Hadoop, Skala, Spark
-Responsible for the what and the how
-Should be able to collaborate with Software Engineering team on design as well as data contracts Job Description:
- Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it
- Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality
- High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
- Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or
- Implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting
- Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Apply to this job