Analytics / Spark Engineer

Description:

As an Analytics / Spark Engineer, you will be responsible for building, designing and maintaining big data pipelines and analytics systems using Apache Spark and other big data technologies. You will collaborate with other engineers, data scientists and analysts to develop scalable and reliable big data solutions. You will work on a variety of projects that include data processing, machine learning, and data visualization.

Key Responsibilities:

  • Design, build, and maintain big data pipelines and analytics systems using Apache Spark and other big data technologies.
  • Collaborate with data scientists, analysts and other engineers to develop scalable and reliable big data solutions.
  • Develop and maintain ETL processes to transform and load data from various sources into big data platforms.
  • Implement machine learning models and algorithms using Spark MLlib and other big data tools.
  • Develop and maintain data visualizations and dashboards to communicate insights to stakeholders.
  • Optimize and improve big data solutions by analyzing performance metrics and user feedback.
  • Stay up-to-date with emerging big data technologies, techniques, and trends.

Requirements:

  • Bachelor's degree in Computer Science, Engineering or a related field.
  • Experience in building, designing and maintaining big data pipelines and analytics systems using Apache Spark and other big data technologies.
  • Strong programming skills in Scala, Python, or Java.
  • Experience with data processing frameworks, such as Hadoop, Hive, and Kafka.
  • Knowledge of machine learning algorithms and models, and their application in big data platforms.
  • Experience with data visualization and dashboard tools, such as Tableau or D3.
  • Understanding of distributed computing and parallel processing.
  • Excellent communication, problem-solving, and analytical skills.
  • Ability to work in a collaborative environment.

Salary:

The salary for an Analytics / Spark Engineer varies based on the level of experience and location, but typically ranges from $90,000 to $150,000 per year.

Apply NowBack to Current Openings