Data Engineer Lazio

Data Engineer
Roma
Lazio, Lazio

Data Engineer - Spark & Scala We are supporting a leading financial consulting firm serving major banking and financial institutions, which has significantly expanded its international presence in recent years.

On one of our projects with them we are looking for a Spark Engineer with expertise in Scala Spark to contribute to three key project areas: New projects: Developing innovative solutions, both internally and for clients, leveraging Apache Spark and Scala.

Enhancements: Working on medium-to-large scale evolutive projects, including major client releases.

Maintenance: Managing and optimizing existing solutions to ensure performance and efficiency.

Key Responsibilities: Design, develop, and optimize Spark-based data pipelines.

Write high-performance, scalable Scala code for distributed data processing.

Collaborate with data engineering and data science teams to integrate models and analytical workflows.

Support debugging, performance tuning, and solution optimization.

Participate in release management and deployment in distributed and cloud environments.

Required Skills: Strong experience with Scala and Apache Spark development.

(Most Important) Knowledge of Big Data architectures and distributed systems.

Experience with data orchestration tools (e. g. , Airflow, Luigi, Oozie).

Familiarity with distributed storage and databases (HDFS, Hive, Cassandra, Delta Lake).

Experience with cloud environments (AWS, Azure, GCP) and DevOps tools for CI/CD.

Understanding of data management frameworks like Databricks or EMR.

Preferred experience with Python and SQL.

Strong teamwork and problem-solving skills.

Contract Details Work Location: Full Remote working with Italy - must be in Europe.

Contract Type: Independent Consultant (Freelancer).

Engagement: Full-time.