Data Engineer
Role:Data Engineer Duration:6 mesi + Possibilita' di estensione Location:100% Remote from Italy Language:English (B2)Partita IVA / Freelance / B2B ContractImportant note: Only for candidates based in Italy will be considered, Italian languages is optional but not requiredJD: Designing, building, and maintaining efficient data pipelines using PySpark and Databricks.
Collaborating with data scientists and analysts to understand data requirements and deliver actionable insights.
Implementing data integration processes and ensuring data quality and reliability.
Optimizing performance of Spark jobs and troubleshooting issues across development, testing, and production environments.
Contributing to the design and architecture of data solutions leveraging Azure cloud infrastructure Implementing CI/CD pipelines for automated testing and deployment of data pipelines.
Monitoring and improving data quality and reliability through robust testing and monitoring practices.
Documenting technical designs, development tasks, and ongoing operations. Must have skills: Excellent software/data engineering skills and proficiency in Python Very good knowledge of SQL, databases (like Postgres, Oracle) Good knowledge of distributed computing frameworks, Pyspark a musthave with others being an advantage.
Familiarity with system design, data structures, algorithms, storage systems, and cloud infrastructure.
Understanding of data modeling and data architecture concepts.
Experience with CI/CD processes as well as data testing and monitoring.
Experience with Databricks and Azure services for data, such as Azure Data Factory, Synapse Analytics, or Fabric.
Work experience with application operations, monitoring, and orchestration (UC4 is a plus).
Proficiency in English (written & verbal) communication. Nice to have: Knowledge of Delta Protocol and Lakehouse architectures.
Previous experience with Palantir Foundry is a plus.
Diventa il primo a rispondere a un'offerta di lavoro!
-
Perché cercare un lavoro con PostiVacanti.it?
Crea Il Tuo Job Alert![]()
Ogni giorno nuove offerte di lavoro ![]()
È possibile scegliere tra un'ampia gamma di lavori: il nostro obiettivo è quello di offrire la più ampia selezione possibile ![]()
Ricevi nuove offerte via e-mail ![]()
Essere i primi a rispondere alle nuove offerte di lavoro ![]()
Tutte le offerte di lavoro in un unico posto (da datori di lavoro, agenzie e altri portali) ![]()
Tutti i servizi per le persone in cerca di lavoro sono gratuiti ![]()
Vi aiuteremo a trovare un nuovo lavoro
