Data Engineer
At Company on Finance industry (Contractor), in Spain
Expires at : 2025-08-19
Remote policy : Full remote
The candidate will join the Data Integration Team to support a project focused on optimizing data-driven decision-making processes across the organization.
This project aims to centralize and streamline the company's data architecture, enabling efficient and secure data integration, storage, and analytics within the Azure environment.
Project Objectives :
Develop and Optimize Data Pipelines : Design, develop, and implement data pipelines within the Azure environment to streamline data ingestion, transformation, and loading processes.
Ensure pipelines are highly performant and can handle large data volumes across multiple sources.
Data Warehouse and Analytics Development : Support the development and maintenance of a centralized data warehouse in Azure, utilizing Azure Analysis Services and Databricks.
This will enable seamless access to curated data for analytics and business intelligence.
Integrate Data with Business Intelligence Tools : Facilitate data accessibility and reporting by integrating curated data into Power BI, allowing business stakeholders to generate meaningful insights and improve decision-making processes.
Enhance Data Quality and Governance : Implement data validation and monitoring processes to ensure data accuracy, consistency, and integrity throughout the pipeline.
Work with data governance teams to apply best practices and standards for data quality and security.
Collaborate on a Scalable Data Architecture : Collaborate closely with cross-functional teams to design a data architecture that can scale with the organization's future data and analytical needs.
Main requirements
Project Deliverables :
Functional Data Pipelines in Azure : Fully operational data pipelines developed in Azure using Databricks and PySpark (if necessary), capable of processing and transforming high volumes of data from multiple sources.
Centralized Data Warehouse : A fully integrated data warehouse in Azure Analysis Services that provides a consolidated view of organizational data, facilitating analytics and reporting.
Power BI Dashboards and Reports : A suite of Power BI dashboards and reports providing relevant metrics, insights, and data visualizations tailored to business stakeholder needs.
Documentation and Best Practices Guide : Comprehensive documentation for all data pipelines, data models, and workflows, along with a best practices guide on data integration, transformation, and security in Azure.
Data Quality and Monitoring Framework : A framework to monitor data quality across all stages of the data lifecycle, including data validation checks and error handling processes.
The candidate's ability to communicate effectively in English, their remote working capability, and the potential for a long-term engagement will be crucial for continuity and alignment with team goals.
#J-18808-Ljbffr
Diventa il primo a rispondere a un'offerta di lavoro!
-
Perché cercare un lavoro con PostiVacanti.it?
Ogni giorno nuove offerte di lavoro È possibile scegliere tra un'ampia gamma di lavori: il nostro obiettivo è quello di offrire la più ampia selezione possibile Ricevi nuove offerte via e-mail Essere i primi a rispondere alle nuove offerte di lavoro Tutte le offerte di lavoro in un unico posto (da datori di lavoro, agenzie e altri portali) Tutti i servizi per le persone in cerca di lavoro sono gratuiti Vi aiuteremo a trovare un nuovo lavoro