Data Engineer - ( Todas as Zonas ), Portugal - Boost IT

Descrição

Boost IT is a Portuguese technology consultancy company, we are integrated into one of the most entrepreneurial groups in Portugal, with investment in more than 30 companies.

We want to be known for being the most dynamic, energetic and reliable company to operate in the market and, for that, we want to count on you.

If you're passionate about technology and want to work on the most relevant technology projects, then this ad could be for you

Boost IT. Doing IT. Better


Role:
Data Engineer


Location:
Portugal - Full Remote


Main Responsabilities:

• Responsible for implementing and maintaining the data and machine learning pipelines to ensure that data quality and consistency throughout the different stages of the application
• Responsible to ensure monitoring of the data pipelines including optimizing them across metrics such as performance, cost and reliability,
• Working together with the entire team and business stakeholders, the data engineer will ensure that data is available in an appropriate format to use for model training and reporting. This includes designing appropriate data stores, schema, indexation and partitioning.

Requirements:

• More than 2 years of experience of implementing data pipelines and moving Machine Learning models into production in an MLOps setup using Infrastructure as Code (IaC) and Continuous Integration/Deployment (CI/CD)
• Experience with the following tech stack:

> Python and PySpark
> Git
> Azure pipelines
> Spark
> Rest APIs
> Azure Databricks
> Streaming IoT data (Azure IoT hub and Event hub)
> Cosmos DB
> Azure Data Factory
> Bicep

If you are interested to know more details about the opportunity, send your CV to
@ using the reference:
BOOST.DATA_ENGINEER