Empregos
>
Porto

    Data & AI Engineer - Porto, Portugal - Capgemini

    Capgemini
    Capgemini Porto, Portugal

    há 5 dias

    Default job background
    Descrição

    Data Engineer - Scala


    Key responsibilities

    • Develop Scala/Spark programs, scripts, and macros for data extraction, transformation and analysis
    • Design and implement solutions to meet business requirements
    • Support and maintain existing Hadoop applications and related technologies
    • Develop and maintain metadata, user access and security controls
    • Develop and maintain technical documentation, including data models, process flows and system diagrams
    Requirements

    • Minimum 35 years of experience from Scala/Spark related projects and/or engagements
    • Create Scala/Spark jobs for data transformation and aggregation as per the complex business requirements.
    • Should be able work in a challenging and agile environment with quick turnaround times and strict deadlines.
    • Perform Unit tests of the Scala code
    • Raise PR, trigger build and release JAR versions for deployment via Jenkins pipeline
    • Should be familiar with CI/CD concepts and the processes
    • Peer review the code
    • Perform RCA of the bugs raised
    • Should have excellent understanding of Hadoop ecosystem
    • Should be well versed with below technologies
    Jenkins
    HQL(Hive Queries)
    Oozie
    Shell scripting

    GIT
    Splunk

    Preferred

    • Relevant certifications (e.g., Scala, Spark, Hadoop, Performance)
    • Knowledge of other programming languages (e.g., Python, R)
    • Insight to cloudbased solutions such as Snowflake
    • Experience in Financial Services, preferrable in the Credit risk domain
  • Dellent Consulting

    Data Engineer

    há 3 dias

    Dellent Consulting Porto, Portugal

    Se és um profissional apaixonado pelo universo automóvel e pela inovação na mobilidade, e queres enfrentar novos desafios, estás no sitio certo. Procuramos pessoas que queiram fazer parte de um projeto líder no setor, contribuindo para a transformação e excelência num ambiente di ...

  • Dellent

    Data Engineer

    há 1 dia

    Dellent Porto, Portugal Tempo integral

    A Dellent é uma empresa de consultoria especializada em Sistemas de Informação e Telecomunicações. O nosso objetivo é conseguirmos ajudar os nossos consultores e candidatos a integrarem projetos que vão ao encontro dos seus interesses, motivações e expectativas. · Se és um profis ...

  • Mind Source

    Data Engineer

    há 3 dias

    Mind Source Porto, Portugal

    LOCAL: Porto (Híbrido) DESCRITIVO DA FUNÇÃO: A Mind Source está a reforçar a sua Equipa de Business Insights através de um Data Engineer.PERFIL:- Licenciatura em Engenharia Informática, Informática de Gestão ou similar;- Pelo menos 3 anos de experiência com modelagem de dados e P ...

  • Pkf-Vmb Belgium

    Data Engineer

    há 3 dias

    Pkf-Vmb Belgium Porto, Portugal

    Quantas vezes te aborreceste à procura de uma oportunidade de emprego que fizesse sentido para ti? Apostamos que perdeste a conta... Se ainda não ouviste falar de nós, temos uma história para ti. Se já ouviste, acreditamos que o que te vamos contar vai fazer a diferença · A agap2 ...

  • Mind Source

    Data Engineer

    há 1 semana

    Mind Source Porto, Portugal Tempo integral

    LOCAL: Porto (Híbrido) · DESCRITIVO DA FUNÇÃO: · A Mind Source está a reforçar a sua Equipa de Business Insights através de um Data Engineer. · PERFIL: · Licenciatura em Engenharia Informática, Informática de Gestão ou similar; · Pelo menos 3 anos de experiência com modelagem de ...

  • Quickops

    Data Platform Engineer

    há 3 dias

    Quickops Porto, Portugal

    Ref. AO2089Estamos à procura de um Data Platform Engineer para se juntar a empresa líder na área de retalho.Se te consideras uma pessoa flexível e proativa e desejas enfrentar novos desafios profissionais, envia-nos a tua candidatura Estamos ansiosos por fazer parte do teu cresci ...

  • Quickops

    Data Platform Engineer

    há 2 semanas

    Quickops Porto, Portugal

    Ref. AO2089 · Estamos à procura de um Data Platform Engineer para se juntar a empresa líder na área de retalho. · Se te consideras uma pessoa flexível e proativa e desejas enfrentar novos desafios profissionais, envia-nos a tua candidatura Estamos ansiosos por fazer parte do teu ...

  • Employment Pro Limited

    Full-Stack Data Engineer

    há 2 dias

    Employment Pro Limited Porto, Portugal

    Buscar vagas de emprego e oportunidades de carreira · Encontramos 735 vagas para Vagas de emprego full-stack-data-engineer .Receba alerta de vagas em seu email. Registre-se agoraFunção: Full Stack EngineerEmpresa: DevoteamTipo: Full-timeContrato: n/dLocalidade: Aveiro, Lisboa, Po ...

  • Adidas

    Data Engineering Intern

    há 1 semana

    Adidas Porto, Portugal

    Data Engineering is all about making sure that the organizational data, coming from both internal and external sources, is stored, processed and analysed as effectively and efficiently as possible. Being a Data Engineer means having a deep understanding of techniques and technolo ...

  • AskBlue

    Data Engineer

    há 5 dias

    AskBlue Porto, Portugal

    We are currently looking for a Data Engineer to integrate one of your project teams in Lisbon or Porto. Main Tasks: Develop and design data pipelines/ETL in Python; Industrialize processes for full automation; Assess client needs, understand the business and deliver a proper solu ...

  • Closer Consulting

    Data Engineer

    há 5 dias

    Closer Consulting Porto, Portugal

    Closer is a tech company created in . Carrying innovation in our DNA, we are a 100% Portuguese company with offices in Portugal, Brazil, the United Kingdom, and Hong Kong. Being proud of our steady growth and impact in the IT market, we are conscious of the importance of the role ...

  • Maersk

    Senior Data Engineer/ Data Engineer

    há 1 semana

    Maersk Porto, Portugal Tempo integral

    Maersk is going through times of unprecedented change. From the farm to your refrigerator, the factory to your wardrobe, we are developing solutions that meet customer needs from one end of the supply chain to the other. Digitization and IT are taking center stage in enabling our ...

  • Dbservices Portugal

    Data Engineer

    há 6 dias

    Dbservices Portugal Porto, Portugal

    DBServices helps to design, develop and support digital platforms for large and mid-sized companies in ITC, Banking, Retail, Government, Health, and other industries in Europe and Americas. · TasksCollaborate closely with business users to understand their requirements and transl ...

  • WE ARE META

    Data Engineer

    há 5 dias

    WE ARE META Porto, Portugal Data Engineer

    Seeking a Data Engineer: Rhino, are you there? · At WE ARE META, we're focused on finding the perfect · match between our Rhinos and our clients. · Why join us? · Expand your network: As a consultant at We Are Meta you'll get to have access to a network of national an ...

  • We Are Meta

    Data Engineer

    há 3 dias

    We Are Meta Porto, Portugal

    Data Engineer (French Speaker)PortoPython,Pyspark,Hadoop,GCP,machine learning · Are you a Data Engineer? Become a Rhino join the #crash We are META, more than a company a TEAM that will shake your idea about tech recruitment. Based in Évora but acting mainly in a remote way, we ...

  • Db Services Portugal

    Data Engineer

    há 6 dias

    Db Services Portugal Porto, Portugal

    DBServices helps to design, develop and support digital platforms for large and mid-sized companies in ITC, Banking, Retail, Government, Health, and other industries in Europe and Americas. · TasksCollaborate closely with business users to understand their requirements and transl ...

  • DBServices Portugal

    Data Engineer

    há 1 semana

    DBServices Portugal Porto, Portugal CDI

    DBServices helps to design, develop and support digital platforms for large and mid-sized companies in ITC, Banking, Retail, Government, Health, and other industries in Europe and Americas. · Tasks · Collaborate closely with business users to understand their requirements and tra ...

  • Multipessoal

    Data Engineer

    há 3 dias

    Multipessoal Porto, Portugal

    We are recruiting a Data Engineer for a multinational company on the Energy Sector. · - Design and develop robust data pipelines and architectures to facilitate efficient data processing, transformation, and loading; · - Implement scalable and reliable ETL processes to extract, t ...

  • Dellent Consulting

    Data Engineer

    há 1 dia

    Dellent Consulting Porto, Portugal

    Would you like to make an impact in different industries with your work? Then this project is for you. Here you will have the opportunity to be part of a multicultural and inclusive team with global projection that contacts with areas such as consultancy, law, strategy, insurance ...

  • Keyrus

    Data Engineer

    há 5 dias

    Keyrus Porto, Portugal

    Empowered by our motto, " Making Data Matter ", Keyrus stands at the forefront of global consultancy in Data & Analytics, AI & Machine Learning, and Digital Transformation. With a presence in 27 countries across 4 continents, we're on a mission to elevate the impact of data. · We ...