Senior Data Engineer

3 semanas atrás

Porto, Portugal Devexperts Llc Tempo inteiro

.Devexperts works with respected financial institutions, delivering products and tailor-made solutions for retail and brokerage houses, exchanges, and buy-side firms. The company focuses on trading platforms and brokerage automation, complex software development projects, market data products, and IT consulting services. Job DescriptionWe are looking for a Senior Data Engineer with a Java / Scala / Python background to join the Research & Development Team. Our current project is for a Top-5 US retail broker (by the number of users). The project is devoted to trading experience, finance reports, and risk management.You will join cross-functional team that excels in getting features done from zero to production.We expect the Senior Data Engineer to: Design, develop, and maintain robust data pipelines using Java within AWS infrastructure,Implement scalable solutions for data analysis and transformation using Apache Spark and PySpark,Utilise Airflow for efficient workflow orchestration in complex data processing tasks,Ensure fast and interactive querying capabilities through the use of Presto.2. Manage Infrastructure:Containerise applications using Docker for streamlined deployment and scaling,Orchestrate and manage containers effectively with Kubernetes in production environments,Implement infrastructure as code using Terraform for provisioning and managing AWS resources.3. Collaborate and Communicate:Collaborate with cross-functional teams to understand data requirements and architect scalable solutions aligned with business goals,Ensure data quality and reliability through robust testing methodologies and monitoring solutions,Stay updated with emerging technologies and industry trends to continuously enhance the data engineering ecosystem.QualificationsMust-have skills: 1. Education and Experience:Bachelor's degree in Computer Science, Engineering, or related field,Minimum 5 years of hands-on experience in Java / Scala / Python development, emphasising object-oriented principles.2. Technical Proficiency:Proficiency in Apache Spark or PySpark for large-scale data processing,Experience with Airflow for workflow orchestration in production environments,Familiarity with Docker for containerisation and Kubernetes for container orchestration,Experience managing AWS services such as S3, EMR, Glue, Athena, and Redshift,Strong background in SQL and relational databases.3. Communication Skills:Excellent English language communication skills, both verbal and written,Ability to collaborate effectively with technical and non-technical stakeholders.Nice-to-have skills: Experience with streaming platforms such as Kafka for real-time data processing,Knowledge of Terraform for infrastructure as code implementation in AWS environments.Life in Devexperts We will only achieve our mission if we live our culture. We start with becoming learners in all things—having a growth mindset

  • Senior Data Engineer

    1 semana atrás

    Porto, Portugal Tn Portugal Tempo inteiro

    .Job Description: Euronext is seeking a talented Senior Data Engineer with expertise in AWS and a strong background in solution architecture, database management, and data engineering. The ideal candidate will have extensive experience with AWS services such as Lambda, Glue, Step Functions, and Cloud Formation, along with proficiency in Python, SQL, and...

  • Senior Data Engineer

    1 semana atrás

    Porto, Portugal Tn Portugal Tempo inteiro

    .Job Description:Euronext is seeking a talented Senior Data Engineer with expertise in AWS and a strong background in solution architecture, database management, and data engineering. The ideal candidate will have extensive experience with AWS services such as Lambda, Glue, Step Functions, and Cloud Formation, along with proficiency in Python, SQL, and...

  • Senior Data Engineer

    3 meses atrás

    Porto, Portugal Euronext Tempo inteiro

    .Euronext is seeking a talented Senior Data Engineer with expertise in AWS and a strong background in solution architecture, database management, and data engineering. The ideal candidate will have extensive experience with AWS services such as Lambda, Glue, Step Functions, and CloudFormation, along with proficiency in Python, SQL, and database technologies....

  • Senior Data Engineer

    2 meses atrás

    Porto, Portugal Samaipata Tempo inteiro

    Senior Data Engineer About the Role As a Senior Data Engineer at Geomiq, you will play a central role in shaping our data infrastructure and operations. Your primary focus will be on establishing a robust foundation that is not only fit for the current needs but also sustainable for future growth. You'll be responsible for collecting data from various...

  • Senior Data Engineer

    2 meses atrás

    Porto, Portugal Top Sigma, Lda Tempo inteiro

    JOB DETAILS: Position: Senior Data Engineer Location: Portugal/ Remote (Portuguese residency required) DAY-TO-DAY DUTIES: As a Data Engineer at Top Sigma, you will: Develop data engineering projects with a strong emphasis on Databricks and Spark. Develop and maintain scalable ETL/ELT pipelines. Collaborate with cross-functional teams to design and implement...

  • Senior Data Engineer

    Há 4 dias

    Porto, Portugal Euronext Tempo inteiro

    .Euronext is seeking a talented Senior Data Engineer with expertise in AWS and a strong background in solution architecture, database management, and data engineering. The ideal candidate will have extensive experience with AWS services such as Lambda, Glue, Step Functions, and CloudFormation, along with proficiency in Python, SQL, and database technologies....

  • Senior Data Engineer

    2 meses atrás

    Porto, Portugal Tn Portugal Tempo inteiro

    .Job Description: Euronext is seeking a talented Senior Data Engineer with expertise in AWS and a strong background in solution architecture, database management, and data engineering. The ideal candidate will have extensive experience with AWS services such as Lambda, Glue, Step Functions, and Cloud Formation, along with proficiency in Python, SQL, and...

  • Senior Data Engineer

    2 meses atrás

    Porto, Portugal Devexperts Tempo inteiro

    Company DescriptionDevexperts works with respected financial institutions, delivering products and tailor-made solutions for retail and brokerage houses, exchanges, and buy-side firms.The company focuses on trading platforms and brokerage automation, complex software development projects, market data products, and IT consulting services.Job DescriptionWe...

  • Senior Data Engineer

    1 semana atrás

    Porto, Portugal Tn Portugal Tempo inteiro

    Job Description:Euronext is seeking a talented Senior Data Engineer with expertise in AWS and a strong background in solution architecture, database management, and data engineering. The ideal candidate will have extensive experience with AWS services such as Lambda, Glue, Step Functions, and Cloud Formation, along with proficiency in Python, SQL, and...

  • Senior Data Engineer

    3 meses atrás

    Porto, Portugal Omega, Inc. Tempo inteiro

    .This job will provide you with an opportunity to further your career alongside some of the best and most passionate technology experts from around the world in a leading company within the test, measurement and data analytics industry. You will be a strong contributor collaborating closely with colleagues from various business functions. At HBK, we live up...

  • Senior Data Engineer

    Há 5 dias

    Porto, Portugal Euronext Tempo inteiro

    .Euronext is seeking a talented Senior Data Engineer with expertise in AWS and a strong background in solution architecture, database management, and data engineering. The ideal candidate will have extensive experience with AWS services such as Lambda, Glue, Step Functions, and CloudFormation, along with proficiency in Python, SQL, and database technologies....

  • Senior Data Engineer

    2 meses atrás

    Porto, Portugal Top Sigma, Lda Tempo inteiro

    JOB DETAILS:Position: Senior Data EngineerLocation: Portugal/ Remote (Portuguese residency required)DAY-TO-DAY DUTIES:As a Data Engineer at Top Sigma, you will:Develop data engineering projects with a strong emphasis on Databricks and Spark .Develop and maintain scalable ETL/ELT pipelines.Collaborate with cross-functional teams to design and implement data...

  • Senior Data Engineer

    Há 1 mês

    Porto, Portugal Devexperts Llc Tempo inteiro

    .Devexperts works with respected financial institutions, delivering products and tailor-made solutions for retail and brokerage houses, exchanges, and buy-side firms. The company focuses on trading platforms and brokerage automation, complex software development projects, market data products, and IT consulting services. Job Description We are looking for a...

  • Senior Data Engineer

    2 meses atrás

    Porto, Portugal Tn Portugal Tempo inteiro

    .Senior Data Engineer - Lead LevelPorto Porto, Porto, Portugal col-wideJob Description: Your mission We are a leading blockchain asset custody platform, committed to providing secure and reliable services to our clients. Our mission is to leverage data to enhance our processes and drive informed- making across various stakeholders. As we expand our team, we...

  • Senior Data Engineer

    Há 1 mês

    Porto, Portugal Devexperts Llc Tempo inteiro

    Devexperts works with respected financial institutions, delivering products and tailor-made solutions for retail and brokerage houses, exchanges, and buy-side firms. The company focuses on trading platforms and brokerage automation, complex software development projects, market data products, and IT consulting services. Job DescriptionWe are looking for...

  • Senior Data Engineer

    Há 1 mês

    Porto, Portugal Samaipata Tempo inteiro

    Senior Data EngineerAbout the Role As a Senior Data Engineer at Geomiq, you will play a central role in shaping our data infrastructure and operations. Your primary focus will be on establishing a robust foundation that is not only fit for the current needs but also sustainable for future growth. You'll be responsible for collecting data from various...

  • Senior Data Engineer

    Há 1 mês

    Porto, Portugal Samaipata Tempo inteiro

    Senior Data EngineerAbout the RoleAs a Senior Data Engineer at Geomiq, you will play a central role in shaping our data infrastructure and operations. Your primary focus will be on establishing a robust foundation that is not only fit for the current needs but also sustainable for future growth. You'll be responsible for collecting data from various sources,...

  • Senior Data Engineer

    2 meses atrás

    Porto, Portugal Devexperts Tempo inteiro

    Company Description Devexperts works with respected financial institutions, delivering products and tailor-made solutions for retail and brokerage houses, exchanges, and buy-side firms. The company focuses on trading platforms and brokerage automation, complex software development projects, market data products, and IT consulting services.  Job...

  • Senior Data Engineer

    2 meses atrás

    Porto, Portugal Top Sigma, Lda Tempo inteiro

    JOB DETAILS: Position: Senior Data Engineer Location: Portugal/ Remote (Portuguese residency required) DAY-TO-DAY DUTIES: As a Data Engineer at Top Sigma, you will: Develop data engineering projects with a strong emphasis on Databricks and Spark.Develop and maintain scalable ETL/ELT pipelines.Collaborate with cross-functional teams to design and implement...

  • Senior Data Engineer

    Há 1 mês

    Porto, Portugal Devexperts Llc Tempo inteiro

    Devexperts works with respected financial institutions, delivering products and tailor-made solutions for retail and brokerage houses, exchanges, and buy-side firms. The company focuses on trading platforms and brokerage automation, complex software development projects, market data products, and IT consulting services.Job Description We are looking for...