Senior Big Data Engineer (RO)

Location

Romania

Experience

Senior
Apply now

Senior Big Data Engineer (RO)

Requirements

ETL solutions to process data Data engineering Batch processing SQL Scala Java Apache Spark Kafka Flink HDFS

You will be working for a leading global provider of advanced analytics, technology solutions and clinical research services to the life sciences industry.

 

Scope of the project:

  • Data platform to integrate, manage and curate complex medical data sets
  • ETL solutions to process data from multiple disparate sources (spanning different countries, languages and compliance requirements)
  • Master data management tool specialized on the governance of electronic medical records (EMR) reference dimensions (diagnosis, posology, laboratory & test values, doctors, products)
  • Privacy Hub that ensures patient data anonymization according to EU regulations
  • Business Intelligence solutions at the top of data we managed

 

Technologies used:

  • Data Engineering: Cloudera Data Platform, Databricks, Hadoop, Hive, Kudu, Spark, Kafka, Camunda, Scala, Java
  • Web application development: Java, C#, Angular, Oracle, Elasticsearch, Kafka
  • Testing: Python, Robot Framework
  • Cloud: Microsoft Azure
  • Containerization: Docker, Kubernetes

 

Responsibilities:

  • Designing and developing ETL solutions to process big amount of medical data
  • Ensuring high quality by creating comprehensive and automated tests
  • Continuously improving our data platform and reducing technical debt
  • Supporting introduction of new tools and migration to Azure cloud
  • Providing technical guidance to less experienced team members
  • Contributing to standards definition and promoting best practices

 

Requirements:

  • 6+ years of experience in data engineering, ETL design and implementation
  • Experience with batch processing (3+ years)
  • Experience in data analysis, profiling, integration and reporting (2+ years)
  • Excellent knowledge about SQL, Scala and Java (4+ years)
  • Experience with Apache Spark, Kafka, Flink and HDFS
  • Being a great team player

 

Nice to have:

  • Extensive knowledge about database design and modeling
  • Commercial experience with Databricks and Azure cloud
  • Analytical and troubleshooting skills

 

About Spyrosoft

Spyrosoft is an authentic, cutting-edge software engineering company, established in 2016. In 2021 and 2022, we were among the fastest growing technology companies in Europe, according to the Financial Times. We were founded by a group of tech experts with established backgrounds in software engineering, who created an ‘engineer-to-engineer’ workplace, powered by enthusiasm, fairness and authentic relationships. Having a unique offering, which bridge the gap between technology and business, we specialise in technology solutions for industry 4.0, automotive, geospatial, healthcare & life sciences, employee experience & education and financial services industries.

WHAT YOU GET

We support you at every stage

Check the benefits of working at Spyrosoft

medical care icon

Private health insurance

Keep your health in check with easy access to medical professionals.

training budget icon

Training budget

Use your personal training budget to gain new skills and knowledge.

career development manager icon

Internal initiatives

Take part in our knowledge-sharing meetups organised by and for tech enthusiasts.

flexible working hours

Flexible working hours

You're not an early bird? You can work for us when you are the most productive.

Referral bonus icon

Referral bonus

Not only do you get to work with your friends, but we also compensate you for the recommendation.

Meet the recruiter

madalina spoiala spyrosoft

I say yes to any challenge that comes up and I always get to the finish line, no matter how hard the ride is. Be part of our ride, join Spyrosoft!

Madalina Spoiala

Recruitment Specialist

Recruitment process (run remotely but you're more than welcome to visit us at the office)

icon
01

We check your CV

We carefully read every CV we receive. If you meet our requirements, we call you to learn more about your skills and needs.
02

We check your qualifications

After talking on the phone, it's time for the technical part of recruitment, during which we can ask you to complete the task related to your position. We always provide feedback after this meeting.
03

We make an appointment

The next stage is a meeting in one of our offices or online. You will have the opportunity to learn more about the team and work culture from the person who manages the department and/or Spyrosoft partner.
04

You get the answer

At Spyrosoft, we contact every person who was taking part in recruitment process. If we accept your candidacy, we will also send you a list of the next steps.

CONTACT OUR RECRUITMENT TEAM

Apply for
Senior Big Data Engineer (RO)

If this offer seems to be perfect for you - don't wait, send us your CV

    Please note that we accept PDF, .doc, .docx or .odt format only.

    By agreeing to one of the following statements, I confirm that I provide my data voluntarily and accept the information contained in the Communication.
    See Communication text
    At the same time, I declare that I voluntarily provide my personal data and I acknowledge that the Controller of my personal data is Spyrosoft S.A. with its registered office in Wrocław, Plac Nowy Targ 28, the recipients of my data can be companies related with the Data Controller: in particular:
    a) dominant companies within the meaning of art. 4 § 1 point 4 of the Commercial Companies Code of 15 September 2000,
    b) affiliated companies within the meaning of art. provisions of the Commercial Companies Code of 15 September 2000,
    c) companies associated personally with the Administrator, i.e. those in which persons discharging functions in the Administrator's bodies hold at least 20% of votes or shares,
    as well as the Customers of these companies or the entities providing services in favour of the Data Controller who may act as data controllers and processors and my personal data shall be processed pursuant to the Regulation of the European Parliament and of the Council (EU) 2016/679 of 27 April 2016 on the protection of individuals with regard to the processing of personal data and on the free movement of such data and repealing Directive 95/46/EC, pursuant to Art. 6 (1) (a) of this Regulation, during the period not exceeding 6 months

    At the same time, I acknowledge that I have the right to access and rectify my personal data, its erasure, limitation of processing, the right to object to the processing of data, the right to transfer data, the right to withdraw the consent at any time (without impact on the lawfulness of the processing carried out before the withdrawal), as well as the right to lodge a complaint to a supervisory body. Withdrawal of the consent and willingness to exercise other rights can be reported via e-mail: rodo@spyro-soft.com or by post to the following address: Spyrosoft S.A., Plac Nowy Targ 28, 50-141 Wrocław.

    I acknowledge that personal data is not subject to the automated decision making, including profiling.