You are here: Home > About Us > Staff > Careers at the RIPE NCC

Big Data Software Engineer

Apply Now

As a Big Data Software Engineer at the RIPE NCC, you will be responsible for the collection and processing of data for the RIPE NCC’s Internet measurement projects, RIS and RIPE Atlas. You will improve and expand our Java code that processes data in Hadoop and HBase. Alongside this, you will have a variety of exciting projects, like transforming our current Hadoop-based batch-oriented data processing into a new stream-oriented pipeline on top of Kafka, and migrating our infrastructure and data processing to the cloud. In this role you will have the opportunity to apply your data skills for the good of the Internet community.

Big Data Software Engineer 

Location: from our office at Amsterdam Central station and from home

37.5 hours per week (a four-day work week is also possible)

Harness your creativity to build effective solutions for new use cases that deliver our Internet measurement data to an extensive community of users. Apply your resourcefulness and determination to troubleshoot and solve bugs and performance issues in our existing processing pipelines and datasets. 

As a next-generation professional, you have a clear vision, courage and focus. You believe that creating a good environment is essential for a successful, respectful and welcoming workplace. You will be part of a dynamic team where quality matters and where we strive to learn from each other’s expertise. You are passionate about your work and are curious and open to new developments.

The data you will work with are not your average website log files, but data related to the performance, quality and usability of the global Internet, collected from tens of thousands of vantage points distributed over the globe. You will be a member of the RIPE NCC’s Global Information Infrastructure (GII) team. We are looking for someone with excellent technical and communication skills.

In this role, you will be responsible for:

  • Working with Hadoop clusters with more than 150 nodes and several petabytes of data

  • Working on our Internet measurement projects such as RIS and RIPE Atlas

  • Developing, testing and deploying your new code

  • Maintaining our current systems and workflows, including troubleshooting and bug fixing for existing code

  • Working closely with front-end developers and researchers in the Research and Development team to provide them with back-end solutions that fulfil their requirements

  • Working closely with system administrators to maintain and expand our hardware infrastructure and Hadoop clusters

What we expect from you:

  • You have at least three years of experience working in a professional environment with Big Data technologies such as HDFS, HBase, MapReduce, Spark, Kafka, etc.

  • Alternatively, you have a Bachelor’s or Master’s degree in software development and have gained hands-on experience

  • You’re fluent in Java and have practical experience with concurrent data processing and building web- and RPC-based APIs 

  • You’re fully comfortable using the Linux command line; we only work with Linux servers

  • You have good communication skills and an excellent command of the English language

It would be nice if you also:

  • Know other programming languages, preferably Scala and/or Python

  • Have a solid knowledge of Internet network technologies such as TCP/IP, DNS and BGP

  • Are familiar with deploying and running cloud services

What we offer you:

  • A distributed environment to work in, with hardware spanning six continents and services used by the entire Internet community

  • A modern, flexible and informal work environment with an emphasis on a healthy work/life balance

  • The opportunity to work on complex tasks in Big Data, plus space and support for new ideas, initiatives and innovation, exploring new technologies and developing your expertise

  • An annual salary between EUR 52,000 to EUR 80,000 (before tax) for a full-time week (37.5 hours per week). This includes the standard 8% annual “holiday pay” and a 5% end-of-year bonus.

  • Excellent secondary benefits including a non-contributory pension scheme, top-tier health insurance coverage for you and your family, annual budgets for health, technology and transportation and 30 vacation days plus 3 collective days

  • A generous annual training allowance that can be used for professional development


Global Information Infrastructure (GII) team

GII is responsible for the collection and storage of RIS data and for providing access to this data via RIPEstat, the RIPE NCC’s one-stop shop for Internet-related information. Apart from that, GII manages the Hadoop storage infrastructure for RIPE Atlas, the RIPE NCC’s global Internet measurement network. GII is also responsible for the operation of a number of DNS services. We are a diverse team and believe our different backgrounds help bring out the best ideas to help us achieve our goals. 


About the RIPE NCC

The RIPE NCC is a not-for-profit organisation founded on the belief that the Internet should be governed openly, transparently and together with the wider Internet community. We are one of the oldest Internet organisations in Europe and are proud of our legacy. 

Our strongest asset is our staff. We bring together more than 175 people from more than 40 countries in our modern, vibrant office in the east wing of Amsterdam Central Station. At the moment, staff can work both from the office and from home. Our official working language is English, but more than 30 languages are spoken by our colleagues.

Our backgrounds are diverse, but our goal is the same: we work for the good of the Internet. Will you join us?


How to apply

If you are interested in this position, please click on the Apply Button and fill in the short application form. Send it to us together with your CV and motivation letter (in English only, please). A pre-employment screening (done by Validata) will be part of the recruitment process.

Apply Now