Skip to content

Data Professional Specializing in System Architecture and Big Data Management

Monthly, billions of users worldwide, spanning over 300 languages, engage with Wikipedia and its associated projects. This vast platform, fueled by over 200,000 volunteer contributors, is upheld by the Wikimedia Foundation's Data Platform team.

Data Architect Specialist with Advanced Technical Skills
Data Architect Specialist with Advanced Technical Skills

Data Professional Specializing in System Architecture and Big Data Management

The Wikimedia Foundation, the non-profit organisation behind Wikipedia and other free knowledge projects, is currently hiring a Senior Data Engineer. This role offers an exciting opportunity to work on a large-scale data platform, contributing to the design and improvement of a shared data platform that supports diverse use cases such as product analytics, bot detection, and image classification.

As a Senior Data Engineer, you will be responsible for designing and building scalable, robust data pipelines and infrastructure using tools such as Apache Airflow, Spark, and Kafka. Your role will also involve ensuring data quality through monitoring and alerting systems, supporting data governance and lineage to manage and track data across pipelines, and driving operational excellence to improve system reliability, maintainability, and performance.

The ideal candidate for this role should have advanced proficiency in Python and Java/Scala, and a minimum of 5 years of data engineering experience. Given the nature of the responsibilities, it is reasonable to expect qualifications such as extensive experience in designing and operating large-scale data pipelines and data infrastructure, proficiency in technologies including Apache Airflow, Apache Spark, Kafka, or similar, strong skills in monitoring, alerting, and maintaining data quality, familiarity with data governance principles and lineage tracking, and the ability to collaborate cross-functionally with various teams.

The Wikimedia Foundation operates as a remote-first organisation with staff members based in over 40 countries. The salary for this role is estimated to range approximately from $101,100 to $156,000 annually, and salaries at the Wikimedia Foundation are set in a way that is competitive, equitable, and consistent with values and culture.

The Senior Data Engineer will join a geographically distributed team reporting to the Engineering Manager, Data Platform Engineering. The work directly impacts billions of users while advancing open knowledge accessibility, as Wikipedia and its sister projects reach billions of users monthly across 300+ languages.

The Wikimedia Foundation is an equal opportunity employer that values diversity and continuously strives to maintain an inclusive and equitable workplace. If you are passionate about data engineering and making a significant impact on the world, we encourage you to apply for this exciting opportunity.

For more specific qualification details or to learn more about the role, please check the Wikimedia Foundation's official job postings or contact their HR department.

  1. As a Senior Data Engineer, you will leverage your expertise in finance by managing and tracking data across pipelines, ensuring data quality through monitoring and alerting systems, and driving operational excellence to improve system reliability, maintainability, and performance.
  2. In this role, you will apply technology to advance open knowledge accessibility by working on a large-scale data platform, designing and building scalable, robust data pipelines and infrastructure using tools such as Apache Airflow, Spark, and Kafka.

Read also:

    Latest

    Diversification of Digital Currencies: A Breakdown of Crypto's Split Variations

    Coin Splits within Cryptocurrency

    Alterations to the code or operational guidelines of a blockchain system, leading to the emergence of a fresh blockchain variant, are referred to as cryptocurrency forks. These splits can encompass modifications in the original blockchain's underlying principles.