Big Data Engineer

MGID was founded in 2008 and is one of the leading companies in native advertising. We enable our media partners to monetize their audience and help brands to promote their services and goods effectively.

MGID offers a range of integrated solutions covering the promotion process every step of the way; we offer services ranging from planning out the marketing strategy to its thoughtful implementation and optimization. Our clients include major international brands like Renault, Domino’s, Airbnb, PizzaHut, Qatar Airlines, and many others, including media organizations and web agencies.

MGID is:

• A proprietary Highload service that delivers 185 billion advertisements to 850 million unique users in more than 70 languages;

• The winner of multiple AdTech awards for innovation and product quality;

• A workforce of 700+ employees operating from offices in the US, Europe, and Asia.
  

We are looking for a Big Data Engineer to efficiently work with large datasets and support our Data Science team in developing, improving, and delivering our ML and AI solutions and algorithms.
If you’re passionate about building scalable data solutions and staying up-to-date with the latest industry trends and technologies, we want to hear from you!

Who you are:

 — Solid skills in Python, pandas and SQL.
 — Proven experience in building scalable data pipelines and preparing complex datasets for analytics or ML workflows.
 — Hands-on experience with distributed or parallel data processing tools, such as: Spark (PySpark or Scala), Dask, SQL-based engines (e.g., ClickHouse, Presto/Trino, DuckDB), or similar technologies.
 — Experience working with task orchestration tools such as Airflow (or Luigi, Prefect).
 — Comfortable working in Linux/Unix CLI environments.
 — Able to design, implement, and optimize ETL/ELT pipelines.
 — Familiarity with data visualization/reporting tools or support of analytics reporting (e.g., Tableau, Redash).
 — Strong communication and collaboration skills in remote teams.

Will be a plus:
— Background in preparing data for dashboards, analytical reports, or machine learning pipelines.
 — Knowledge of ClickHouse or other analytical DBMSs.
 — Experience with Kafka or other message brokers and streaming systems.
 — Exposure to NoSQL technologies (e.g., MongoDB, Aerospike).
 — Understanding of online advertising and RTB systems.
 — Knowledge of data quality, security, or governance practices.
 — Basic understanding of machine learning workflows.
 — Experience working as a big data analyst, especially involving complex data transformations or reporting.

What You Will Do:
— Collaborate with Data Scientists, Analysts, and Engineers to understand data needs and develop solutions.
 — Design and develop data pipelines for ingesting, transforming, and analyzing large datasets.
 — Optimize performance of data workflows and ensure data quality and integrity.
 — Develop and maintain data visualization dashboards or datasets for reporting, analytics, or ML models.
 — Leverage Airflow orchestrate complex workflows.
 — Stay up-to-date with industry trends to continuously improve the data platform and practices.

Will be a plus:
 — Experience working as a big data analyst, especially involving complex data transformations or reporting.
 — Familiarity with Docker/Kubernetes, or cloud platforms (AWS, GCP, etc.).

Join MGID, a company known for its results-driven culture and drive for innovation in AdTech. As part of our team, you will feel supported, connected, and have the flexibility you need to thrive in both your personal and professional life. We value your background, ideas, enthusiasm, and desire to improve every day.

MGID is an equal opportunity employer. We value our colleagues for who they are, no matter what they look like, where they come from, or what language they speak.