Summary

We are seeking a Principal Data Engineer to join Giga, an initiative to connect every school in the world to the Internet and every young person to information, opportunity, and choice. As a senior technical member, the candidate will contribute to product strategy and help develop technical and data teams of Giga’s products.

Your main responsibilities will be…

• Architect and manage technically robust, resilient and scalable DataOps platform – a set of synced tools to maintain sanity and consistency across the entire data lifecycle of ingestion, transformation, storage, access and sharing in an automated manner.
• Collaborate with product managers, data scientists, analysts and engineers to estimate technical feasibility of their respective products/projects and to translate products specifications into technical architecture flows and roadmaps.
• Architect and manage data workflows and tech stack of Giga’s products.
• Build proof of concept products or mockups for product market testing.
• Guide and support vendors and partners in building products.
• Build key data pipelines and workflows prototypes for Giga’s flagship products like DataOps and ML model for school detection.
• You set up the data engineering culture and best practices and champion their adoption at the same time.

To qualify for this position, you will have…

• University degree in Computer Science or similar field.
• At least five years of relevant work experience in building and managing open-source data products.
• Deep understanding & expertise in building and managing DataOps Platforms – data pipelines, ingestion, storage, data processing, and data governance.
• Experience with open-source data engineering and governance technologies like Airflow or any other major orchestration tool, Python, Apache Atlas or DataHub, Apache Superset, Kubernetes clusters, Great Expectations package.
• Strong knowledge of ML lifecycle with MLOps.
• Experience on functional and technical requirements gathering
• Experience using agile methodology and use of software ticketing systems (Jira, Github)
• Experience with git-based repositories.
• Experience on implementing automated testing (QA) and continuous integration with systems.
• Excellent leadership skills to mentor engineers.
• Active open-source contributions and have a good understanding of open-source DataOps tools & ecosystem.
• Experience with JavaScript and JS frameworks is a plus.
• Developing country work experience and/or familiarity with emergency is considered an asset.
• Fluency in English is required. Knowledge of another official UN language (Arabic, Chinese, French, Russian or Spanish) or a local language is an asset.

About Our Team

We are a fast-paced, multi-disciplinary team of software engineers, finance specialists, data scientists, policy experts, and much more. Our team is a distributed workforce and plans to remain distributed into the foreseeable future. We are growing fast. Our team has grown by over 400% in the last 6 months as we rapidly scale to meet our stated mission.