Data Engineer with Bharti Institute of Public Policy

Job Title:

Data Engineer


Bharti Institute of Public Policy (BIPP)

Reportees to Position:









India Data Portal

We are looking for a passionate Data Engineers to join hands with us in building the best open data portal in the country. India Data Portal has the ambition to serve as a one-stop open-access portal for all public data related to the social sector and the environment to support an array of different stakeholders – researchers, students, journalists, policymakers, administrators, NGOs, and entrepreneurs – to access and interact with public datasets.

What do we do?

  • Thrive to build a platform with public data on a single portal providing seamless access to the data, inter-data comparisons, and visualisations.
  • We make data available in Machine Readable formats via automated, semi-automated data pipelines.
  • Engage with key stakeholders for improved open data usage across various domains/industries.


Job Purpose

  • Work with multiple projects for data collection using web-scraping techniques followed by automation/semi-automation of data ingestion workflows.
  • Ensure data is transformed and stored in efficient and secure methods for retrieval and use
  • Maintain and track the dataset updates from period to period
  • Create precise documentation and follow code standards, code management and automated systems to a smooth daily workflow responsible for the efficiency and effectiveness of ETL jobs
  • Maintain deep technical knowledge of various tools in the data warehouse, data hub, and analytical tools.
  • Manage a group of interns from various top institutions in the country to train the students and deliver work.


Skills Required:

  • Minimum 2-3 years of experience working on ETL pipelines using python
  • Should be familiar with using Apache Airflow, dbt or other orchestration technologies
  • Expertise in web-scraping using python – using selenium, scrapy, requests, beautiful soup, and other libraries
  • Hands-on experience with RDBMS, Cloud Storage like Amazon S3/ Google Cloud Storage
  • Excellent knowledge of data transformations using pandas, NumPy and other libraries
  • Good to know about Cloud  Implementation/deployment (either one of Azure, GCP, or Amazon)
  • Implementation of Serverless or Cloud Functions
  • Experience in data exchange products like CKAN will be an advantage
  • Should be independent and able to work in a fast-paced environment with minimal supervision
  • Good communication skills (verbal/written) to effectively communicate and work with the team to coordinate and deliver.


How to apply

  • ISB is committed to diversity at the workplace, and strongly encourages applications from women and minority candidates.
  • Upload your application on this link
  • Please upload your updated CV and a cover letter (500 words or less) discussing your motivation and why you think you are a good fit for this position.
  • Please note: Only applications sent through this link will be accepted. Applications will be reviewed on a rolling basis until the position is filled. Applicants will be contacted only if shortlisted for an interview.
  • In case of any issues in uploading, please write to with the subject line “Application for Data Engineer BIPP”.