Data Engineer

Overview

Job Title: Data Engineer

Function: Bharti Institute of Public Policy

Location: Mohali, Punjab

Reports to position: Chief Data Scientist

Reportees to Position: Junior Data Engineers

Band: FT

Job Description

Job Purpose:

The Data Engineer will be responsible for the end-to-end design, development, deployment, and maintenance of the Metadata Registry Platform for the State Data Authority (SDA) of Uttar Pradesh. The role is positioned at the DataHub at Bharti Institute of Public Policy, Mohali, to work closely with the SDA implementation team at a BIPP and the State Transformation Commission Lucknow.

The Metadata Registry is one of the initial goals in the roadmap of SDA development. This is a platform that enables departments of the Government of Uttar Pradesh to discover, classify, and govern their data assets in line with the state’s vision 2030.

The successful candidate will oversee the data pipelines, and backend development, oversee UAT, ensure deployment on the UPSDC servers, and build the monitoring dashboard.

Job Outline:

The Data Engineer will carry out the following key activities:

• Platform Architecture & Design: Design the Registry’s system architecture, database schema, and API layer in alignment with BIPP’s technical blueprint. Ensure the architecture is modular, open-source, and deployable on the UP State Data Centre (UPSDC) infrastructure.
• Backend Development: Build RESTful APIs and backend services using Python/Node.js; develop data ingestion pipelines for dataset metadata; implement role-based access control (RBAC) for Data Owners, Stewards, and administrators.
• Compliance Dashboard: Build a real-time compliance dashboard tracking dataset registration status, classification completeness, and DPDP Act alignment across onboarded departments.
• UAT & Deployment: Lead User Acceptance Testing with STC IT team and pilot departments; resolve bugs; deploy the applications to the UPSDC-compatible production environment.
• Junior DE Supervision: Mentor and technically supervise two Junior Data Engineers; review code, assign tasks, and ensure delivery quality.
• Frontend Development: Although, there will be Full Stack developers working along in the team, but the candidate is required have some knowledge of frontend frameworks to oversee and align the development work.

Job Specifications

Knowledge / Education:

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, Information Technology, or related field
• Understanding of data governance frameworks and open data standards is an advantage

Specific Skills:

• Strong proficiency in Python and for backend development. Node.js experience is also welcome
• Experience with RESTful API design and development
• Frontend development using React or equivalent JavaScript framework
• Relational and NoSQL databases (PostgreSQL, MongoDB)
• Containerisation and deployment (Docker, Linux server environments)
• Familiarity with RBAC, data security, and access control patterns

Desirable Experience:

• 3–6 years of experience in software development, with at least 2 years in data focused work
• Prior experience working on government or public sector digital platforms is strongly preferred
• Experience with data catalogues, metadata management, or open data portals is an advantage
• Exposure to DPDP Act, data classification, or data governance contexts is desirable

How to Apply?

All applications must be submitted exclusively through the JotForm link provided below. Applicants are required to upload their CV and cover letter directly within the form at the designated sections.

JotForm Link: https://form.jotform.com/260973190114050 

Applications will be reviewed until the position is filled. You will be contacted only in case you are shortlisted for an interview.