NeGD is currently inviting applications for the position of AI Safety Researcher on a contractual basis.

Responsibilities

Adversarial ML & Model Security Testing

• Design and execute adversarial attack campaigns — evasion, model inversion, membership inference, model extraction, data poisoning — against pod deliverables including document intelligence, predictive-analytics and fraud-scoring models, and visual AI, face-embedding and liveness models
• Develop and maintain a reusable adversarial ML attack library and test harness for repeatable preproduction evaluation
• Produce adversarial-robustness reports for each pod service with quantitative measures, reproducible attack notebooks, and prioritised mitigation guidance

LLM, RAG & Agentic AI Red Teaming

• Lead structured red-team exercises against LLM, RAG and agentic AI deployments across the programme
• Cover prompt injection, jailbreaks, indirect prompt injection via retrieved documents, data exfiltration, unsafe tool invocation, sandbox escape and policy-boundary violations by agents
• Develop and maintain red-team playbooks tailored to government AI use cases; publish anonymised playbooks and evaluation sets to AIKosh under standard metadata
• Advise pods on guardrail selection, output filtering, RAG source-integrity controls, retrieval provenance, and agent policy design

Hallucination, Calibration & Responsible AI Evaluation

• Design and run hallucination measurement, groundedness checks, and calibration/uncertainty evaluation for RAG systems and generative outputs across teams
• Run bias and fairness audits using quantitative metrics — demographic parity, equalised odds, calibration, subgroup accuracy
• Conduct explainability evaluation (SHAP, LIME, Captum) and lightweight privacy impact assessments on team deliverables
• Author the technical safety evaluation content in model cards, dataset sheets, bias/hallucination/safety evaluation reports, and Responsible AI evidence per the MeitY Responsible AI advisory and the IndiaAI Safe & Trusted AI framework

AI Security Architecture & Threat Modelling

• Own AI-specific threat modelling end-to-end for all pod systems under development — STRIDE, MITRE ATT&CK, MITRE ATLAS and OWASP Top 10 for LLMs — including data pipelines, retrieval sources, model artefacts, prompt paths, tool interfaces and output surfaces
• Review deployment configurations across IndiaAI Compute, on-premise/sovereign GPU and CSP API paths for AI-specific security risks; recommend controls and defensive patterns
• Contribute AI security and Responsible AI requirements to NeGD RFQs, RDRs and procurement documents; review empanelled-agency proposals for AI security posture

Cross-Programme Advisory, Upskilling & Governance Input

• Advise each team’s AI QA Engineer on safety and Responsible AI test design, sample selection, evaluation metrics and evidence capture
• Brief and upskill teams on AI-specific security concerns and Responsible AI controls

Research, Publication & Knowledge Transfer

• Track adversarial ML, LLM safety, agentic-AI safety and Responsible AI research literature; translate relevant findings into team-usable checks, controls and evaluation additions
• Maintain the programme’s open-source AI safety testing toolkit; deposit reusable notebooks, evaluation harnesses and playbooks to OpenForge, and publish reusable evaluation sets and safety artefacts to AIKosh under standard metadata for reuse

Important Links

About National e-Governance Division (NeGD)

The National e-Governance Division (NeGD) is an independent business division under the Digital India Corporation, Ministry of Electronics and Information Technology. NeGD has been playing a pivotal role in supporting MeitY in Programme Management and implementation of e-Governance projects and initiatives undertaken by various Ministries/ Departments, both at the Central and State levels.

NeGD has been spearheading several innovative initiatives under the aegis of the Digital India Programme. Those have been developed keeping the vision areas of Digital India at the core- providing digital infrastructure as a core utility to every citizen, governance and services on demand and in particular, digital empowerment of the citizens of our country; some of these initiatives include DigiLocker, UMANG, Poshan Tracker, OpenForge Platform, API Setu, National Academic Depository, Academic Bank of Credits, Learning Management System.