NeGD is currently inviting applications for the position of AI Safety Researcher on a contractual basis.

जिम्मेदारियां

Adversarial ML & Model Security Testing

• Design and execute adversarial attack campaigns — evasion, model inversion, membership inference, model extraction, data poisoning — against pod deliverables including document intelligence, predictive-analytics and fraud-scoring models, and visual AI, face-embedding and liveness models
• Develop and maintain a reusable adversarial ML attack library and test harness for repeatable preproduction evaluation
• Produce adversarial-robustness reports for each pod service with quantitative measures, reproducible attack notebooks, and prioritised mitigation guidance

LLM, RAG & Agentic AI Red Teaming

• Lead structured red-team exercises against LLM, RAG and agentic AI deployments across the programme
• Cover prompt injection, jailbreaks, indirect prompt injection via retrieved documents, data exfiltration, unsafe tool invocation, sandbox escape and policy-boundary violations by agents
• Develop and maintain red-team playbooks tailored to government AI use cases; publish anonymised playbooks and evaluation sets to AIKosh under standard metadata
• Advise pods on guardrail selection, output filtering, RAG source-integrity controls, retrieval provenance, and agent policy design

Hallucination, Calibration & Responsible AI Evaluation

• Design and run hallucination measurement, groundedness checks, and calibration/uncertainty evaluation for RAG systems and generative outputs across teams
• Run bias and fairness audits using quantitative metrics — demographic parity, equalised odds, calibration, subgroup accuracy
• Conduct explainability evaluation (SHAP, LIME, Captum) and lightweight privacy impact assessments on team deliverables
• Author the technical safety evaluation content in model cards, dataset sheets, bias/hallucination/safety evaluation reports, and Responsible AI evidence per the MeitY Responsible AI advisory and the IndiaAI Safe & Trusted AI framework

AI Security Architecture & Threat Modelling

• Own AI-specific threat modelling end-to-end for all pod systems under development — STRIDE, MITRE ATT&CK, MITRE ATLAS and OWASP Top 10 for LLMs — including data pipelines, retrieval sources, model artefacts, prompt paths, tool interfaces and output surfaces
• Review deployment configurations across IndiaAI Compute, on-premise/sovereign GPU and CSP API paths for AI-specific security risks; recommend controls and defensive patterns
• Contribute AI security and Responsible AI requirements to NeGD RFQs, RDRs and procurement documents; review empanelled-agency proposals for AI security posture

Cross-Programme Advisory, Upskilling & Governance Input

• Advise each team’s AI QA Engineer on safety and Responsible AI test design, sample selection, evaluation metrics and evidence capture
• Brief and upskill teams on AI-specific security concerns and Responsible AI controls

Research, Publication & Knowledge Transfer

• Track adversarial ML, LLM safety, agentic-AI safety and Responsible AI research literature; translate relevant findings into team-usable checks, controls and evaluation additions
• Maintain the programme’s open-source AI safety testing toolkit; deposit reusable notebooks, evaluation harnesses and playbooks to OpenForge, and publish reusable evaluation sets and safety artefacts to AIKosh under standard metadata for reuse

महत्वपूर्ण लिंक

राष्ट्रीय ई-गवर्नेंस प्रभाग (NeGD) के बारे में

राष्ट्रीय ई-गवर्नेंस प्रभाग (एनईजीडी) डिजिटल इंडिया कॉर्पोरेशन, इलेक्ट्रॉनिक्स और सूचना प्रौद्योगिकी मंत्रालय के तहत एक स्वतंत्र व्यापार प्रभाग है। एनईजीडी केंद्र और राज्य दोनों स्तरों पर विभिन्न मंत्रालयों/विभागों द्वारा किए गए ई-गवर्नेंस परियोजनाओं और पहलों के कार्यक्रम प्रबंधन और कार्यान्वयन में एमईआईटीवाई का समर्थन करने में महत्वपूर्ण भूमिका निभा रहा है।

एनईजीडी डिजिटल इंडिया कार्यक्रम के तत्वावधान में कई नवीन पहलों का नेतृत्व कर रहा है। इन्हें डिजिटल इंडिया के विज़न क्षेत्रों को केंद्र में रखते हुए विकसित किया गया है - प्रत्येक नागरिक, शासन और मांग पर सेवाओं और विशेष रूप से हमारे देश के नागरिकों के डिजिटल सशक्तिकरण के लिए मुख्य उपयोगिता के रूप में डिजिटल बुनियादी ढांचा प्रदान करना; इनमें से कुछ पहलों में डिजिलॉकर, उमंग, पोषण ट्रैकर, ओपनफोर्ज प्लेटफॉर्म, एपीआई सेतु, नेशनल एकेडमिक डिपॉजिटरी, एकेडमिक बैंक ऑफ क्रेडिट्स, लर्निंग मैनेजमेंट सिस्टम शामिल हैं।