Note: The job is a remote job and is open to candidates in USA. CACI is looking for an AI Prompt Engineer to join their EITaaS contract. The role involves designing, testing, and optimizing prompts for Large Language Models (LLMs) to ensure high-quality outputs while collaborating with various teams to streamline processes.

Responsibilities

• Develop, refine, and iterate on prompts for various generative AI models (LLMs) to elicit desired behaviors, responses, and creative outputs
• Conduct testing to compare prompt variations, analyze results drive continuous improvement
• Work closely with multiple groups to integrate prompts to streamline manual processes
• Stay abreast of the latest advancements in LLMs, generative AI, and prompt engineering techniques
• Provide input and collaborate on strategies for model fine-tuning and Retrieval Augmented Generation (RAG) to further improve accuracy
• Debug unexpected model behaviors, identifying root causes within prompt structure, model limitations, or data context

Skills

• US Citizenship
• A DoD secret clearance or ability to obtain
• Bachelor's degree in computer science, Software Engineering, Information Technology, or related field (equivalent experience may be considered in lieu of degree)
• 6+ months of professional software development experience, internships, or relevant academic project work
• 1+ year of hands-on experience working with Large Language Models (e.g., OpenAI GPT series, Llama, Gemini) or other generative AI models
• Experience with at least one programming language (Python, JavaScript/TypeScript)
• Familiarity with prompt engineering techniques (few-shot, chain-of-thought, structured outputs, function calling)
• Problem-solving skills, with a data-driven approach to experimentation and optimization
• Written and verbal communication skills, with an ability to articulate complex technical concepts clearly
• Ability to work independently and collaboratively in a fast-paced, evolving environment
• Familiarity with use cases and limitations of various AI implementation types: RAG, agentic, generative, etc
• Understanding of AI safety considerations (e.g., prompt injection, bias, data privacy)
• Exposure to Agile/Scrum development environments
• Experience with ServiceNow

Benefits

• Flexible time off benefit
• Robust learning resources
• Healthcare
• Wellness
• Financial
• Retirement
• Family support
• Continuing education
• Time off benefits

Company Overview