Conversational AI & Prompt Engineer
• About Our Client: The organization operates in the entrepreneurial support space, focused on simplifying the process of starting, running, and growing small businesses. It addresses the common challenges faced by entrepreneurs, such as navigating complex forms, taxes, and state compliance. The company is fully remote with team members across the United States, contributing to a nationwide impact by enabling individuals to launch and manage their businesses more effectively.
- About the Opportunity:
The Conversational AI & Prompt Engineer will shape the voice and functionality of an AI system designed to improve interactions between entrepreneurs and the organization’s services. This role blends conversational design with advanced language model optimization to create clear, trustworthy, and efficient AI experiences. The position is critical for enhancing how AI supports business growth, focusing on continuous improvement through data-driven experimentation and collaboration. Reporting to the Senior Director of Growth & AI, this fully remote role aligns AI capabilities with user needs to drive customer satisfaction and operational efficiency.
- Responsibilities:
- Analyze conversation transcripts and user feedback to identify issues and prompt weaknesses
- Define and track conversational KPIs with product leadership
- Optimize prompts and model choices for cost, speed, and scalability
- Collaborate with engineers to improve evaluation criteria like intent recognition
- Design and maintain frameworks for prompt performance evaluation using datasets and automated scoring
- Implement safeguards to prevent hallucinations, prompt injections, and ensure compliance
- Design, map, and implement complex conversation flows including error recovery and human escalation
- Continuously optimize system prompts for accuracy, tone, and brand alignment
- Design structured outputs, function calls, and tool-routing to support data capture and system integration
- Requirements:
- 5+ years experience with 2+ years in Conversational AI, LLM Engineering, Prompt Engineering, or NLP production systems
- Expertise in designing and optimizing prompts for GPT, Gemini, or similar models, including structured outputs and function calling
- Practical experience with RAG pipelines including chunking, embeddings, and retrieval evaluation
- Experience building evaluation datasets and conducting prompt experiments such as A/B testing and regression testing
- Proficiency in Python or TypeScript and experience integrating LLM APIs in production
- Strong analytics skills to interpret conversational data and improve performance
- Systems thinking, user empathy, and ability to translate business logic into scalable AI behavior
- Experience with agentic systems similar to Decagon, Agentforce, Fin, or Sierra
- Pay Range and Compensation Package:
- The pay range and compensation package for this role will be determined based on the candidate’s experience, skills, and other relevant factors.
- Benefits & Perks:
- Medical, vision, dental, disability, and life insurance for employees and dependents
- Parental and military leave
- Employee assistance program
- 401(k) plan with company match
- Annual bonus and restricted stock units (RSUs)
- Pet insurance
- Paid parking for in-office employees
- Ten paid holidays
- Regular virtual and in-person social events including talent shows, competitions, and hackathons
Equal Opportunity Statement: Our client is an equal opportunity employer. They celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, or national origin. Note RemoteHunter is not the Employer of Record (EOR) for this role. Our purpose in this opportunity is to connect exceptional candidates with leading employers. We help job seekers worldwide discover roles that match their goals and guide them to complete their full application directly through the hiring company’s career page or ATS.