• Location: New York NY
• Type: Perm
• Job #23820

Company Overview:
A multi-strategy investment firm with over $8 billion in assets under management is seeking a Senior AI Engineer to join their central technology team. The role focuses on designing and implementing AI-native tools across the firm, integrating closely with on-prem data and systems.

Job Responsibilities:

• Build internal AI tools and automation workflows within on-prem datasets and infrastructure.
• Design and implement components for orchestration, vector search, and retrieval-augmented generation (RAG).
• Interface with external LLM APIs via secure, controlled endpoints; manage tokenization, prompts, and responses.
• Ensure secure data handling and auditability in hybrid on-prem and cloud LLM scenarios.
• Develop libraries and APIs for consistent, reusable patterns across user-facing tools.
• Integrate private databases, internal APIs, and real-time systems into AI workflows.
• Partner with stakeholders to gather requirements and prototype ideas.
• Identify and drive adoption of cutting-edge AI tools, frameworks, and vendors.
• Interface with management on feature implementation and requests.
• Develop agentic workflows for autonomous decision-making and task execution.
• Structure data for optimized retrieval, processing, and analysis.
• Deliver products tailored to varying levels of technical sophistication among end users.

Qualifications:

• Bachelor’s degree in computer science, operations research, or similar fields.
• 5+ years’ experience in backend or full-stack engineering, ideally with exposure to ML or AI tooling.
• Strong Python development skills; experience with modern LLM stacks.
• Comfortable working in hybrid environments with external API calls and internal data pipelines.
• Familiarity with standard infra tools like Docker, Kubernetes, and HAProxy.
• Experience designing secure, low-latency workflows across data boundaries.
• Excellent communication skills and a user-first mentality.

Compensation:
Salary: $150,000 – $250,000, Plus Bonus