Senior Automation Engineer

Department: Engineering

Employment Type: Full time

Location: Remote, India

About the Role

At realfast.ai, we deliver superhuman quality at superhuman speed. We're building the first truly AI-native Salesforce implementation partner, amplifying what makes humans exceptional. Our Exo platform automates tedious work, giving developers back valuable time for high-impact tasks. We are looking for a quality-obsessed automation engineer who can build robust test automation while understanding business needs.

Responsibilities

• Build automation frameworks from the ground up for web, API, CLI, and AI system testing.
• Design and implement QA automation for our SaaS products (Exo Help, Exo Code) and platform infrastructure.
• Create AI testing infrastructure including eval suites, prompt testing scenarios, and non-deterministic system validation.
• Build QA productivity tools that enhance efficiency within the Salesforce ecosystem.
• Write functional test suites covering API endpoints, web interfaces, and backend services.
• Prototype and ideate automation solutions that enhance developer and QA productivity.
• Collaborate across teams, working closely with platform engineers, AI engineers, and services teams.
• Champion quality by establishing automation best practices and testing standards.
• Explore new automation technologies and AI testing patterns that could lead to breakthroughs.

Requirements

• 5-8 years of hands-on automation experience building and maintaining test automation frameworks.
• Expertise in web automation with tools like Playwright, Selenium, Cypress, or similar modern frameworks.
• Deep experience automating REST/GraphQL APIs and building comprehensive test suites.
• Strong programming skills in Python, JavaScript/TypeScript, or similar languages.
• Experience in building test automation frameworks from scratch.
• Familiarity with CI/CD integration (GitHub Actions, Jenkins, CircleCI).
• Experience or strong interest in testing AI/ML systems, including writing eval suites and prompt testing.
• Knowledge of multiple test layers: unit, integration, e2e, API, and web UI testing.
• Understanding of testing design patterns, such as testing pyramids and Page Object Model.
• Familiarity with Salesforce testing tools and QA workflows (good to have).
• Comfortable collaborating with developers, AI engineers, and business stakeholders.
• Ability to articulate the value of automation and testing to various audiences.
• Self-starter mentality, thriving in ambiguous environments.
• Natural inclination toward building reusable automation solutions.
• Avid learner who stays current with automation and AI testing trends.

This Role is for You If

• You are a quality champion who loves building automation that catches bugs before customers see them.
• You are excited about AI testing challenges, such as evaluating prompts and testing non-deterministic systems.
• You want to build automation platforms that enable teams to ship faster with confidence.
• You are interested in the business impact of quality automation, not just test coverage numbers.
• You thrive in environments where you can build automation practices from the ground up.
• You can quickly demonstrate value through automation that prevents production issues.
• You are comfortable with rapid changes in technology stack and testing requirements.

This Role is NOT for You If

• You prefer a strictly defined role with clear boundaries between QA, automation, and development.
• You need detailed test cases written for you before you can automate.
• You require extensive guidance to identify what should be tested.
• You are looking for a purely manual testing position without building automation.
• You prefer to specialize deeply in one testing tool rather than being versatile across the stack.
• You are uncomfortable with rapid changes in direction and technology choices.
• You prefer maintaining existing test suites over building new automation frameworks from scratch.
• You want to manage people (this is a senior individual contributor role).