Overview
CertifyOS is seeking an AI-first Software Development Engineer in Test (SDET) to build reliable, scalable, high-quality software by combining test automation with AI-assisted and agentic engineering workflows.
What you'll do
- Adopt AI-assisted and agentic approaches across the testing lifecycle.
- Use AI coding agents to generate, execute, debug, and maintain automated tests.
- Build AI-assisted workflows for test case generation from product specifications and acceptance criteria.
- Explore agentic testing approaches that can independently execute workflows, identify failures, and report defects.
- Use AI to analyse test failures, identify patterns, and suggest potential root causes.
- Continuously identify opportunities to reduce manual effort through AI and automation.
- Build and maintain scalable automation frameworks for UI, API, integration, and end-to-end testing.
- Develop reusable test components and automation libraries.
- Automate critical business workflows and regression suites.
- Integrate automated testing into CI/CD pipelines.
- Design and execute load, stress, spike, and endurance tests.
- Simulate real-world traffic, concurrent users, and high-volume API requests.
- Establish performance benchmarks and service-level objectives.
- Identify bottlenecks across APIs, databases, microservices, and infrastructure.
- Analyse latency, throughput, resource utilisation, and error rates.
- Work with developers to identify and resolve performance bottlenecks.
- Validate application behaviour as traffic, data volume, and workloads increase.
- Identify scalability limitations across distributed systems.
- Test asynchronous workflows, queues, event processing, retries, and failure recovery.
- Evaluate database performance and query efficiency under load.
- Identify resource constraints and potential points of failure.
- Contribute to capacity planning and reliability improvements.
- Work with developers and product managers to identify quality risks early.
- Participate in technical design and code reviews.
- Define quality gates and automation standards.
- Build a culture where quality is everyone's responsibility.
What you'll need
- 3–6 years of experience in software testing and automation engineering.
- Strong programming skills in Python, Java, or JavaScript/TypeScript.
- Hands-on experience with Playwright, Cypress, or Selenium.
- Strong API automation and backend testing experience.
- Experience with performance testing tools such as k6, JMeter, or Locust.
- Understanding of microservices and distributed systems.
- Good knowledge of SQL and database testing.
- Experience integrating automated tests into CI/CD pipelines.
- Practical experience using AI coding assistants and AI agents.
- Ability to analyse logs, metrics, and performance bottlenecks.
- Be comfortable working with AI coding agents such as Claude Code, Cursor, or GitHub Copilot.
- Use AI to generate test scenarios, automation scripts, and test data.
- Understand how to validate AI-generated code and prevent unreliable tests.
- Explore agentic workflows for autonomous test execution and failure analysis.
- Build reusable AI-powered testing workflows rather than relying only on manual prompting.
Nice to have
- Experience with AWS or GCP.
- Familiarity with Docker and Kubernetes.
- Experience with Kafka or other messaging systems.
- Exposure to Grafana, Prometheus, Datadog, or similar observability tools.
- Knowledge of chaos engineering and resilience testing.
- Experience with database performance tuning.
Read the full description and apply on the company’s own careers page.