Senior Software Development Engineer in Test (SDET) - Benchmarking

Bitwarden promotes better internet security and safety with the leading open source password management solution for individuals, teams, and business organizations. Our philosophy on security is that “we are all in this together” – we continue to offer a full-featured free version of Bitwarden so that everyone can be protected with strong password management. We also provide enterprise-grade solutions to some of the largest companies in the world, and will continue to innovate in the identity and authentication market as the world starts to grow beyond passwords. Read more on the Bitwarden blog . As a Software Development Engineer in Test (SDET) on Bitwarden’s Autofill Coverage team, you will help make autofill work reliably on the sites people actually use, and keep it fast and unobtrusive as the product evolves. Autofill is the Bitwarden capability that fills logins, payment details, and identities into web forms across browsers. The Autofill Coverage team maintains and expands a curated dataset of site-specific autofill rules, builds automation that continuously checks autofill across popular websites, and builds lab-based measurement of autofill’s performance in the browser. Every engineer on the team works across all of this, so we value curiosity and range over a perfect match to any single tool. This is a hands-on role. You will spend your time writing, reviewing, and shipping code, alongside your teammatesand in close partnership with the wider Autofill team. WHAT YOU WILL DO UI Automation: Build and maintain browser automation that checks autofill across popular real-world websites and purpose-built test pages. Keep suites stable as sites change, with reliable locators, sensible waits, and flakiness fixed at its root. Performance Testing: Run, extend, and maintain lab-based benchmarks that measure how autofill affects page responsiveness, rendering, and memory in the browser. Set up runs, review results, and investigate numbers that look wrong. Trustworthy Results: Make sure test and benchmark results can be relied on. Confirm that two runs did the same work before comparing them, and flag misleading metrics before anyone acts on them. Test Scenarios: Build and maintain test pages that recreate tricky real-world patterns, such as dynamic forms, shadow DOM, and iframes, so they can be tested repeatably. Failure Triage: Reproduce autofill failures found by automation, support, or internal reports. Document them clearly, hand dataset fixes to teammates, and route the rest to the right owner. Reporting and Observability: Publish results to dashboards, set up alerting on regressions, and report coverage and trends on a regular cadence. AI-Assisted Development: Use AI coding assistants effectively in daily engineering and exercise judgement about where they help and where they do not. Help keep test documentation and Claude skills current as new autofill code lands. Learning and Collaboration: Pair with senior engineers on hard problems, share what you learn, and review teammates’ pull requests with care. Cross-Functional Partnership: Work closely with Software Engineer teammates, the Autofill team, Product, and Security on triage, test strategy, and release coordination. WHAT YOU BRING Overall Experience: 4–8 years in test automation, SDET, or software engineering roles, with hands-on UI automation of web applications and exposure to front-end performance testing. Technical Stack: We value strong automation fundamentals and a performance mindset over an exact tool match. Experience with load-testing tools such as JMeter or k6 is welcome, but this role centres on performance inside the browser. Expertise- UI automation with Playwright, Cypress, Selenium/WebDriver, or Puppeteer, including stable locators, waits, and handling flaky tests JavaScript or TypeScript, and Node.js HTML, the DOM, and CSS selectors Front-end performance testing with the Chrome DevTools Performance panel, Lighthouse, WebPageTest, or Core Web Vitals tooling Experience- CI/CD with GitHub Actions, Jenkins, or similar, and running tests in Docker. Interpreting performance results: percentiles, variance, and comparing runs fairly Dashboards and alerting with Datadog, Grafana, New Relic, or similar. Data or API validation with JSON Schema, Postman, or similar AI-assisted development, preferably Claude Code Familiarity- Chrome DevTools Protocol and browser Performance APIs (PerformanceObserver, Long Tasks, User Timing) Browser extensions and how they are tested (Manifest V3) Shell scripting Engineering Mindset: Curious about why a test failed, not just that it failed. You treat a flaky test or a surprising number as something to understand rather than rerun until green, and you pick up new tools quickly. Practical experience with containerized environments, automated test frameworks (unit, integration, and end-to-end), CI/CD pipelines, and observability tooling. Secure Coding: Familiarity with secure coding practices and care in handling test credentials and sensitive data, with an interest in how security shapes product decisions in a zero-knowledge product. Collaborative Spirit: A highly collaborative and adaptable mindset, excited to work in rapid, outcome-driven feedback loops. Open Source Passion: Excitement and enthusiasm for open source, developer advocacy, and building a more secure internet. Problem-Solving: Excellent problem-solving skills, valuing written, clear documentation and using data to make technical decisions. Why Join Us This is an opportunity to play a foundational role in shaping our India Engineering COE from the ground up. Our user community loves us and we love them. Come to work each day with a sense of purpose as we bring a more secure internet experience to everyone from our friends and family to the world’s largest organizations. Become an expert. You’ll get immersed in the prominent technology markets of security and open source software. You'll work alongside talented global teams, solve meaningful engineering challenges, influence how we scale our engineering organization & contribute to products used by customers around the world. If you're passionate about building exceptional teams, enabling engineering excellence, and making a lasting impact within a fast-growing engineering company, we'd love to hear from you. Equal Opportunity Employer We are committed to fostering an inclusive workplace where everyone can do their best work. We welcome applicants from all backgrounds and make employment decisions based on skills, experience, qualifications, and business needs.