Software Engineer III

About the Role We are seeking a dedicated and skilled developer to join our team of Data Engineers and Data Analysts working with various stakeholders. We are looking for an experienced Azure Data Engineer with 4–5 years of hands-on experience in building, optimizing, and maintaining scalable data solutions on Microsoft Azure and good knowledge of US Insurance terminologies. The ideal candidate will have strong expertise in Azure data services, Databricks, SQL, and modern data engineering practices, with a focus on performance, reliability, and data quality. You will also leverage various AI Agents like Azure Open AI, Databricks Genie Code, Genie and Copilot to improve productivity. About the Team: Team is tech hub for rest of the organization and hence working across multiple domains – US Healthcare, Insurance, Government etc. Team primarily works on data extraction, manipulation, loading, and analytics using technologies like Python, PySpark, Bigdata – HPCC, language ECL, Talend, Azure tools (Synapse, ADF etc), Power BI, Essbase etc. Key Responsibilities 1. Data Engineering & Pipeline Development Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Data Factory , Databricks , and Azure storage services . Ingest data from multiple sources including relational databases, APIs, and file-based systems into Azure data platforms. Implement data transformations on HPCC using ECL and on Azure platform using SparkSQL and PySpark in Azure Databricks. 2. Azure Databricks & Distributed Processing Develop and optimize notebooks and jobs using Azure Databricks . Write efficient Spark jobs for large-scale data processing. Implement best practices for cluster configuration, job scheduling, and cost optimization. 3. Data Modeling & Storage Design and implement data models on HPCC using ECL and also using Delta Lake , Parquet , or other columnar storage formats. Build and maintain curated, analytics-ready datasets (bronze, silver, gold layers). Ensure high data quality, consistency, and governance across data layers. 4. Performance Optimization Optimize ECL code or SQL and Spark workloads for performance and scalability. Apply partitioning, caching, indexing, and data pruning techniques. Monitor and troubleshoot data pipelines and Databricks jobs to resolve performance bottlenecks. 5. Data Security & Governance Implement security best practices using Azure IAM, managed identities, and RBAC . Apply data access controls and encryption standards. Participate in data governance initiatives and metadata management. 6. Collaboration & Documentation Work closely with business analysts, data scientists, and application teams to understand data requirements. Document data pipelines, transformations, and architectural designs. Participate in code reviews and promote data engineering best practices. Tech Stack: Azure Databricks PySpark & SparkSQL SQL Optimization Azure Data Factory Delta Lake ADLS Gen2 Data Modeling & ETL/ELT Performance Tuning Azure Security & RBAC Requirements: Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience). Should have 4-5 years of relevant experience. Knowledge of SDLC process like requirement gathering, design, implementation (Coding), testing, deployment, and maintenance. Solid understanding of software development principles, design patterns, and best practices. Proficient in requirement gathering and documentation. Excellent communication skills – verbal and written. Strong problem-solving skills. Good knowledge of Insurance terminology, Strong proficiency in SQL and data transformation logic. Hands-on experience with Azure Databricks , SparkSQL , and PySpark . Experience with Azure Data Factory , Azure Data Lake Storage (ADLS Gen2) , and Azure SQL / Synapse . Solid understanding of data warehousing concepts and ETL/ELT patterns. Experience working with large-scale, structured and semi-structured datasets. Experience with Agile development methodologies. Must have a positive attitude and desire to learn new processes and technologies. Good to Have Experience with CI/CD pipelines for data platforms (Azure DevOps, GitHub). Familiarity with Azure Synapse Analytics . Knowledge of HPCC Exposure to data quality frameworks and monitoring tools. Azure certifications (e.g., DP-203: Azure Data Engineer Associate ). Experience in Agile/Scrum development environments. Benefits: · Group Health Insurance Policy (covering self and family) · Group Life insurance/accident policy · Generous long-service awards · New Baby gift · Rewards and Certifications About Us RELX is a global provider of information-based analytics and decision tools for professional and business customers. We help scientists make new discoveries, doctors and nurses improve the lives of patients and lawyers win cases. We prevent online fraud and money laundering and help insurance companies evaluate and predict risk. Our events enable customers to learn about markets, source products and complete transactions. In short, we enable our customers to make better decisions, get better results and be more productive. The Group serves customers in more than 180 countries and has offices in about 40 countries. It employs over 33,000 people, of which around 1/4th are technologists. We want RELX to be a great place to work, where our employees feel valued, have equal opportunities and benefit from pay equality, regardless of their gender, gender identity, national origin, race, ethnicity, religion, sexual orientation, age or disability status. Inclusion and diversity are important to our future. We need the engagement of people from a wide range of backgrounds, experiences and ideas to achieve real innovation for our customers around the world. About LexisNexis Risk Solutions LexisNexis Risk Solutions Group is a portfolio of brands that span multiple industries providing customers with innovative technologies, information-based analytics and decision tools and data services. Our brands provide market-specific solutions that help our customers solve problems, make better decisions, stay compliant, reduce risk and improve their operations. Serving customers in more than 180 countries, we employ approximately 9,700 people. We are part of RELX, a global provider of information and analytics for professional and business customers. We have offices in 24 countries around the world. Apply today, or to learn more about opportunities with LexisNexis Risk Solutions or RELX Global, join us here: https://risk.lexisnexis.com/group/careers www.relx.com/careers/join-us We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120. Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here . Please read our Candidate Privacy Policy . We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. USA Job Seekers: EEO Know Your Rights .