hero

Accelerate your career.

Explore opportunities across TA's portfolio

Lead Data Engineer

Solifi

Solifi

Software Engineering, Data Science
India
Posted on Dec 11, 2025
Lead Data Engineer
VN885
Lead Data Engineer
Bangalore
Solifi deliver a solid financial technology foundation for equipment, working capital, wholesale, and automotive finance firms. At Solifi, we believe that commerce is only as strong as the system it runs on. Our mission is to reshape finance technology by bringing together proven solutions into a singular powerful technology platform designed to help protect and scale financial organizations. We guard our customers by being precise and reliable, we guide their success by combining powerful technology with proven expertise, and we help them grow by unleashing their potential.
You will be joining a dynamic engineering team focused on building scalable, cloud-native applications that power key business functions. This role primarily with Python, dbt, Redshift/Redshift Spectrum, Quicksight and other AWS services to deliver secure, performant, and resilient solutions. The environment is highly collaborative, agile, and quality-driven. Engineers partner closely with product managers, architects, and cross-functional groups to translate business requirements into well-designed, customer-centric products. The team values continuous improvement, modern engineering practices, and a culture of mentorship, ownership, and innovation.
As a Lead Data Engineer, you are a senior technical leader responsible for architecting, building, and optimizing large-scale data pipelines, models, and reporting systems that power Solifi’s risk-management platform. You design and implement cloud-native data solutions that transform operational data into reliable, accessible, and scalable datasets for analytics, reporting, and cross-team consumption.
You bring deep experience in Python-based data engineering, ELT patterns, complex data modeling, and building modern AWS-native data ecosystems. You excel at solving difficult data integration challenges and enabling analytics teams through well-structured data pipelines, curated datasets, dashboards, and APIs.
While the role is primarily data engineering–focused, you can comfortably work in .NET (C#) when necessary, especially to create microservices that expose curated data for internal or customer-facing scenarios. You work closely with product, engineering, and business stakeholders, helping shape the long-term data strategy for Solifi’s risk data ecosystem.
As a Staff-level engineer, you act as a technical authority, mentor, and thought leader, driving improvements in data quality, engineering best practices, and architectural robustness across the organization.
• Architect, design, and build scalable data pipelines in Python, transforming operational and analytical data into structured datasets for reporting, analytics, and downstream systems.
• Lead the creation of ELT processes including ingestion, validation, enrichment, aggregation, and historical data modeling.
• Develop and maintain AWS-native data platforms, including S3-based data lakes/marts, Redshift Spectrum, and other related AWS services.
• Design and build Amazon QuickSight dashboards and reports that deliver high-quality insights for customers and internal teams.
• Integrate and unify data from multiple, diverse data sources to create comprehensive datasets supporting large-scale risk analysis and reporting.
• Implement best practices in schema design, partitioning strategies, metadata management, and file formats (including Parquet and Apache Avro).
• Build and maintain .NET microservices that expose curated data via RESTful APIs for operational and analytical needs.
• Partner with engineering and product teams to define data requirements and deliver robust, scalable solutions.
• Drive improvements in data reliability, quality, lineage, and observability, ensuring stakeholders trust the platform’s outputs.
• Optimize processing and query performance across compute, storage, and orchestration layers.
• Mentor engineers, influence architectural decisions, and elevate data engineering practices across Solifi.
• Participate in technical design reviews, architectural discussions, and long-term planning, providing deep expertise in data systems and cloud-scale patterns.
Bachelor’s degree in Computer Science, Engineering, Data Science, or equivalent experience. 8+ years of experience in data engineering or software engineering with significant exposure to cloud-native data systems. Deep expertise in building Python-based data pipelines and ELT/ETL workflows. Strong experience with AWS data services, including: S3 (data lake/mart patterns) Redshift / Redshift Spectrum Glue, Lambda, or Step Functions (nice to have) Hands-on experience with Apache Avro, Parquet, ORC, or other columnar storage formats. Strong SQL skills and experience with analytical queries, schema design, and performance tuning. Demonstrated experience building Amazon QuickSight dashboards and analytical solutions. Experience integrating data from multiple heterogeneous sources into unified structures. Ability to build or modify .NET (C#) microservices, especially those exposing data via RESTful APIs. Deep understanding of data quality frameworks, governance, lineage, and reliability practices. Excellent problem-solving, debugging, and communication skills. Proven ability to collaborate across teams and mentor engineers. Preferred: Experience working with high-volume or real-time data flows. Familiarity with event-driven/data streaming architectures (Kafka, Kinesis, SNS/SQS). Experience with infrastructure-as-code (Terraform, CloudFormation). Knowledge of semantic layers, data catalogs, or metadata management systems. Experience creating internal data tooling, automation frameworks, or libraries. Exposure to risk-management systems, financial platforms, or regulated environments. Experience evaluating and introducing new technologies through proof-of-concepts.
8 years
Bachelor's Degree
Full Time
Group Medical Insurance, Group Personal Accident, Employee Anniversary gift, Loyalty Bonus, Employee Referral Bonus, Rewards and Recognition program, Wellness Allowance, Privilege Leave (PL): 15 days per year, Casual Leave (CL) 12 days per year, Maternity/paternity/Bereavement leave
07 Jun 2026