
Senior Software Engineer - Data Engineering
TeikametricsPosted 4/22/2025

Senior Software Engineer - Data Engineering
Teikametrics
Job Location
Job Summary
Teikametrics, a leading AI-powered Marketplace Optimization platform, seeks a Senior Software Engineer - Data Engineering with strong computer science fundamentals and experience in data engineering, API Integration, or large-scale data processing. The role involves designing, developing, and scaling robust data pipelines to process massive amounts of structured and unstructured data. The candidate will work closely with data scientists, analysts, and product engineers to deliver high-performance, scalable solutions. With a strong background in building large-scale distributed data processing systems, the ideal candidate will have experience with Apache Spark (Scala or Python), Databricks, Kafka, AWS S3, and other distributed computing tools. Teikametrics offers flexible remote work options, $4,000/year travel stipends, and equity in a fast-growing company. Apply now to join our team of passionate engineers and contribute to groundbreaking projects.
Job Description
HOW YOU'LL SPEND YOUR TIME
- Design and implement highly scalable, fault-tolerant data pipelines for real-time and batch processing.
- Develop and optimize end-to-end Databricks Spark pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data.
- Build and manage ETL (Extract, Transform, Load) processes to integrate data from diverse sources into our data ecosystem.
- Implement data validation, governance, and quality assurance mechanisms to ensure accuracy, completeness, and reliability.
- Collaborate with data scientists, ML engineers, and analysts to integrate AI/ML models into production environments, ensuring efficient data pipelines for training, deployment, and monitoring.
- Work with real-time data streaming solutions such as Kafka, Kinesis, or Flink to process and analyze event-driven data.
- Improve and optimize performance, scalability, and efficiency of data workflows and storage solutions.
- Document technical designs, workflows, and best practices to facilitate knowledge sharing and maintain system documentation.
WHO YOU ARE
- 4+ years of experience as a professional software/data engineer, with a strong background in building large-scale distributed data processing systems.
- Experience with AI, machine learning, or data science concepts, including working on ML feature engineering, model training pipelines, or AI-driven data analytics.
- Hands-on experience with Apache Spark (Scala or Python) and Databricks.
- Experience with real-time data streaming technologies such as Kafka, Flink, Kinesis, or Dataflow.
- Proficiency in Java, Scala, or Python for building scalable data engineering solutions.
- Deep understanding of cloud-based architectures (AWS, GCP, or Azure) and experience with S3, Lambda, EMR, Glue, or Redshift.
- Experience in writing well-designed, testable, and scalable AI/ML data pipelines that can be efficiently reused and maintained with effective unit and integration testing.
- Strong understanding of data warehousing principles and best practices for optimizing large-scale ETL workflows.
- Experience with ML frameworks such as TensorFlow, PyTorch, or Scikit-learn.
- Optimize ML feature engineering and model training pipelines for scalability and efficiency.
- Knowledge of SQL and NoSQL databases for structured and unstructured data storage.
- Passion for collaborative development, continuous learning, and mentoring junior engineers.
WHAT CAN HELP YOU STAND OUT
- Exposure to MLOps or Feature Stores for managing machine learning model data.
- Experience with data governance, compliance, and security best practices.
- Experience working in a fast-paced startup environment.
WE'VE GOT YOU COVERED
- Every Teikametrics employee is eligible for company equity
- Remote Work – flexibility to work from home or from our offices + remote working allowance
- Broadband reimbursement
- Group Medical Insurance – Coverage of INR 7,50,000 per annum for a family
- Crèche benefit
- Training and development allowance