Data Engineer

We are looking for a skilled LLM Application Developer to join our team. You will be working closely with the Data Scientists and be responsible for implementing large language model (LLM) based applications, working with proprietary and open-source models as well as popular frameworks such as LangChain to ensure seamless integration and development.

Requirements:

• Proven experience in building customer-facing ML-based APIs.
• Experience in developing scalable applications to handle TBs of data.
• Strong knowledge of API integration (RESTful, GraphQL).
• Experience with data preprocessing, SQL, NoSQL databases, and vector stores (e.g., Postgres, MySQL, Solr, Elasticsearch/OpenSearch, etc.)
• Familiarity with deployment tools (Docker, Kubernetes).
• Experience with DevOps tools like Jenkins, Terraform, and Cloud Formation templates is highly preferred.
• Excellent problem-solving and communication skills.
• Experience with Spark/Hadoop, EMR, or any other Big Data technology would be a plus.
• Ability to work collaboratively in an agile team environment.

Responsibilities:

• Building standalone applications that interact with LLM models.
• Building RAG-based applications.
• Understanding of Vector databases like Solr for LLM-based applications.
• Integrate models with existing systems and APIs.
• Implement production-quality ETL jobs.
• Preprocess and manage data for training and deployment.
• Collaborate with cross-functional teams to define, design, and ship new features.
• Write clean, maintainable, and efficient code.
• Document development processes, code, and APIs.

Preferred Qualifications:

• Degree in Computer Science, Data Science, or a related field.
• Certifications in machine learning, data science, or cloud computing.
• Portfolio showcasing past projects or contributions to open-source projects