Job Description
About the Role:
We are seeking a seasoned AI Data Engineer based in Hyderabad to design, build, and optimize scalable data pipelines and infrastructure that power advanced machine learning and AI solutions. You will collaborate with data scientists, ML engineers, and cross-functional teams to deploy, monitor, and maintain production-grade models, ensuring high performance, reliability, and security.
Responsibilities:
Design, develop, and maintain scalable ETL pipelines and data workflows using Python, SQL, Databricks, and Snowflake
Build and deploy machine learning pipelines on Azure, leveraging TensorFlow, PyTorch, and scikit-learn
Integrate, fine-tune, and optimize NLP models using Hugging Face and LangChain
Implement data ingestion, transformation, and storage solutions that support batch and real-time analytics
Monitor pipeline performance, troubleshoot bottlenecks, and ensure data quality and integrity
Collaborate with data scientists, ML engineers, and stakeholders to translate business requirements into robust technical solutions
Enforce best practices for data governance, security, and compliance in cloud environments
Required Qualifications:
8–12 years of experience in data engineering, software engineering, or related roles
Expert proficiency in Python and SQL for data processing and ETL
Hands-on experience with Databricks and Snowflake for large-scale data workloads
Proven track record deploying and managing ML models using TensorFlow, PyTorch, and scikit-learn
Experience with Hugging Face transformers and LangChain for NLP applications
Strong understanding of Azure cloud services including Azure Data Factory, Azure Databricks, and Azure ML
Deep knowledge of data modeling, data warehousing, and ETL best practices
Excellent problem-solving, communication, and collaboration skills
Preferred Qualifications:
Experience with MLOps frameworks and CI/CD pipelines for automated model deployment
Familiarity with containerization technologies such as Docker and orchestration with Kubernetes
Background in advanced natural language processing and state-of-the-art NLP techniques
Microsoft Azure certifications (e.g., Azure Data Engineer Associate)
Master’s degree in Computer Science, Data Science, or a related field
Experience mentoring junior engineers and leading technical projects
Position Details
- Position Title: AI Data Engineer
- Location:
- Experience Required: 12
